Jun 14 03:10:29.881371 ip-10-0-138-133 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 14 03:10:29.881385 ip-10-0-138-133 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 14 03:10:29.881396 ip-10-0-138-133 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 14 03:10:29.881700 ip-10-0-138-133 systemd[1]: Failed to start Kubernetes Kubelet. Jun 14 03:10:40.026167 ip-10-0-138-133 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 14 03:10:40.026184 ip-10-0-138-133 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6134c0f9d60844f59c13531f6d10782b -- Jun 14 03:13:09.721217 ip-10-0-138-133 systemd[1]: Starting Kubernetes Kubelet... Jun 14 03:13:10.143487 ip-10-0-138-133 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 03:13:10.143487 ip-10-0-138-133 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 03:13:10.143487 ip-10-0-138-133 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 03:13:10.143487 ip-10-0-138-133 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 03:13:10.143487 ip-10-0-138-133 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 03:13:10.145501 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.145420 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 03:13:10.151652 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151637 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 03:13:10.151652 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151652 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151655 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151659 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151663 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151665 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151668 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151671 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151674 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151676 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151681 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151685 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151688 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151691 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151694 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151700 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151703 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151706 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151708 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151711 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 03:13:10.151728 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151713 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151716 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151718 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151721 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151723 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151726 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151728 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151731 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151734 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151737 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151739 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151742 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151744 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151747 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151750 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151752 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151755 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151757 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151760 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151762 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 03:13:10.152234 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151765 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151768 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151770 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151773 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151775 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151777 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151780 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151782 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151785 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151787 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151790 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151792 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151795 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151797 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151800 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151812 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151815 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151818 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151820 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151823 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 03:13:10.152781 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151826 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151829 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151831 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151835 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151838 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151840 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151843 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151845 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151848 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151851 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151853 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151858 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151861 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151864 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151867 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151870 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151873 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151875 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151878 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151880 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 03:13:10.153314 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151882 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151886 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151888 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151891 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151894 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151896 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151899 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151902 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151905 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151907 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151910 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151912 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151914 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151917 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151919 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151922 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151936 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151938 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 03:13:10.153817 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.151941 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 03:13:10.155119 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155107 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 03:13:10.155119 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155119 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155122 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155125 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155128 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155131 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155133 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155136 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155138 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155141 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155144 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155147 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155149 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155152 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155154 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155157 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155159 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155162 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155165 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155167 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 03:13:10.155180 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155170 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155172 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155174 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155178 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155182 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155185 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155188 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155192 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155195 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155197 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155200 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155202 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155204 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155207 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155209 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155212 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155214 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155218 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155222 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 03:13:10.155679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155225 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155227 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155230 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155232 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155235 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155237 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155240 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155242 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155244 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155247 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155249 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155251 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155254 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155256 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155258 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155262 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155264 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155267 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155269 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155272 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 03:13:10.156212 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155274 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155276 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155279 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155281 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155285 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155288 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155291 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155293 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155296 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155298 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155301 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155303 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155306 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155309 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155311 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155314 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155316 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155318 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155321 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 03:13:10.156760 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155324 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155326 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155328 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155331 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155333 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155337 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155339 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155342 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155344 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155347 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155349 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155352 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155354 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155357 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155359 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155362 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155364 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155367 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155369 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155371 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 03:13:10.157265 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155374 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155721 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155725 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155728 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155730 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155733 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155737 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155741 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155744 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155746 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155749 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155751 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155755 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155757 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155760 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155763 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155765 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155768 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155770 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 03:13:10.157785 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155773 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155775 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155778 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155780 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155783 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155786 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155788 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155790 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155793 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155795 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155798 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155800 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155813 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155816 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155819 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155821 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155824 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155826 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155829 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155832 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 03:13:10.158368 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155835 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155837 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155840 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155842 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155844 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155847 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155849 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155851 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155854 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155857 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155860 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155863 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155865 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155868 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155870 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155872 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155877 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155880 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155883 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 03:13:10.158888 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155886 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155889 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155891 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155894 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155896 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155899 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155901 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155903 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155906 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155908 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155911 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155913 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155916 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155919 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155922 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155937 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155940 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155942 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155946 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155950 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 03:13:10.159389 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155953 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155956 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155959 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155962 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155964 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155967 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155969 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155972 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155974 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155977 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155979 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155982 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155984 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155986 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155989 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155991 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155994 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155997 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.155999 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156002 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 03:13:10.159941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156004 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156006 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156077 2581 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156092 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156100 2581 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156104 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156109 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156112 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156116 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156120 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156123 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156126 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156129 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156132 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156135 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156138 2581 flags.go:64] FLAG: --cgroup-root="" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156141 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156144 2581 flags.go:64] FLAG: --client-ca-file="" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156146 2581 flags.go:64] FLAG: --cloud-provider="external" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156149 2581 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156153 2581 flags.go:64] FLAG: --cluster-domain="" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156155 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156158 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156161 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 03:13:10.160457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156164 2581 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156168 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156170 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156176 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156179 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156182 2581 flags.go:64] FLAG: --contention-profiling="false" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156184 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156187 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156190 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156193 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156196 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156199 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156202 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156205 2581 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156207 2581 flags.go:64] FLAG: --enable-server="true" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156211 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156215 2581 flags.go:64] FLAG: --event-burst="100" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156218 2581 flags.go:64] FLAG: --event-qps="50" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156221 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156224 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156227 2581 flags.go:64] FLAG: --eviction-hard="" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156233 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156236 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156238 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156241 2581 flags.go:64] FLAG: --eviction-soft="" Jun 14 03:13:10.161083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156244 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156246 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156249 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156252 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156255 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156257 2581 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156260 2581 flags.go:64] FLAG: --feature-gates="" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156263 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156266 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156269 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156274 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156277 2581 flags.go:64] FLAG: --healthz-port="10248" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156280 2581 flags.go:64] FLAG: --help="false" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156282 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156285 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156288 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156291 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156294 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156298 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156300 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156303 2581 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156305 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156308 2581 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 03:13:10.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156311 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156314 2581 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156317 2581 flags.go:64] FLAG: --kube-reserved="" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156320 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156323 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156327 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156329 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156332 2581 flags.go:64] FLAG: --lock-file="" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156334 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156337 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156340 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156345 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156347 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156350 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156353 2581 flags.go:64] FLAG: --logging-format="text" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156356 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156359 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156361 2581 flags.go:64] FLAG: --manifest-url="" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156364 2581 flags.go:64] FLAG: --manifest-url-header="" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156369 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156372 2581 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156376 2581 flags.go:64] FLAG: --max-pods="110" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156379 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156381 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156384 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 03:13:10.162349 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156387 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156390 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156392 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156395 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156402 2581 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156405 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156408 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156411 2581 flags.go:64] FLAG: --pod-cidr="" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156414 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156419 2581 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156422 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156425 2581 flags.go:64] FLAG: --pods-per-core="0" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156428 2581 flags.go:64] FLAG: --port="10250" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156432 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156435 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-047a68926ba65ec0c" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156437 2581 flags.go:64] FLAG: --qos-reserved="" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156440 2581 flags.go:64] FLAG: --read-only-port="10255" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156443 2581 flags.go:64] FLAG: --register-node="true" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156446 2581 flags.go:64] FLAG: --register-with-taints="" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156449 2581 flags.go:64] FLAG: --registry-burst="10" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156451 2581 flags.go:64] FLAG: --registry-qps="5" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156454 2581 flags.go:64] FLAG: --reserved-cpus="" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156457 2581 flags.go:64] FLAG: --reserved-memory="" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156460 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156463 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 03:13:10.163099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156466 2581 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156471 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156474 2581 flags.go:64] FLAG: --runonce="false" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156476 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156479 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156482 2581 flags.go:64] FLAG: --seccomp-default="false" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156484 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156487 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156490 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156493 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156495 2581 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156498 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156501 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156503 2581 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156506 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156509 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156512 2581 flags.go:64] FLAG: --system-cgroups="" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156514 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156519 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156522 2581 flags.go:64] FLAG: --tls-cert-file="" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156525 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156529 2581 flags.go:64] FLAG: --tls-min-version="" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156531 2581 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156534 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156537 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 03:13:10.163743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156539 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156542 2581 flags.go:64] FLAG: --v="2" Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156546 2581 flags.go:64] FLAG: --version="false" Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156549 2581 flags.go:64] FLAG: --vmodule="" Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156553 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.156556 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156664 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156667 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156672 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156675 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156677 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156680 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156683 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156685 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156687 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156690 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156692 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156695 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156697 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156700 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156702 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 03:13:10.164410 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156704 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156707 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156709 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156712 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156714 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156717 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156721 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156723 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156726 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156728 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156730 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156733 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156735 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156738 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156742 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156745 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156748 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156750 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156753 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156756 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 03:13:10.164971 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156759 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156763 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156767 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156770 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156773 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156775 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156778 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156780 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156783 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156785 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156787 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156790 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156792 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156796 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156799 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156802 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156806 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156808 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156813 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 03:13:10.165480 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156815 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156818 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156821 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156823 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156826 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156829 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156832 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156834 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156837 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156840 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156842 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156845 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156848 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156851 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156854 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156856 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156859 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156861 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156864 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156866 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 03:13:10.166024 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156869 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156871 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156873 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156876 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156878 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156881 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156883 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156886 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156888 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156890 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156894 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156898 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156901 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156903 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156905 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156908 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156910 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156913 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156915 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 03:13:10.166559 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156918 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 03:13:10.167055 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156920 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 03:13:10.167055 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156922 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 03:13:10.167055 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156939 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 03:13:10.167055 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156942 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 03:13:10.167055 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.156944 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 03:13:10.167055 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.157713 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 03:13:10.167055 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.164328 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 03:13:10.167055 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.164342 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 03:13:10.167055 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.165151 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 03:13:10.167055 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.165160 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 03:13:10.167055 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165215 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 03:13:10.167055 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165221 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 03:13:10.167055 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165224 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 03:13:10.167055 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165227 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165230 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165233 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165236 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165238 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165241 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165244 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165246 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165249 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165252 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165255 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165257 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165260 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165262 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165265 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165268 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165270 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165273 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165277 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 03:13:10.167422 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165280 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165284 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165286 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165289 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165293 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165296 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165298 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165301 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165304 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165306 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165308 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165311 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165314 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165316 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165319 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165321 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165324 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165326 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165329 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165331 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 03:13:10.167937 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165333 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165336 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165339 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165343 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165347 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165349 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165352 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165354 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165357 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165359 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165362 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165364 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165367 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165369 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165372 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165374 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165377 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165379 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165382 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 03:13:10.168463 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165385 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165388 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165390 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165393 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165395 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165398 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165400 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165403 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165405 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165408 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165410 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165413 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165415 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165418 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165420 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165423 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165425 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165428 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165430 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165433 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 03:13:10.168959 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165435 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165437 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165440 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165442 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165445 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165447 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165451 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165454 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165457 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165460 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165463 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165466 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165469 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165472 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165475 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165477 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165480 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 03:13:10.169484 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165482 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.165487 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165600 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165605 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165608 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165611 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165614 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165616 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165619 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165621 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165624 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165627 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165629 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165633 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165635 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 03:13:10.169983 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165638 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165640 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165642 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165645 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165647 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165650 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165652 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165654 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165657 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165659 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165662 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165664 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165667 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165669 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165672 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165674 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165678 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165681 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165684 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 03:13:10.170373 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165686 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165689 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165692 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165694 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165697 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165699 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165701 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165704 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165707 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165709 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165711 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165713 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165716 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165719 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165721 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165724 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165726 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165728 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165731 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165733 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 03:13:10.170870 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165736 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165738 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165740 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165743 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165745 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165748 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165750 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165753 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165755 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165757 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165760 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165762 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165764 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165767 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165769 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165771 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165773 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165776 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165778 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 03:13:10.171447 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165781 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165783 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165785 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165788 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165790 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165793 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165795 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165798 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165800 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165803 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165805 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165808 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165811 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165814 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165817 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165819 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165822 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165824 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165827 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 03:13:10.171960 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165829 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 03:13:10.172657 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165833 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 03:13:10.172657 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165836 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 03:13:10.172657 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165839 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 03:13:10.172657 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165841 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 03:13:10.172657 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165844 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 03:13:10.172657 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165847 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 03:13:10.172657 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165849 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 03:13:10.172657 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:10.165852 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 03:13:10.172657 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.165856 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 03:13:10.172657 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.165968 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 03:13:10.172657 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.167883 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 03:13:10.172657 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.169454 2581 server.go:1019] "Starting client certificate rotation" Jun 14 03:13:10.172657 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.169549 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 03:13:10.173206 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.169586 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 03:13:10.173206 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.172242 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 03:13:10.174577 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.174557 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 03:13:10.185776 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.185760 2581 log.go:25] "Validated CRI v1 runtime API" Jun 14 03:13:10.189364 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.189349 2581 log.go:25] "Validated CRI v1 image API" Jun 14 03:13:10.190209 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.190191 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 03:13:10.194450 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.194432 2581 fs.go:135] Filesystem UUIDs: map[2b2c66b6-61b9-4b6f-aa28-88a6e6723f90:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dbfa4d8a-dcdb-4859-a52a-6ef4bf37b99e:/dev/nvme0n1p4] Jun 14 03:13:10.194507 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.194449 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 03:13:10.198551 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.198439 2581 manager.go:216] Machine: {Timestamp:2026-06-14 03:13:10.197983032 +0000 UTC m=+0.357125928 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3076809 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2718b588fc81b2e8e2b59de2172917 SystemUUID:ec2718b5-88fc-81b2-e8e2-b59de2172917 BootID:6134c0f9-d608-44f5-9c13-531f6d10782b Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:87:06:eb:d6:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:87:06:eb:d6:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:1a:a0:01:a4:54 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 03:13:10.198551 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.198540 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 03:13:10.198672 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.198609 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 03:13:10.201611 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.201586 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 03:13:10.201754 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.201613 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 03:13:10.202577 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.202559 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 03:13:10.202967 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.202956 2581 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 03:13:10.203010 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.202968 2581 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 03:13:10.203010 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.202977 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 03:13:10.203882 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.203872 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 03:13:10.205259 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.205247 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 03:13:10.208808 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.208796 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 14 03:13:10.208914 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.208904 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 03:13:10.208963 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.208951 2581 kubelet.go:486] "Attempting to sync node with API server" Jun 14 03:13:10.208991 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.208972 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 03:13:10.208991 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.208986 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 03:13:10.209049 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.208993 2581 kubelet.go:398] "Adding apiserver pod source" Jun 14 03:13:10.209049 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.209005 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 03:13:10.209574 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.209563 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 03:13:10.209611 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.209583 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 03:13:10.213946 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.213912 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 03:13:10.216082 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.216057 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 03:13:10.216138 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.216110 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 03:13:10.218174 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.218148 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 03:13:10.218174 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.218171 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 03:13:10.218276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.218177 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 03:13:10.218276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.218185 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 03:13:10.218276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.218198 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 03:13:10.218276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.218215 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 03:13:10.218276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.218225 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 03:13:10.218276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.218232 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 03:13:10.218276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.218240 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 03:13:10.218276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.218250 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 03:13:10.218276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.218260 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 03:13:10.218276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.218265 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 03:13:10.219260 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.219249 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 03:13:10.219260 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.219259 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 03:13:10.222260 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.222247 2581 server.go:1268] "Started kubelet" Jun 14 03:13:10.222357 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.222329 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 03:13:10.222408 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.222339 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 03:13:10.222453 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.222411 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 03:13:10.223186 ip-10-0-138-133 systemd[1]: Started Kubernetes Kubelet. Jun 14 03:13:10.223544 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.223498 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 03:13:10.223619 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.223596 2581 server.go:310] "Adding debug handlers to kubelet server" Jun 14 03:13:10.223765 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.223716 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 03:13:10.223765 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.223734 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 03:13:10.223957 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.223904 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6zpn8" Jun 14 03:13:10.224281 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.224206 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 03:13:10.228879 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.228828 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 03:13:10.229007 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.228842 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 03:13:10.229065 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.228994 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jun 14 03:13:10.229640 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.229561 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 03:13:10.229640 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.229570 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 03:13:10.229640 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.229586 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 03:13:10.229803 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.229758 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 03:13:10.229803 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.229744 2581 reconstruct.go:97] "Volume reconstruction finished" Jun 14 03:13:10.229912 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.229809 2581 reconciler.go:29] "Reconciler: start to sync state" Jun 14 03:13:10.230409 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.230392 2581 factory.go:153] Registering CRI-O factory Jun 14 03:13:10.230409 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.230409 2581 factory.go:223] Registration of the crio container factory successfully Jun 14 03:13:10.230543 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.230456 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 03:13:10.230543 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.230466 2581 factory.go:55] Registering systemd factory Jun 14 03:13:10.230543 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.230478 2581 factory.go:223] Registration of the systemd container factory successfully Jun 14 03:13:10.230543 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.230502 2581 factory.go:103] Registering Raw factory Jun 14 03:13:10.230543 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.230519 2581 manager.go:1196] Started watching for new ooms in manager Jun 14 03:13:10.230764 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.229513 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-133.ec2.internal.18b8d40993aa0dc2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-133.ec2.internal,UID:ip-10-0-138-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-133.ec2.internal,},FirstTimestamp:2026-06-14 03:13:10.222220738 +0000 UTC m=+0.381363631,LastTimestamp:2026-06-14 03:13:10.222220738 +0000 UTC m=+0.381363631,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-133.ec2.internal,}" Jun 14 03:13:10.231019 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.231005 2581 manager.go:349] Starting recovery of all containers Jun 14 03:13:10.231450 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.231428 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6zpn8" Jun 14 03:13:10.236056 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.236028 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 14 03:13:10.236180 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.236163 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 14 03:13:10.243710 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.243691 2581 manager.go:354] Recovery completed Jun 14 03:13:10.248707 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.248691 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 03:13:10.250556 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.250538 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory" Jun 14 03:13:10.250634 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.250571 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 03:13:10.250634 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.250586 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID" Jun 14 03:13:10.251119 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.251105 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 03:13:10.251119 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.251118 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 03:13:10.251220 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.251142 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 03:13:10.251220 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.251165 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 14 03:13:10.251779 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.251764 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory" Jun 14 03:13:10.251850 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.251792 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 03:13:10.251850 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.251811 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID" Jun 14 03:13:10.253095 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.253083 2581 policy_none.go:49] "None policy: Start" Jun 14 03:13:10.253140 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.253099 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 03:13:10.253140 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.253109 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 03:13:10.255001 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.254990 2581 policy_none.go:47] "Start" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.291382 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.292666 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.292699 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.292718 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.292752 2581 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.293848 2581 manager.go:337] "Starting Device Plugin manager" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.293875 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.293884 2581 server.go:87] "Starting device plugin registration server" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.294147 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.294157 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.294343 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.294412 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.294421 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.294966 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.294981 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 03:13:10.306461 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.295009 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-133.ec2.internal\" not found" Jun 14 03:13:10.393784 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.393727 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"] Jun 14 03:13:10.393844 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.393808 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 03:13:10.394281 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.394270 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 03:13:10.394806 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.394789 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory" Jun 14 03:13:10.394871 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.394817 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 03:13:10.394871 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.394826 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID" Jun 14 03:13:10.394871 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.394850 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory" Jun 14 03:13:10.394871 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.394870 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 03:13:10.395021 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.394880 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID" Jun 14 03:13:10.395021 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.394903 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.397045 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.397034 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 03:13:10.397156 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.397141 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.397211 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.397178 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 03:13:10.397700 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.397678 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory" Jun 14 03:13:10.397776 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.397709 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 03:13:10.397776 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.397719 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID" Jun 14 03:13:10.397776 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.397678 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory" Jun 14 03:13:10.397776 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.397774 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 03:13:10.397893 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.397788 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID" Jun 14 03:13:10.399939 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.399911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.400016 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.399955 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 03:13:10.400554 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.400528 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.400623 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.400562 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-133.ec2.internal\": node \"ip-10-0-138-133.ec2.internal\" not found" Jun 14 03:13:10.400623 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.400597 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory" Jun 14 03:13:10.400623 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.400619 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 03:13:10.400719 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.400632 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID" Jun 14 03:13:10.417228 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.417208 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jun 14 03:13:10.421456 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.421441 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-133.ec2.internal\" not found" node="ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.425709 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.425694 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-133.ec2.internal\" not found" node="ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.430872 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.430857 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38bed639f66eae39728d1b37cb405cda-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"38bed639f66eae39728d1b37cb405cda\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.430955 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.430880 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4eba8bc83e04f869575af54c451335cc-config\") pod \"kube-apiserver-proxy-ip-10-0-138-133.ec2.internal\" (UID: \"4eba8bc83e04f869575af54c451335cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.430955 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.430898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38bed639f66eae39728d1b37cb405cda-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"38bed639f66eae39728d1b37cb405cda\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.517740 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.517718 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jun 14 03:13:10.531024 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.531006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4eba8bc83e04f869575af54c451335cc-config\") pod \"kube-apiserver-proxy-ip-10-0-138-133.ec2.internal\" (UID: \"4eba8bc83e04f869575af54c451335cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.531075 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.531032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38bed639f66eae39728d1b37cb405cda-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"38bed639f66eae39728d1b37cb405cda\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.531075 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.531056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38bed639f66eae39728d1b37cb405cda-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"38bed639f66eae39728d1b37cb405cda\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.531133 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.531087 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38bed639f66eae39728d1b37cb405cda-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"38bed639f66eae39728d1b37cb405cda\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.531133 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.531091 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4eba8bc83e04f869575af54c451335cc-config\") pod \"kube-apiserver-proxy-ip-10-0-138-133.ec2.internal\" (UID: \"4eba8bc83e04f869575af54c451335cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.531133 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.531091 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38bed639f66eae39728d1b37cb405cda-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"38bed639f66eae39728d1b37cb405cda\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.618174 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.618147 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jun 14 03:13:10.718955 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.718891 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jun 14 03:13:10.724048 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.724034 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.729216 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:10.729185 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" Jun 14 03:13:10.819968 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.819922 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jun 14 03:13:10.920418 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:10.920392 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jun 14 03:13:11.021063 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:11.020992 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jun 14 03:13:11.071730 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:11.071706 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 03:13:11.121784 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:11.121759 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jun 14 03:13:11.169327 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:11.169303 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 03:13:11.169908 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:11.169436 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 03:13:11.169908 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:11.169472 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 03:13:11.222832 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:11.222808 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jun 14 03:13:11.236695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:11.236665 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 03:08:10 +0000 UTC" deadline="2027-12-05 04:44:19.520895184 +0000 UTC" Jun 14 03:13:11.236785 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:11.236702 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12937h31m8.2841962s" Jun 14 03:13:11.323436 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:11.323364 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jun 14 03:13:11.348125 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:11.348093 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38bed639f66eae39728d1b37cb405cda.slice/crio-bdc6a3b63de90e72671a85fcb5d2fbed3c3444e8197318d123fc547306609c67 WatchSource:0}: Error finding container bdc6a3b63de90e72671a85fcb5d2fbed3c3444e8197318d123fc547306609c67: Status 404 returned error can't find the container with id bdc6a3b63de90e72671a85fcb5d2fbed3c3444e8197318d123fc547306609c67 Jun 14 03:13:11.348433 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:11.348411 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eba8bc83e04f869575af54c451335cc.slice/crio-6f1160f012d839a3f47eac7ced3f579c6f24a917c93cfd1feb5b0e0cda30479f WatchSource:0}: Error finding container 6f1160f012d839a3f47eac7ced3f579c6f24a917c93cfd1feb5b0e0cda30479f: Status 404 returned error can't find the container with id 6f1160f012d839a3f47eac7ced3f579c6f24a917c93cfd1feb5b0e0cda30479f Jun 14 03:13:11.352851 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:11.352830 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 03:13:11.395241 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:11.395212 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 03:13:11.424461 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:11.424429 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jun 14 03:13:11.431990 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:11.431973 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 03:13:11.530192 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:11.530168 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jun 14 03:13:11.543306 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:11.543278 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 03:13:11.544380 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:11.544366 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" Jun 14 03:13:11.552515 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:11.552498 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 03:13:12.210011 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.209979 2581 apiserver.go:52] "Watching apiserver" Jun 14 03:13:12.217689 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.217659 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 03:13:12.218157 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.218119 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-qlsqz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7","openshift-cluster-node-tuning-operator/tuned-2wvnb","openshift-dns/node-resolver-6cqlb","openshift-image-registry/node-ca-s6rwj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal","openshift-multus/multus-additional-cni-plugins-fcnf6","openshift-multus/network-metrics-daemon-lwmb5","kube-system/global-pull-secret-syncer-vlbgl","kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal","openshift-multus/multus-cmhxd","openshift-network-diagnostics/network-check-target-z9v7r","openshift-network-operator/iptables-alerter-g66n5","openshift-ovn-kubernetes/ovnkube-node-tg2sg"] Jun 14 03:13:12.220913 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.220891 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.223195 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.223171 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g66n5" Jun 14 03:13:12.223719 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.223701 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 03:13:12.223803 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.223747 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 03:13:12.223897 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.223883 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7t2cz\"" Jun 14 03:13:12.223982 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.223908 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 03:13:12.224100 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.224085 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 03:13:12.224180 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.223706 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 03:13:12.225573 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.225410 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.225984 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.225965 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 03:13:12.226392 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.226366 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 03:13:12.226628 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.226581 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hbd4f\"" Jun 14 03:13:12.227017 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.227000 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 03:13:12.227639 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.227622 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 03:13:12.228252 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.227868 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 03:13:12.228252 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.227964 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hrh6m\"" Jun 14 03:13:12.228252 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.228209 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6cqlb" Jun 14 03:13:12.230556 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.230230 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-htqj5\"" Jun 14 03:13:12.230556 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.230488 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 03:13:12.230762 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.230740 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 03:13:12.231018 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.230975 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s6rwj" Jun 14 03:13:12.231253 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.230987 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 03:13:12.234782 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.234007 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.235114 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.234949 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 03:13:12.235210 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.235181 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 03:13:12.235576 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.235560 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 03:13:12.238327 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.236684 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7wk45\"" Jun 14 03:13:12.238327 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.236783 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:12.238327 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.237183 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:12.238327 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.237712 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t9jm2\"" Jun 14 03:13:12.238327 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.238040 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 03:13:12.238327 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.238189 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 03:13:12.238327 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.238290 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 03:13:12.238727 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.238706 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 03:13:12.239509 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.239480 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 03:13:12.239792 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.239776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/72195c14-ccd6-47a2-bc7b-55f98f521366-iptables-alerter-script\") pod \"iptables-alerter-g66n5\" (UID: \"72195c14-ccd6-47a2-bc7b-55f98f521366\") " pod="openshift-network-operator/iptables-alerter-g66n5" Jun 14 03:13:12.239881 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.239869 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 03:13:12.239956 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.239902 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab17fc73-f1d8-47d4-8d65-26cf473dbd8c-hosts-file\") pod \"node-resolver-6cqlb\" (UID: \"ab17fc73-f1d8-47d4-8d65-26cf473dbd8c\") " pod="openshift-dns/node-resolver-6cqlb" Jun 14 03:13:12.240019 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.239956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd57bf24-0839-4aa8-be56-63233ae1bce5-os-release\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.240019 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.239998 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd57bf24-0839-4aa8-be56-63233ae1bce5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.240176 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.240054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd57bf24-0839-4aa8-be56-63233ae1bce5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.240176 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.240143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7aed657b-71d4-4eee-bea2-c86f8183cf31-serviceca\") pod \"node-ca-s6rwj\" (UID: \"7aed657b-71d4-4eee-bea2-c86f8183cf31\") " pod="openshift-image-registry/node-ca-s6rwj" Jun 14 03:13:12.240269 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.240178 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j65rt\" (UniqueName: \"kubernetes.io/projected/72195c14-ccd6-47a2-bc7b-55f98f521366-kube-api-access-j65rt\") pod \"iptables-alerter-g66n5\" (UID: \"72195c14-ccd6-47a2-bc7b-55f98f521366\") " pod="openshift-network-operator/iptables-alerter-g66n5" Jun 14 03:13:12.240269 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.240203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhn85\" (UniqueName: \"kubernetes.io/projected/7aed657b-71d4-4eee-bea2-c86f8183cf31-kube-api-access-bhn85\") pod \"node-ca-s6rwj\" (UID: \"7aed657b-71d4-4eee-bea2-c86f8183cf31\") " pod="openshift-image-registry/node-ca-s6rwj" Jun 14 03:13:12.240850 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.240819 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qlsqz" Jun 14 03:13:12.240956 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.240882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd57bf24-0839-4aa8-be56-63233ae1bce5-cni-binary-copy\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.241011 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.240949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-tuned\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.241011 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.240989 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-tmp\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.241101 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72195c14-ccd6-47a2-bc7b-55f98f521366-host-slash\") pod \"iptables-alerter-g66n5\" (UID: \"72195c14-ccd6-47a2-bc7b-55f98f521366\") " pod="openshift-network-operator/iptables-alerter-g66n5" Jun 14 03:13:12.241101 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241058 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-sysctl-conf\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.241101 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241078 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-run\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.241247 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241121 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-sys\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.241247 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241145 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd57bf24-0839-4aa8-be56-63233ae1bce5-system-cni-dir\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.241247 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241183 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-sysconfig\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.241247 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-kubernetes\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.241247 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241224 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-systemd\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.241486 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-var-lib-kubelet\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.241486 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab17fc73-f1d8-47d4-8d65-26cf473dbd8c-tmp-dir\") pod \"node-resolver-6cqlb\" (UID: \"ab17fc73-f1d8-47d4-8d65-26cf473dbd8c\") " pod="openshift-dns/node-resolver-6cqlb" Jun 14 03:13:12.241486 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv2jl\" (UniqueName: \"kubernetes.io/projected/ab17fc73-f1d8-47d4-8d65-26cf473dbd8c-kube-api-access-mv2jl\") pod \"node-resolver-6cqlb\" (UID: \"ab17fc73-f1d8-47d4-8d65-26cf473dbd8c\") " pod="openshift-dns/node-resolver-6cqlb" Jun 14 03:13:12.241486 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7aed657b-71d4-4eee-bea2-c86f8183cf31-host\") pod \"node-ca-s6rwj\" (UID: \"7aed657b-71d4-4eee-bea2-c86f8183cf31\") " pod="openshift-image-registry/node-ca-s6rwj" Jun 14 03:13:12.241486 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-sysctl-d\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.241486 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241469 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-lib-modules\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.241763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241492 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-host\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.241763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm6q8\" (UniqueName: \"kubernetes.io/projected/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-kube-api-access-hm6q8\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.241763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241546 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd57bf24-0839-4aa8-be56-63233ae1bce5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.241763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241614 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-457tg\" (UniqueName: \"kubernetes.io/projected/fd57bf24-0839-4aa8-be56-63233ae1bce5-kube-api-access-457tg\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.241763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241640 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-modprobe-d\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.241763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.241667 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd57bf24-0839-4aa8-be56-63233ae1bce5-cnibin\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.243261 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.243239 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.243413 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.243393 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-clcd4\"" Jun 14 03:13:12.244323 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.244307 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 03:13:12.244464 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.244446 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 03:13:12.245459 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.245438 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 03:13:12.246239 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.245865 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 03:13:12.246239 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.245896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:12.246239 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.245967 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:12.246239 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.246055 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kg9b9\"" Jun 14 03:13:12.246239 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.246191 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 03:13:12.246526 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.246506 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 03:13:12.248803 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.248505 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.250792 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.250601 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 03:13:12.250792 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.250624 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2hqcv\"" Jun 14 03:13:12.251185 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.251150 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:12.251263 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.251204 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:12.267793 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.267772 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tp6m" Jun 14 03:13:12.279134 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.278948 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tp6m" Jun 14 03:13:12.297811 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.297765 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" event={"ID":"38bed639f66eae39728d1b37cb405cda","Type":"ContainerStarted","Data":"bdc6a3b63de90e72671a85fcb5d2fbed3c3444e8197318d123fc547306609c67"} Jun 14 03:13:12.298899 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.298870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" event={"ID":"4eba8bc83e04f869575af54c451335cc","Type":"ContainerStarted","Data":"6f1160f012d839a3f47eac7ced3f579c6f24a917c93cfd1feb5b0e0cda30479f"} Jun 14 03:13:12.330962 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.330919 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 03:13:12.341843 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.341820 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-multus-cni-dir\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.341983 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.341859 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-multus-socket-dir-parent\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.341983 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.341890 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd57bf24-0839-4aa8-be56-63233ae1bce5-cnibin\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.341983 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.341915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.341983 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.341955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-var-lib-kubelet\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.341983 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.341976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-run-multus-certs\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.342235 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.341980 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd57bf24-0839-4aa8-be56-63233ae1bce5-cnibin\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.342235 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.341999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-var-lib-openvswitch\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.342235 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342023 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-node-log\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.342235 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342046 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01806094-2ac6-494a-8e17-2d782d2b4dbf-agent-certs\") pod \"konnectivity-agent-qlsqz\" (UID: \"01806094-2ac6-494a-8e17-2d782d2b4dbf\") " pod="kube-system/konnectivity-agent-qlsqz" Jun 14 03:13:12.342235 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd57bf24-0839-4aa8-be56-63233ae1bce5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.342235 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342094 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-device-dir\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.342235 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342116 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-cnibin\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.342235 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342139 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-run-systemd\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.342235 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2nx6\" (UniqueName: \"kubernetes.io/projected/e5573ea3-92ae-4032-9333-300f5fae54df-kube-api-access-d2nx6\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.342235 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:12.342235 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342230 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxrvd\" (UniqueName: \"kubernetes.io/projected/6aef466d-2db1-4d24-9c58-bf3c6859587f-kube-api-access-mxrvd\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhn85\" (UniqueName: \"kubernetes.io/projected/7aed657b-71d4-4eee-bea2-c86f8183cf31-kube-api-access-bhn85\") pod \"node-ca-s6rwj\" (UID: \"7aed657b-71d4-4eee-bea2-c86f8183cf31\") " pod="openshift-image-registry/node-ca-s6rwj" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342278 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-sys-fs\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-systemd-units\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-run-openvswitch\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-cni-netd\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342367 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-dbus\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd57bf24-0839-4aa8-be56-63233ae1bce5-cni-binary-copy\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-tmp\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342459 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-var-lib-cni-bin\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-sysctl-conf\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-run\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342530 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-log-socket\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-run-ovn-kubernetes\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01806094-2ac6-494a-8e17-2d782d2b4dbf-konnectivity-ca\") pod \"konnectivity-agent-qlsqz\" (UID: \"01806094-2ac6-494a-8e17-2d782d2b4dbf\") " pod="kube-system/konnectivity-agent-qlsqz" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342606 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-run\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342613 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd57bf24-0839-4aa8-be56-63233ae1bce5-system-cni-dir\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.342695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342629 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-sysctl-conf\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342639 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-sysconfig\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342681 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-kubernetes\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342691 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-sysconfig\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342691 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd57bf24-0839-4aa8-be56-63233ae1bce5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342705 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-systemd\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342690 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd57bf24-0839-4aa8-be56-63233ae1bce5-system-cni-dir\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab17fc73-f1d8-47d4-8d65-26cf473dbd8c-tmp-dir\") pod \"node-resolver-6cqlb\" (UID: \"ab17fc73-f1d8-47d4-8d65-26cf473dbd8c\") " pod="openshift-dns/node-resolver-6cqlb" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342733 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-kubernetes\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342743 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-systemd\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhkbz\" (UniqueName: \"kubernetes.io/projected/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-kube-api-access-rhkbz\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342741 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-sysctl-d\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342810 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-os-release\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-etc-openvswitch\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342837 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd57bf24-0839-4aa8-be56-63233ae1bce5-cni-binary-copy\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342859 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5573ea3-92ae-4032-9333-300f5fae54df-ovn-node-metrics-cert\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.343514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342884 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-kubelet-config\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd57bf24-0839-4aa8-be56-63233ae1bce5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342954 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-457tg\" (UniqueName: \"kubernetes.io/projected/fd57bf24-0839-4aa8-be56-63233ae1bce5-kube-api-access-457tg\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342961 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-sysctl-d\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.342979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-cni-binary-copy\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343004 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-hostroot\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343057 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/72195c14-ccd6-47a2-bc7b-55f98f521366-iptables-alerter-script\") pod \"iptables-alerter-g66n5\" (UID: \"72195c14-ccd6-47a2-bc7b-55f98f521366\") " pod="openshift-network-operator/iptables-alerter-g66n5" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343029 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab17fc73-f1d8-47d4-8d65-26cf473dbd8c-tmp-dir\") pod \"node-resolver-6cqlb\" (UID: \"ab17fc73-f1d8-47d4-8d65-26cf473dbd8c\") " pod="openshift-dns/node-resolver-6cqlb" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab17fc73-f1d8-47d4-8d65-26cf473dbd8c-hosts-file\") pod \"node-resolver-6cqlb\" (UID: \"ab17fc73-f1d8-47d4-8d65-26cf473dbd8c\") " pod="openshift-dns/node-resolver-6cqlb" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343103 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-run-ovn\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343186 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab17fc73-f1d8-47d4-8d65-26cf473dbd8c-hosts-file\") pod \"node-resolver-6cqlb\" (UID: \"ab17fc73-f1d8-47d4-8d65-26cf473dbd8c\") " pod="openshift-dns/node-resolver-6cqlb" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343192 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd57bf24-0839-4aa8-be56-63233ae1bce5-os-release\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343223 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd57bf24-0839-4aa8-be56-63233ae1bce5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343247 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7aed657b-71d4-4eee-bea2-c86f8183cf31-serviceca\") pod \"node-ca-s6rwj\" (UID: \"7aed657b-71d4-4eee-bea2-c86f8183cf31\") " pod="openshift-image-registry/node-ca-s6rwj" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-multus-daemon-config\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j65rt\" (UniqueName: \"kubernetes.io/projected/72195c14-ccd6-47a2-bc7b-55f98f521366-kube-api-access-j65rt\") pod \"iptables-alerter-g66n5\" (UID: \"72195c14-ccd6-47a2-bc7b-55f98f521366\") " pod="openshift-network-operator/iptables-alerter-g66n5" Jun 14 03:13:12.344334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343276 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd57bf24-0839-4aa8-be56-63233ae1bce5-os-release\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-registration-dir\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-var-lib-cni-multus\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343393 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p5lp\" (UniqueName: \"kubernetes.io/projected/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-kube-api-access-8p5lp\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343419 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j7kc\" (UniqueName: \"kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc\") pod \"network-check-target-z9v7r\" (UID: \"b5814b79-879c-469b-8793-8b54b6c7633a\") " pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343418 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd57bf24-0839-4aa8-be56-63233ae1bce5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-slash\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343473 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd57bf24-0839-4aa8-be56-63233ae1bce5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-cni-bin\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-tuned\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-etc-selinux\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-multus-conf-dir\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343589 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72195c14-ccd6-47a2-bc7b-55f98f521366-host-slash\") pod \"iptables-alerter-g66n5\" (UID: \"72195c14-ccd6-47a2-bc7b-55f98f521366\") " pod="openshift-network-operator/iptables-alerter-g66n5" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-sys\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343648 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e5573ea3-92ae-4032-9333-300f5fae54df-ovnkube-script-lib\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.345163 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343666 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-run-k8s-cni-cncf-io\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-var-lib-kubelet\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343696 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72195c14-ccd6-47a2-bc7b-55f98f521366-host-slash\") pod \"iptables-alerter-g66n5\" (UID: \"72195c14-ccd6-47a2-bc7b-55f98f521366\") " pod="openshift-network-operator/iptables-alerter-g66n5" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343711 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv2jl\" (UniqueName: \"kubernetes.io/projected/ab17fc73-f1d8-47d4-8d65-26cf473dbd8c-kube-api-access-mv2jl\") pod \"node-resolver-6cqlb\" (UID: \"ab17fc73-f1d8-47d4-8d65-26cf473dbd8c\") " pod="openshift-dns/node-resolver-6cqlb" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7aed657b-71d4-4eee-bea2-c86f8183cf31-host\") pod \"node-ca-s6rwj\" (UID: \"7aed657b-71d4-4eee-bea2-c86f8183cf31\") " pod="openshift-image-registry/node-ca-s6rwj" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343744 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7aed657b-71d4-4eee-bea2-c86f8183cf31-serviceca\") pod \"node-ca-s6rwj\" (UID: \"7aed657b-71d4-4eee-bea2-c86f8183cf31\") " pod="openshift-image-registry/node-ca-s6rwj" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-etc-kubernetes\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343779 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-kubelet\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343789 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7aed657b-71d4-4eee-bea2-c86f8183cf31-host\") pod \"node-ca-s6rwj\" (UID: \"7aed657b-71d4-4eee-bea2-c86f8183cf31\") " pod="openshift-image-registry/node-ca-s6rwj" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343791 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-var-lib-kubelet\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e5573ea3-92ae-4032-9333-300f5fae54df-ovnkube-config\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343757 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-sys\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343838 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e5573ea3-92ae-4032-9333-300f5fae54df-env-overrides\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343862 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-run-netns\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-lib-modules\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343815 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/72195c14-ccd6-47a2-bc7b-55f98f521366-iptables-alerter-script\") pod \"iptables-alerter-g66n5\" (UID: \"72195c14-ccd6-47a2-bc7b-55f98f521366\") " pod="openshift-network-operator/iptables-alerter-g66n5" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-host\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343962 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-host\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.345916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.343981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm6q8\" (UniqueName: \"kubernetes.io/projected/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-kube-api-access-hm6q8\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.346763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.344014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-run-netns\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.346763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.344036 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-lib-modules\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.346763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.344128 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-modprobe-d\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.346763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.344157 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-socket-dir\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.346763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.344182 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-system-cni-dir\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.346763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.344252 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-modprobe-d\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.346763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.346107 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-etc-tuned\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.347570 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.347548 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-tmp\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.353581 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.353554 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv2jl\" (UniqueName: \"kubernetes.io/projected/ab17fc73-f1d8-47d4-8d65-26cf473dbd8c-kube-api-access-mv2jl\") pod \"node-resolver-6cqlb\" (UID: \"ab17fc73-f1d8-47d4-8d65-26cf473dbd8c\") " pod="openshift-dns/node-resolver-6cqlb" Jun 14 03:13:12.353706 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.353645 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhn85\" (UniqueName: \"kubernetes.io/projected/7aed657b-71d4-4eee-bea2-c86f8183cf31-kube-api-access-bhn85\") pod \"node-ca-s6rwj\" (UID: \"7aed657b-71d4-4eee-bea2-c86f8183cf31\") " pod="openshift-image-registry/node-ca-s6rwj" Jun 14 03:13:12.353706 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.353648 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm6q8\" (UniqueName: \"kubernetes.io/projected/bc6b9e6d-7480-4d4a-8d53-16e33866f0ea-kube-api-access-hm6q8\") pod \"tuned-2wvnb\" (UID: \"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea\") " pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.353814 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.353752 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j65rt\" (UniqueName: \"kubernetes.io/projected/72195c14-ccd6-47a2-bc7b-55f98f521366-kube-api-access-j65rt\") pod \"iptables-alerter-g66n5\" (UID: \"72195c14-ccd6-47a2-bc7b-55f98f521366\") " pod="openshift-network-operator/iptables-alerter-g66n5" Jun 14 03:13:12.353981 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.353965 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-457tg\" (UniqueName: \"kubernetes.io/projected/fd57bf24-0839-4aa8-be56-63233ae1bce5-kube-api-access-457tg\") pod \"multus-additional-cni-plugins-fcnf6\" (UID: \"fd57bf24-0839-4aa8-be56-63233ae1bce5\") " pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.427127 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.427102 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 03:13:12.445072 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e5573ea3-92ae-4032-9333-300f5fae54df-ovnkube-config\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.445072 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e5573ea3-92ae-4032-9333-300f5fae54df-env-overrides\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.445254 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445088 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-run-netns\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.445254 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-run-netns\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.445254 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-socket-dir\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.445254 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445157 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-system-cni-dir\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.445254 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445177 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-multus-cni-dir\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.445254 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445188 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-run-netns\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.445254 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-multus-socket-dir-parent\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.445254 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445192 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-run-netns\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.445254 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.445254 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445251 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-var-lib-kubelet\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.445254 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445252 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-system-cni-dir\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445265 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-run-multus-certs\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445265 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-multus-cni-dir\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-var-lib-openvswitch\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-node-log\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445328 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-multus-socket-dir-parent\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445356 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-var-lib-kubelet\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445364 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-run-multus-certs\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445369 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-socket-dir\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445399 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-node-log\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445400 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-var-lib-openvswitch\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01806094-2ac6-494a-8e17-2d782d2b4dbf-agent-certs\") pod \"konnectivity-agent-qlsqz\" (UID: \"01806094-2ac6-494a-8e17-2d782d2b4dbf\") " pod="kube-system/konnectivity-agent-qlsqz" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445417 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-device-dir\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-cnibin\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-run-systemd\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2nx6\" (UniqueName: \"kubernetes.io/projected/e5573ea3-92ae-4032-9333-300f5fae54df-kube-api-access-d2nx6\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445528 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-cnibin\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.445789 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445555 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445559 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-run-systemd\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445576 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-device-dir\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxrvd\" (UniqueName: \"kubernetes.io/projected/6aef466d-2db1-4d24-9c58-bf3c6859587f-kube-api-access-mxrvd\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-sys-fs\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445626 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e5573ea3-92ae-4032-9333-300f5fae54df-env-overrides\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-systemd-units\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.445656 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-run-openvswitch\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445699 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-sys-fs\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445708 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e5573ea3-92ae-4032-9333-300f5fae54df-ovnkube-config\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445710 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-systemd-units\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.445715 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs podName:6aef466d-2db1-4d24-9c58-bf3c6859587f nodeName:}" failed. No retries permitted until 2026-06-14 03:13:12.945695511 +0000 UTC m=+3.104838410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs") pod "network-metrics-daemon-lwmb5" (UID: "6aef466d-2db1-4d24-9c58-bf3c6859587f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445740 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-run-openvswitch\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-cni-netd\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-dbus\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445801 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-cni-netd\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.446483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-var-lib-cni-bin\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445862 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-var-lib-cni-bin\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445876 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-log-socket\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-run-ovn-kubernetes\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445945 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-log-socket\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445956 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-dbus\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445948 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01806094-2ac6-494a-8e17-2d782d2b4dbf-konnectivity-ca\") pod \"konnectivity-agent-qlsqz\" (UID: \"01806094-2ac6-494a-8e17-2d782d2b4dbf\") " pod="kube-system/konnectivity-agent-qlsqz" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhkbz\" (UniqueName: \"kubernetes.io/projected/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-kube-api-access-rhkbz\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.445970 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-run-ovn-kubernetes\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-os-release\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446162 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-os-release\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-etc-openvswitch\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446238 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5573ea3-92ae-4032-9333-300f5fae54df-ovn-node-metrics-cert\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-kubelet-config\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446285 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-cni-binary-copy\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-hostroot\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.447466 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446361 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-run-ovn\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-multus-daemon-config\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446414 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-registration-dir\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446441 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-var-lib-cni-multus\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446479 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p5lp\" (UniqueName: \"kubernetes.io/projected/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-kube-api-access-8p5lp\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446507 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-kubelet-config\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7kc\" (UniqueName: \"kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc\") pod \"network-check-target-z9v7r\" (UID: \"b5814b79-879c-469b-8793-8b54b6c7633a\") " pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-slash\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-cni-bin\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-etc-selinux\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-multus-conf-dir\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446645 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446663 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e5573ea3-92ae-4032-9333-300f5fae54df-ovnkube-script-lib\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-run-k8s-cni-cncf-io\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-etc-kubernetes\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446724 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-etc-kubernetes\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446734 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.448319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-kubelet\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446829 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-kubelet\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446872 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-run-ovn\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.447009 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-multus-conf-dir\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.447020 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-var-lib-cni-multus\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.447051 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-slash\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.447086 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-registration-dir\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.447094 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-host-cni-bin\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446415 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01806094-2ac6-494a-8e17-2d782d2b4dbf-konnectivity-ca\") pod \"konnectivity-agent-qlsqz\" (UID: \"01806094-2ac6-494a-8e17-2d782d2b4dbf\") " pod="kube-system/konnectivity-agent-qlsqz" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.447138 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-etc-selinux\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.447163 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-cni-binary-copy\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.447185 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5573ea3-92ae-4032-9333-300f5fae54df-etc-openvswitch\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.447182 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.447231 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-host-run-k8s-cni-cncf-io\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.447243 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret podName:f8fda1d3-bf38-4112-9d1c-89cb07a96a5e nodeName:}" failed. No retries permitted until 2026-06-14 03:13:12.947228284 +0000 UTC m=+3.106371184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret") pod "global-pull-secret-syncer-vlbgl" (UID: "f8fda1d3-bf38-4112-9d1c-89cb07a96a5e") : object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.446451 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-hostroot\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.447401 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-multus-daemon-config\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.447514 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e5573ea3-92ae-4032-9333-300f5fae54df-ovnkube-script-lib\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.449020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.448286 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01806094-2ac6-494a-8e17-2d782d2b4dbf-agent-certs\") pod \"konnectivity-agent-qlsqz\" (UID: \"01806094-2ac6-494a-8e17-2d782d2b4dbf\") " pod="kube-system/konnectivity-agent-qlsqz" Jun 14 03:13:12.449656 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.448891 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5573ea3-92ae-4032-9333-300f5fae54df-ovn-node-metrics-cert\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.456541 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.456319 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 03:13:12.456541 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.456339 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 03:13:12.456541 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.456352 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7j7kc for pod openshift-network-diagnostics/network-check-target-z9v7r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:12.456541 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.456397 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc podName:b5814b79-879c-469b-8793-8b54b6c7633a nodeName:}" failed. No retries permitted until 2026-06-14 03:13:12.956385446 +0000 UTC m=+3.115528331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7j7kc" (UniqueName: "kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc") pod "network-check-target-z9v7r" (UID: "b5814b79-879c-469b-8793-8b54b6c7633a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:12.458107 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.458078 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2nx6\" (UniqueName: \"kubernetes.io/projected/e5573ea3-92ae-4032-9333-300f5fae54df-kube-api-access-d2nx6\") pod \"ovnkube-node-tg2sg\" (UID: \"e5573ea3-92ae-4032-9333-300f5fae54df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.458356 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.458332 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxrvd\" (UniqueName: \"kubernetes.io/projected/6aef466d-2db1-4d24-9c58-bf3c6859587f-kube-api-access-mxrvd\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:12.459059 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.459021 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhkbz\" (UniqueName: \"kubernetes.io/projected/1ad8c2cd-72e4-4a47-9968-5b3ea3db3479-kube-api-access-rhkbz\") pod \"aws-ebs-csi-driver-node-4cbg7\" (UID: \"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.459208 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.459156 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p5lp\" (UniqueName: \"kubernetes.io/projected/d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba-kube-api-access-8p5lp\") pod \"multus-cmhxd\" (UID: \"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba\") " pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.537952 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.537848 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fcnf6" Jun 14 03:13:12.544967 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.544945 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" Jun 14 03:13:12.553633 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.553604 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g66n5" Jun 14 03:13:12.561284 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.561257 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6cqlb" Jun 14 03:13:12.567902 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.567886 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s6rwj" Jun 14 03:13:12.576558 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.576540 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:12.584196 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.584173 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qlsqz" Jun 14 03:13:12.590868 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.590847 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" Jun 14 03:13:12.595529 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.595511 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cmhxd" Jun 14 03:13:12.950422 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.950387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:12.950608 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:12.950450 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:12.950608 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.950564 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:12.950717 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.950649 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret podName:f8fda1d3-bf38-4112-9d1c-89cb07a96a5e nodeName:}" failed. No retries permitted until 2026-06-14 03:13:13.950627676 +0000 UTC m=+4.109770580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret") pod "global-pull-secret-syncer-vlbgl" (UID: "f8fda1d3-bf38-4112-9d1c-89cb07a96a5e") : object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:12.950717 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.950572 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:12.950795 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:12.950716 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs podName:6aef466d-2db1-4d24-9c58-bf3c6859587f nodeName:}" failed. No retries permitted until 2026-06-14 03:13:13.950701477 +0000 UTC m=+4.109844359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs") pod "network-metrics-daemon-lwmb5" (UID: "6aef466d-2db1-4d24-9c58-bf3c6859587f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:13.051098 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.051065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7kc\" (UniqueName: \"kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc\") pod \"network-check-target-z9v7r\" (UID: \"b5814b79-879c-469b-8793-8b54b6c7633a\") " pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:13.051250 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:13.051230 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 03:13:13.051287 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:13.051251 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 03:13:13.051287 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:13.051262 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7j7kc for pod openshift-network-diagnostics/network-check-target-z9v7r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:13.051355 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:13.051310 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc podName:b5814b79-879c-469b-8793-8b54b6c7633a nodeName:}" failed. No retries permitted until 2026-06-14 03:13:14.051296611 +0000 UTC m=+4.210439507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7j7kc" (UniqueName: "kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc") pod "network-check-target-z9v7r" (UID: "b5814b79-879c-469b-8793-8b54b6c7633a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:13.179437 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:13.179400 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5573ea3_92ae_4032_9333_300f5fae54df.slice/crio-4253ed806de34a0633dfe9b292889d70397661f53e54d4197dc4a218d321e5f1 WatchSource:0}: Error finding container 4253ed806de34a0633dfe9b292889d70397661f53e54d4197dc4a218d321e5f1: Status 404 returned error can't find the container with id 4253ed806de34a0633dfe9b292889d70397661f53e54d4197dc4a218d321e5f1 Jun 14 03:13:13.180138 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:13.180115 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33e80b6_3b15_4ac9_be4a_48e8e4ec1bba.slice/crio-f026df5d17443353763af84d8d744ced38b43ab264b0e28353a16b974faaa38d WatchSource:0}: Error finding container f026df5d17443353763af84d8d744ced38b43ab264b0e28353a16b974faaa38d: Status 404 returned error can't find the container with id f026df5d17443353763af84d8d744ced38b43ab264b0e28353a16b974faaa38d Jun 14 03:13:13.208054 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:13.207972 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6b9e6d_7480_4d4a_8d53_16e33866f0ea.slice/crio-e1b97353ce398fdaa71f8cb559f4f8625d724aa29ccb1c8506abd601cbd83b02 WatchSource:0}: Error finding container e1b97353ce398fdaa71f8cb559f4f8625d724aa29ccb1c8506abd601cbd83b02: Status 404 returned error can't find the container with id e1b97353ce398fdaa71f8cb559f4f8625d724aa29ccb1c8506abd601cbd83b02 Jun 14 03:13:13.208679 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:13.208660 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aed657b_71d4_4eee_bea2_c86f8183cf31.slice/crio-d4cad00e2279784c5d6f71ed31ec167509b7c25478700b2b9c89cf6bbfc32268 WatchSource:0}: Error finding container d4cad00e2279784c5d6f71ed31ec167509b7c25478700b2b9c89cf6bbfc32268: Status 404 returned error can't find the container with id d4cad00e2279784c5d6f71ed31ec167509b7c25478700b2b9c89cf6bbfc32268 Jun 14 03:13:13.209664 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:13.209644 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72195c14_ccd6_47a2_bc7b_55f98f521366.slice/crio-f53b880760d2a0e690697d3ebd873804605b48c997ebaf72aae95c42497fdb42 WatchSource:0}: Error finding container f53b880760d2a0e690697d3ebd873804605b48c997ebaf72aae95c42497fdb42: Status 404 returned error can't find the container with id f53b880760d2a0e690697d3ebd873804605b48c997ebaf72aae95c42497fdb42 Jun 14 03:13:13.281697 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.281655 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 03:08:12 +0000 UTC" deadline="2027-12-22 18:23:03.297360997 +0000 UTC" Jun 14 03:13:13.281697 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.281695 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13359h9m50.015668817s" Jun 14 03:13:13.293397 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.293377 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:13.293480 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:13.293464 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:13.309628 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.309597 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" event={"ID":"4eba8bc83e04f869575af54c451335cc","Type":"ContainerStarted","Data":"52cfa6015dc8400d7095329142a65b241df476522de4c5ce2fc03aca21660728"} Jun 14 03:13:13.312215 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.312193 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s6rwj" event={"ID":"7aed657b-71d4-4eee-bea2-c86f8183cf31","Type":"ContainerStarted","Data":"d4cad00e2279784c5d6f71ed31ec167509b7c25478700b2b9c89cf6bbfc32268"} Jun 14 03:13:13.313862 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.313842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g66n5" event={"ID":"72195c14-ccd6-47a2-bc7b-55f98f521366","Type":"ContainerStarted","Data":"f53b880760d2a0e690697d3ebd873804605b48c997ebaf72aae95c42497fdb42"} Jun 14 03:13:13.315282 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.315251 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cmhxd" event={"ID":"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba","Type":"ContainerStarted","Data":"f026df5d17443353763af84d8d744ced38b43ab264b0e28353a16b974faaa38d"} Jun 14 03:13:13.316360 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.316340 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcnf6" event={"ID":"fd57bf24-0839-4aa8-be56-63233ae1bce5","Type":"ContainerStarted","Data":"9ef251e03fe01b45e3c290082838d7059d358f62a5908a280e5c4fb43975b2a1"} Jun 14 03:13:13.317335 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.317317 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" event={"ID":"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea","Type":"ContainerStarted","Data":"e1b97353ce398fdaa71f8cb559f4f8625d724aa29ccb1c8506abd601cbd83b02"} Jun 14 03:13:13.319188 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.319168 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" event={"ID":"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479","Type":"ContainerStarted","Data":"21f8c5c3e757221cb5ff283c82be3fb41995ad450a50f674dca32f5586920580"} Jun 14 03:13:13.321277 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.321253 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qlsqz" event={"ID":"01806094-2ac6-494a-8e17-2d782d2b4dbf","Type":"ContainerStarted","Data":"48da5dbd5ddd9dbbc24e2ff6cb9975139a61dfdb266f5c7c86e08d98d9f16d8f"} Jun 14 03:13:13.323211 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.323188 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6cqlb" event={"ID":"ab17fc73-f1d8-47d4-8d65-26cf473dbd8c","Type":"ContainerStarted","Data":"cfe2ef113d82c675535a7fbca428460b2d4c38fb1a887bf7b459285b31bb8da2"} Jun 14 03:13:13.323943 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.323883 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" podStartSLOduration=2.32387052 podStartE2EDuration="2.32387052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:13:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:13.32376402 +0000 UTC m=+3.482906921" watchObservedRunningTime="2026-06-14 03:13:13.32387052 +0000 UTC m=+3.483013415" Jun 14 03:13:13.325685 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.325667 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" event={"ID":"e5573ea3-92ae-4032-9333-300f5fae54df","Type":"ContainerStarted","Data":"4253ed806de34a0633dfe9b292889d70397661f53e54d4197dc4a218d321e5f1"} Jun 14 03:13:13.860542 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.860287 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 03:13:13.962354 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.962309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:13.962529 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:13.962377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:13.962529 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:13.962517 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:13.962645 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:13.962578 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs podName:6aef466d-2db1-4d24-9c58-bf3c6859587f nodeName:}" failed. No retries permitted until 2026-06-14 03:13:15.962558909 +0000 UTC m=+6.121701795 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs") pod "network-metrics-daemon-lwmb5" (UID: "6aef466d-2db1-4d24-9c58-bf3c6859587f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:13.963073 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:13.962983 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:13.963073 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:13.963043 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret podName:f8fda1d3-bf38-4112-9d1c-89cb07a96a5e nodeName:}" failed. No retries permitted until 2026-06-14 03:13:15.963025389 +0000 UTC m=+6.122168275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret") pod "global-pull-secret-syncer-vlbgl" (UID: "f8fda1d3-bf38-4112-9d1c-89cb07a96a5e") : object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:14.063450 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:14.063411 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7kc\" (UniqueName: \"kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc\") pod \"network-check-target-z9v7r\" (UID: \"b5814b79-879c-469b-8793-8b54b6c7633a\") " pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:14.063625 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:14.063579 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 03:13:14.063625 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:14.063597 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 03:13:14.063625 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:14.063610 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7j7kc for pod openshift-network-diagnostics/network-check-target-z9v7r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:14.063791 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:14.063665 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc podName:b5814b79-879c-469b-8793-8b54b6c7633a nodeName:}" failed. No retries permitted until 2026-06-14 03:13:16.063647553 +0000 UTC m=+6.222790440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7j7kc" (UniqueName: "kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc") pod "network-check-target-z9v7r" (UID: "b5814b79-879c-469b-8793-8b54b6c7633a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:14.282248 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:14.282151 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 03:08:12 +0000 UTC" deadline="2027-12-09 07:11:22.831696977 +0000 UTC" Jun 14 03:13:14.282248 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:14.282208 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13035h58m8.549494626s" Jun 14 03:13:14.294617 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:14.294045 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:14.294617 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:14.294179 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:14.295120 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:14.294893 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:14.295120 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:14.295008 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:14.339604 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:14.339569 2581 generic.go:356] "Generic (PLEG): container finished" podID="38bed639f66eae39728d1b37cb405cda" containerID="1bf775c68a6ad4e48e7066c1792df0c9fefdc3a57f5f894a72854c6b4c87c9fe" exitCode=0 Jun 14 03:13:14.340605 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:14.339818 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" event={"ID":"38bed639f66eae39728d1b37cb405cda","Type":"ContainerDied","Data":"1bf775c68a6ad4e48e7066c1792df0c9fefdc3a57f5f894a72854c6b4c87c9fe"} Jun 14 03:13:15.293691 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:15.293659 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:15.294174 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:15.293782 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:15.363369 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:15.363338 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" event={"ID":"38bed639f66eae39728d1b37cb405cda","Type":"ContainerStarted","Data":"4948feacc30be6d05dbf05d1bc9c79e02ba3a30cb4a6764515a01d6f5483b2b7"} Jun 14 03:13:15.378638 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:15.378575 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" podStartSLOduration=4.37855724 podStartE2EDuration="4.37855724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:13:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:15.377721236 +0000 UTC m=+5.536864140" watchObservedRunningTime="2026-06-14 03:13:15.37855724 +0000 UTC m=+5.537700147" Jun 14 03:13:15.980348 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:15.980309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:15.980522 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:15.980398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:15.980585 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:15.980535 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:15.980655 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:15.980598 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret podName:f8fda1d3-bf38-4112-9d1c-89cb07a96a5e nodeName:}" failed. No retries permitted until 2026-06-14 03:13:19.980579607 +0000 UTC m=+10.139722503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret") pod "global-pull-secret-syncer-vlbgl" (UID: "f8fda1d3-bf38-4112-9d1c-89cb07a96a5e") : object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:15.981019 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:15.980997 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:15.981128 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:15.981058 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs podName:6aef466d-2db1-4d24-9c58-bf3c6859587f nodeName:}" failed. No retries permitted until 2026-06-14 03:13:19.981043222 +0000 UTC m=+10.140186118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs") pod "network-metrics-daemon-lwmb5" (UID: "6aef466d-2db1-4d24-9c58-bf3c6859587f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:16.081090 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:16.081017 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7kc\" (UniqueName: \"kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc\") pod \"network-check-target-z9v7r\" (UID: \"b5814b79-879c-469b-8793-8b54b6c7633a\") " pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:16.081258 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:16.081238 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 03:13:16.081258 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:16.081256 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 03:13:16.081368 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:16.081268 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7j7kc for pod openshift-network-diagnostics/network-check-target-z9v7r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:16.081368 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:16.081327 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc podName:b5814b79-879c-469b-8793-8b54b6c7633a nodeName:}" failed. No retries permitted until 2026-06-14 03:13:20.081310489 +0000 UTC m=+10.240453374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7j7kc" (UniqueName: "kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc") pod "network-check-target-z9v7r" (UID: "b5814b79-879c-469b-8793-8b54b6c7633a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:16.298666 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:16.298593 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:16.298666 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:16.298615 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:16.299160 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:16.298726 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:16.299160 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:16.299114 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:17.293946 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:17.293902 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:17.294135 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:17.294099 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:18.293493 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:18.293458 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:18.293978 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:18.293594 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:18.294129 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:18.294110 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:18.294246 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:18.294224 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:19.293425 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:19.293394 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:19.293613 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:19.293522 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:20.015499 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:20.015445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:20.015686 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:20.015546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:20.015686 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:20.015618 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:20.015686 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:20.015651 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:20.015852 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:20.015699 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs podName:6aef466d-2db1-4d24-9c58-bf3c6859587f nodeName:}" failed. No retries permitted until 2026-06-14 03:13:28.015678993 +0000 UTC m=+18.174821890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs") pod "network-metrics-daemon-lwmb5" (UID: "6aef466d-2db1-4d24-9c58-bf3c6859587f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:20.015852 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:20.015729 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret podName:f8fda1d3-bf38-4112-9d1c-89cb07a96a5e nodeName:}" failed. No retries permitted until 2026-06-14 03:13:28.015711219 +0000 UTC m=+18.174854124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret") pod "global-pull-secret-syncer-vlbgl" (UID: "f8fda1d3-bf38-4112-9d1c-89cb07a96a5e") : object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:20.116592 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:20.116560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7kc\" (UniqueName: \"kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc\") pod \"network-check-target-z9v7r\" (UID: \"b5814b79-879c-469b-8793-8b54b6c7633a\") " pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:20.116769 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:20.116707 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 03:13:20.116769 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:20.116724 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 03:13:20.116769 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:20.116736 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7j7kc for pod openshift-network-diagnostics/network-check-target-z9v7r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:20.116885 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:20.116794 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc podName:b5814b79-879c-469b-8793-8b54b6c7633a nodeName:}" failed. No retries permitted until 2026-06-14 03:13:28.116777309 +0000 UTC m=+18.275920194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7j7kc" (UniqueName: "kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc") pod "network-check-target-z9v7r" (UID: "b5814b79-879c-469b-8793-8b54b6c7633a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:20.297170 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:20.297099 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:20.297597 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:20.297229 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:20.297597 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:20.297293 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:20.297597 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:20.297367 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:21.293604 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:21.293571 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:21.293792 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:21.293715 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:22.294067 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:22.294036 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:22.294491 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:22.294167 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:22.294491 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:22.294225 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:22.294491 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:22.294365 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:23.293781 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:23.293747 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:23.293959 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:23.293873 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:24.293633 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:24.293603 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:24.294124 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:24.293737 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:24.294124 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:24.293605 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:24.294236 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:24.294132 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:25.293627 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:25.293588 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:25.293768 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:25.293722 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:26.293524 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:26.293490 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:26.293802 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:26.293616 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:26.293802 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:26.293668 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:26.293802 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:26.293768 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:27.293736 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:27.293706 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:27.293898 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:27.293830 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:28.077955 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:28.077849 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:28.077955 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:28.077914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:28.078132 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:28.078045 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:28.078132 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:28.078118 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret podName:f8fda1d3-bf38-4112-9d1c-89cb07a96a5e nodeName:}" failed. No retries permitted until 2026-06-14 03:13:44.078098433 +0000 UTC m=+34.237241320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret") pod "global-pull-secret-syncer-vlbgl" (UID: "f8fda1d3-bf38-4112-9d1c-89cb07a96a5e") : object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:28.078132 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:28.078048 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:28.078274 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:28.078184 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs podName:6aef466d-2db1-4d24-9c58-bf3c6859587f nodeName:}" failed. No retries permitted until 2026-06-14 03:13:44.07815813 +0000 UTC m=+34.237301012 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs") pod "network-metrics-daemon-lwmb5" (UID: "6aef466d-2db1-4d24-9c58-bf3c6859587f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:28.179289 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:28.179245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7kc\" (UniqueName: \"kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc\") pod \"network-check-target-z9v7r\" (UID: \"b5814b79-879c-469b-8793-8b54b6c7633a\") " pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:28.179460 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:28.179428 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 03:13:28.179460 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:28.179451 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 03:13:28.179570 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:28.179467 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7j7kc for pod openshift-network-diagnostics/network-check-target-z9v7r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:28.179570 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:28.179532 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc podName:b5814b79-879c-469b-8793-8b54b6c7633a nodeName:}" failed. No retries permitted until 2026-06-14 03:13:44.1795119 +0000 UTC m=+34.338654785 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7j7kc" (UniqueName: "kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc") pod "network-check-target-z9v7r" (UID: "b5814b79-879c-469b-8793-8b54b6c7633a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:28.293455 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:28.293420 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:28.293614 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:28.293543 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:28.293896 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:28.293870 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:28.294303 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:28.293985 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:29.293320 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:29.293281 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:29.293482 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:29.293385 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:30.294657 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:30.294478 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:30.295141 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:30.294539 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:30.295141 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:30.294749 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:30.295141 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:30.294849 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:31.292945 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:31.292893 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:31.293131 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:31.293024 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:32.293397 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.293146 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:32.294049 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.293174 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:32.294049 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:32.293506 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:32.294049 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:32.293618 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:32.397729 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.397704 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s6rwj" event={"ID":"7aed657b-71d4-4eee-bea2-c86f8183cf31","Type":"ContainerStarted","Data":"7dd46af5302c7bd6a69cc419744b0e81190455904af5a610309d0d025d1bfe02"} Jun 14 03:13:32.399523 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.399498 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cmhxd" event={"ID":"d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba","Type":"ContainerStarted","Data":"1af66165b27f13e8a92d63b6c0bc18d4c998599d2738bade2e7f31fdb59713c7"} Jun 14 03:13:32.401099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.401077 2581 generic.go:356] "Generic (PLEG): container finished" podID="fd57bf24-0839-4aa8-be56-63233ae1bce5" containerID="44af70070288ffe7000c812d66e4f4410dcbe2e962cec71a9aac2bf79726d2fa" exitCode=0 Jun 14 03:13:32.401197 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.401159 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcnf6" event={"ID":"fd57bf24-0839-4aa8-be56-63233ae1bce5","Type":"ContainerDied","Data":"44af70070288ffe7000c812d66e4f4410dcbe2e962cec71a9aac2bf79726d2fa"} Jun 14 03:13:32.405464 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.405434 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" event={"ID":"bc6b9e6d-7480-4d4a-8d53-16e33866f0ea","Type":"ContainerStarted","Data":"e322fd21ff871633cb46367ac80f230e80acf286eb85034df29bd7061b20c939"} Jun 14 03:13:32.406950 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.406915 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" event={"ID":"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479","Type":"ContainerStarted","Data":"c5aa2cf0afe9c6dde06e5ed810fa06a58774bf2b4f860e9ef703e4f29885b750"} Jun 14 03:13:32.408266 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.408241 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qlsqz" event={"ID":"01806094-2ac6-494a-8e17-2d782d2b4dbf","Type":"ContainerStarted","Data":"4a5cde6b5867f3dbf9de5863458a27e82bf03343d74c3e27a0fad21446fef389"} Jun 14 03:13:32.409379 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.409346 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6cqlb" event={"ID":"ab17fc73-f1d8-47d4-8d65-26cf473dbd8c","Type":"ContainerStarted","Data":"12dcffc0f5432a31afbd5329c35a86a76efd820cbd398c5231e6cafbbc90a018"} Jun 14 03:13:32.411327 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.411311 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:13:32.411584 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.411565 2581 generic.go:356] "Generic (PLEG): container finished" podID="e5573ea3-92ae-4032-9333-300f5fae54df" containerID="43c98c9294f60779e2234375892affd19687e03d856e35a7a4fecc48a50c90ea" exitCode=1 Jun 14 03:13:32.411648 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.411598 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" event={"ID":"e5573ea3-92ae-4032-9333-300f5fae54df","Type":"ContainerStarted","Data":"e95d80f3581866f87739c99775c8dcdf0ab7f23d58f05a0830489c75eacccaec"} Jun 14 03:13:32.411683 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.411646 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" event={"ID":"e5573ea3-92ae-4032-9333-300f5fae54df","Type":"ContainerStarted","Data":"7882f1653457b2e859d67840c3251ce791e886dde65ff5afbf154540c8b1547e"} Jun 14 03:13:32.411683 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.411676 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" event={"ID":"e5573ea3-92ae-4032-9333-300f5fae54df","Type":"ContainerDied","Data":"43c98c9294f60779e2234375892affd19687e03d856e35a7a4fecc48a50c90ea"} Jun 14 03:13:32.411742 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.411704 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" event={"ID":"e5573ea3-92ae-4032-9333-300f5fae54df","Type":"ContainerStarted","Data":"ae0a2d1f07c66018211bbd47e4c82da9f95aee2da16838a92e72efebc8da85c8"} Jun 14 03:13:32.412033 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.412004 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s6rwj" podStartSLOduration=3.809274973 podStartE2EDuration="22.41197838s" totalImagesPullingTime="18.602703407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:32.411919244 +0000 UTC m=+22.571062148" watchObservedRunningTime="2026-06-14 03:13:32.41197838 +0000 UTC m=+22.571121281" Jun 14 03:13:32.454069 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.454032 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2wvnb" podStartSLOduration=3.851501319 podStartE2EDuration="22.454019743s" totalImagesPullingTime="18.602518424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:32.453614825 +0000 UTC m=+22.612757740" watchObservedRunningTime="2026-06-14 03:13:32.454019743 +0000 UTC m=+22.613162646" Jun 14 03:13:32.470771 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.470735 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cmhxd" podStartSLOduration=3.771785777 podStartE2EDuration="22.470720759s" totalImagesPullingTime="18.698934982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:32.470496382 +0000 UTC m=+22.629639287" watchObservedRunningTime="2026-06-14 03:13:32.470720759 +0000 UTC m=+22.629863663" Jun 14 03:13:32.484424 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.484373 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6cqlb" podStartSLOduration=3.854430984 podStartE2EDuration="22.48435506s" totalImagesPullingTime="18.629924076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:32.483633181 +0000 UTC m=+22.642776085" watchObservedRunningTime="2026-06-14 03:13:32.48435506 +0000 UTC m=+22.643497964" Jun 14 03:13:32.497385 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:32.497348 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qlsqz" podStartSLOduration=3.867882269 podStartE2EDuration="22.497334852s" totalImagesPullingTime="18.629452583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:32.497185367 +0000 UTC m=+22.656328271" watchObservedRunningTime="2026-06-14 03:13:32.497334852 +0000 UTC m=+22.656477756" Jun 14 03:13:33.174275 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:33.174045 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 03:13:33.293886 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:33.293852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:33.294382 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:33.293979 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:33.315036 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:33.314904 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T03:13:33.174276602Z","UUID":"0bb21eb3-6fed-494d-875d-a4b13f0cc042","Handler":null,"Name":"","Endpoint":""} Jun 14 03:13:33.316727 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:33.316705 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 03:13:33.316828 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:33.316740 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 03:13:33.416252 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:33.416214 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" event={"ID":"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479","Type":"ContainerStarted","Data":"2ee25d48b08c07851d8d3180c317f64da140f6b48048dd34d51956162d3ab28c"} Jun 14 03:13:33.419171 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:33.419147 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:13:33.419545 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:33.419520 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" event={"ID":"e5573ea3-92ae-4032-9333-300f5fae54df","Type":"ContainerStarted","Data":"afb98749284cc783eb915ab06357400812269935db07714292b1ab28a1c99291"} Jun 14 03:13:33.419619 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:33.419604 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" event={"ID":"e5573ea3-92ae-4032-9333-300f5fae54df","Type":"ContainerStarted","Data":"a23f5cc440e98341573b9967d61314a47240b1b580b4d57604e906fc68f92fa7"} Jun 14 03:13:33.421055 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:33.421024 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g66n5" event={"ID":"72195c14-ccd6-47a2-bc7b-55f98f521366","Type":"ContainerStarted","Data":"31c8a1dabdb43e12e6a4a6c2cd07e49be591647469dc5878df54620c716472b7"} Jun 14 03:13:33.435217 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:33.435165 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g66n5" podStartSLOduration=4.831273245 podStartE2EDuration="23.435147831s" totalImagesPullingTime="18.603874586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:33.434895312 +0000 UTC m=+23.594038234" watchObservedRunningTime="2026-06-14 03:13:33.435147831 +0000 UTC m=+23.594290737" Jun 14 03:13:34.293622 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:34.293589 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:34.293762 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:34.293706 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:34.293817 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:34.293768 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:34.293911 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:34.293890 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:34.425246 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:34.425167 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" event={"ID":"1ad8c2cd-72e4-4a47-9968-5b3ea3db3479","Type":"ContainerStarted","Data":"4fad0114990128b674b5d764c3228d1de165edc093f8b59599fed109e8cc4045"} Jun 14 03:13:34.443547 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:34.443498 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cbg7" podStartSLOduration=3.88505862 podStartE2EDuration="24.443478213s" totalImagesPullingTime="20.558419593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:13:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:34.442800893 +0000 UTC m=+24.601943798" watchObservedRunningTime="2026-06-14 03:13:34.443478213 +0000 UTC m=+24.602621118" Jun 14 03:13:35.293414 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:35.293381 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:35.293559 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:35.293513 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:35.431303 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:35.431278 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:13:35.431751 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:35.431655 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" event={"ID":"e5573ea3-92ae-4032-9333-300f5fae54df","Type":"ContainerStarted","Data":"1a16e69d987f5f80eda26e2fefd034076e38a867fbf7aeb9d4eac047d4364954"} Jun 14 03:13:36.224442 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:36.224410 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qlsqz" Jun 14 03:13:36.225170 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:36.225152 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qlsqz" Jun 14 03:13:36.293798 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:36.293757 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:36.293990 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:36.293769 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:36.293990 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:36.293869 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:36.294111 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:36.294001 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:36.434404 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:36.434370 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qlsqz" Jun 14 03:13:36.435086 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:36.435063 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qlsqz" Jun 14 03:13:37.293913 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:37.293706 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:37.294045 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:37.293958 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:37.438351 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:37.438323 2581 generic.go:356] "Generic (PLEG): container finished" podID="fd57bf24-0839-4aa8-be56-63233ae1bce5" containerID="2df9d8fdae931a29f334d0a0f4e90239aecb7cb3a5d02b6c5fc6ea49a915f88e" exitCode=0 Jun 14 03:13:37.438710 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:37.438397 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcnf6" event={"ID":"fd57bf24-0839-4aa8-be56-63233ae1bce5","Type":"ContainerDied","Data":"2df9d8fdae931a29f334d0a0f4e90239aecb7cb3a5d02b6c5fc6ea49a915f88e"} Jun 14 03:13:37.444699 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:37.444678 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:13:37.445090 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:37.445064 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" event={"ID":"e5573ea3-92ae-4032-9333-300f5fae54df","Type":"ContainerStarted","Data":"788f1b803fa7eed5b3ada9cdf9b153a598df90c0cd56ef7fcacd817de9bcc481"} Jun 14 03:13:37.445243 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:37.445228 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:37.445324 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:37.445301 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:37.445376 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:37.445346 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:37.445517 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:37.445500 2581 scope.go:117] "RemoveContainer" containerID="43c98c9294f60779e2234375892affd19687e03d856e35a7a4fecc48a50c90ea" Jun 14 03:13:37.461862 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:37.461841 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:37.462104 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:37.462090 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:13:38.295856 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:38.295188 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:38.295856 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:38.295326 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:38.295856 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:38.295705 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:38.295856 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:38.295795 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:38.450000 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:38.449888 2581 generic.go:356] "Generic (PLEG): container finished" podID="fd57bf24-0839-4aa8-be56-63233ae1bce5" containerID="c131837631e85394565f4446a29aa2b8ca8c09ac444aef1ba3d286c584a9c43d" exitCode=0 Jun 14 03:13:38.450000 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:38.449972 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcnf6" event={"ID":"fd57bf24-0839-4aa8-be56-63233ae1bce5","Type":"ContainerDied","Data":"c131837631e85394565f4446a29aa2b8ca8c09ac444aef1ba3d286c584a9c43d"} Jun 14 03:13:38.454649 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:38.454631 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:13:38.455094 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:38.455069 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" event={"ID":"e5573ea3-92ae-4032-9333-300f5fae54df","Type":"ContainerStarted","Data":"1776332f9811303db2b7d67500404a799726a2570ca48fe3f58d648d048afaaf"} Jun 14 03:13:38.500711 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:38.500661 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" podStartSLOduration=9.815131856 podStartE2EDuration="28.500646435s" totalImagesPullingTime="18.685514579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:38.499132595 +0000 UTC m=+28.658275499" watchObservedRunningTime="2026-06-14 03:13:38.500646435 +0000 UTC m=+28.659789338" Jun 14 03:13:38.997172 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:38.996815 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lwmb5"] Jun 14 03:13:38.997346 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:38.997224 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:38.997346 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:38.997332 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:38.997710 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:38.997642 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z9v7r"] Jun 14 03:13:38.997818 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:38.997775 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:38.997877 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:38.997845 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:38.998357 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:38.998323 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vlbgl"] Jun 14 03:13:38.998452 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:38.998414 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:38.998506 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:38.998488 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:39.459079 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:39.459051 2581 generic.go:356] "Generic (PLEG): container finished" podID="fd57bf24-0839-4aa8-be56-63233ae1bce5" containerID="037502ca38ce1377f2cb4206d1b03f63bc9cbc00d60c3facd0937718de1a3a40" exitCode=0 Jun 14 03:13:39.459540 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:39.459133 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcnf6" event={"ID":"fd57bf24-0839-4aa8-be56-63233ae1bce5","Type":"ContainerDied","Data":"037502ca38ce1377f2cb4206d1b03f63bc9cbc00d60c3facd0937718de1a3a40"} Jun 14 03:13:40.294686 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:40.294657 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:40.294848 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:40.294782 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:41.293123 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:41.293079 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:41.293123 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:41.293130 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:41.293648 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:41.293233 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:41.293648 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:41.293429 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:42.293293 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:42.293258 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:42.293899 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:42.293389 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:43.293175 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:43.293099 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:43.293175 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:43.293132 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:43.293674 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:43.293224 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlbgl" podUID="f8fda1d3-bf38-4112-9d1c-89cb07a96a5e" Jun 14 03:13:43.293674 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:43.293329 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9v7r" podUID="b5814b79-879c-469b-8793-8b54b6c7633a" Jun 14 03:13:44.090738 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.090704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:44.090963 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.090746 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:44.090963 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:44.090829 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:44.090963 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:44.090872 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:44.090963 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:44.090883 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs podName:6aef466d-2db1-4d24-9c58-bf3c6859587f nodeName:}" failed. No retries permitted until 2026-06-14 03:14:16.090870902 +0000 UTC m=+66.250013784 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs") pod "network-metrics-daemon-lwmb5" (UID: "6aef466d-2db1-4d24-9c58-bf3c6859587f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:44.090963 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:44.090956 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret podName:f8fda1d3-bf38-4112-9d1c-89cb07a96a5e nodeName:}" failed. No retries permitted until 2026-06-14 03:14:16.090939873 +0000 UTC m=+66.250082770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret") pod "global-pull-secret-syncer-vlbgl" (UID: "f8fda1d3-bf38-4112-9d1c-89cb07a96a5e") : object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:44.191288 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.191256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7kc\" (UniqueName: \"kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc\") pod \"network-check-target-z9v7r\" (UID: \"b5814b79-879c-469b-8793-8b54b6c7633a\") " pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:44.191428 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:44.191413 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 03:13:44.191468 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:44.191435 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 03:13:44.191468 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:44.191447 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7j7kc for pod openshift-network-diagnostics/network-check-target-z9v7r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:44.191532 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:44.191494 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc podName:b5814b79-879c-469b-8793-8b54b6c7633a nodeName:}" failed. No retries permitted until 2026-06-14 03:14:16.191481694 +0000 UTC m=+66.350624576 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7j7kc" (UniqueName: "kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc") pod "network-check-target-z9v7r" (UID: "b5814b79-879c-469b-8793-8b54b6c7633a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:44.293164 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.293129 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:44.293338 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:44.293261 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:13:44.660620 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.660381 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeReady" Jun 14 03:13:44.660827 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.660738 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 03:13:44.706238 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.706214 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rggv2"] Jun 14 03:13:44.720526 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.720506 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gfm2z"] Jun 14 03:13:44.720661 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.720642 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:44.722968 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.722949 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 03:13:44.723059 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.723005 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ctq98\"" Jun 14 03:13:44.723128 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.723116 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 03:13:44.734738 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.734659 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rggv2"] Jun 14 03:13:44.734738 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.734697 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gfm2z"] Jun 14 03:13:44.734841 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.734763 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gfm2z" Jun 14 03:13:44.737432 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.737415 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 03:13:44.737568 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.737550 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pf4ph\"" Jun 14 03:13:44.737568 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.737563 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 03:13:44.738063 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.738050 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 03:13:44.795807 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.795776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4fa9ace-4554-47df-9837-f3654d47b791-tmp-dir\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:44.795807 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.795807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f4fa9ace-4554-47df-9837-f3654d47b791-config-volume\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:44.795983 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.795832 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9mvx\" (UniqueName: \"kubernetes.io/projected/f4fa9ace-4554-47df-9837-f3654d47b791-kube-api-access-n9mvx\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:44.795983 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.795860 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:44.896582 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.896552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlk2x\" (UniqueName: \"kubernetes.io/projected/19be7501-2da6-48b0-945c-6d519237edcb-kube-api-access-wlk2x\") pod \"ingress-canary-gfm2z\" (UID: \"19be7501-2da6-48b0-945c-6d519237edcb\") " pod="openshift-ingress-canary/ingress-canary-gfm2z" Jun 14 03:13:44.896680 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.896606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4fa9ace-4554-47df-9837-f3654d47b791-tmp-dir\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:44.896680 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.896650 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f4fa9ace-4554-47df-9837-f3654d47b791-config-volume\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:44.896745 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.896680 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19be7501-2da6-48b0-945c-6d519237edcb-cert\") pod \"ingress-canary-gfm2z\" (UID: \"19be7501-2da6-48b0-945c-6d519237edcb\") " pod="openshift-ingress-canary/ingress-canary-gfm2z" Jun 14 03:13:44.896745 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.896705 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9mvx\" (UniqueName: \"kubernetes.io/projected/f4fa9ace-4554-47df-9837-f3654d47b791-kube-api-access-n9mvx\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:44.896745 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.896740 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:44.896851 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:44.896836 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:13:44.896898 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.896883 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4fa9ace-4554-47df-9837-f3654d47b791-tmp-dir\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:44.896950 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:44.896894 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls podName:f4fa9ace-4554-47df-9837-f3654d47b791 nodeName:}" failed. No retries permitted until 2026-06-14 03:13:45.396877671 +0000 UTC m=+35.556020556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls") pod "dns-default-rggv2" (UID: "f4fa9ace-4554-47df-9837-f3654d47b791") : secret "dns-default-metrics-tls" not found Jun 14 03:13:44.897288 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.897270 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f4fa9ace-4554-47df-9837-f3654d47b791-config-volume\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:44.907022 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.907002 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9mvx\" (UniqueName: \"kubernetes.io/projected/f4fa9ace-4554-47df-9837-f3654d47b791-kube-api-access-n9mvx\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:44.997115 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.997063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlk2x\" (UniqueName: \"kubernetes.io/projected/19be7501-2da6-48b0-945c-6d519237edcb-kube-api-access-wlk2x\") pod \"ingress-canary-gfm2z\" (UID: \"19be7501-2da6-48b0-945c-6d519237edcb\") " pod="openshift-ingress-canary/ingress-canary-gfm2z" Jun 14 03:13:44.997209 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.997117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19be7501-2da6-48b0-945c-6d519237edcb-cert\") pod \"ingress-canary-gfm2z\" (UID: \"19be7501-2da6-48b0-945c-6d519237edcb\") " pod="openshift-ingress-canary/ingress-canary-gfm2z" Jun 14 03:13:44.999376 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:44.999355 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19be7501-2da6-48b0-945c-6d519237edcb-cert\") pod \"ingress-canary-gfm2z\" (UID: \"19be7501-2da6-48b0-945c-6d519237edcb\") " pod="openshift-ingress-canary/ingress-canary-gfm2z" Jun 14 03:13:45.006072 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:45.006054 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlk2x\" (UniqueName: \"kubernetes.io/projected/19be7501-2da6-48b0-945c-6d519237edcb-kube-api-access-wlk2x\") pod \"ingress-canary-gfm2z\" (UID: \"19be7501-2da6-48b0-945c-6d519237edcb\") " pod="openshift-ingress-canary/ingress-canary-gfm2z" Jun 14 03:13:45.055138 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:45.055115 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gfm2z" Jun 14 03:13:45.242751 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:45.242724 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gfm2z"] Jun 14 03:13:45.246076 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:13:45.246052 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19be7501_2da6_48b0_945c_6d519237edcb.slice/crio-1f5444cff011a9ae997efbf0c80fa4d8dd0832bd50d5f95ad2216eafe66fb431 WatchSource:0}: Error finding container 1f5444cff011a9ae997efbf0c80fa4d8dd0832bd50d5f95ad2216eafe66fb431: Status 404 returned error can't find the container with id 1f5444cff011a9ae997efbf0c80fa4d8dd0832bd50d5f95ad2216eafe66fb431 Jun 14 03:13:45.293977 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:45.293947 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:13:45.294339 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:45.293979 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:13:45.297101 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:45.297079 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 03:13:45.297257 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:45.297241 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 03:13:45.297346 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:45.297330 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-68bfl\"" Jun 14 03:13:45.297493 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:45.297477 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 03:13:45.400811 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:45.400792 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:45.400965 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:45.400916 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:13:45.401027 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:45.400978 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls podName:f4fa9ace-4554-47df-9837-f3654d47b791 nodeName:}" failed. No retries permitted until 2026-06-14 03:13:46.400966324 +0000 UTC m=+36.560109206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls") pod "dns-default-rggv2" (UID: "f4fa9ace-4554-47df-9837-f3654d47b791") : secret "dns-default-metrics-tls" not found Jun 14 03:13:45.475381 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:45.475359 2581 generic.go:356] "Generic (PLEG): container finished" podID="fd57bf24-0839-4aa8-be56-63233ae1bce5" containerID="b2de6757743d5ea85a896d42bc4549503249c3c3fdd5673f4d2df1c3440648d7" exitCode=0 Jun 14 03:13:45.475501 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:45.475445 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcnf6" event={"ID":"fd57bf24-0839-4aa8-be56-63233ae1bce5","Type":"ContainerDied","Data":"b2de6757743d5ea85a896d42bc4549503249c3c3fdd5673f4d2df1c3440648d7"} Jun 14 03:13:45.476618 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:45.476598 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gfm2z" event={"ID":"19be7501-2da6-48b0-945c-6d519237edcb","Type":"ContainerStarted","Data":"1f5444cff011a9ae997efbf0c80fa4d8dd0832bd50d5f95ad2216eafe66fb431"} Jun 14 03:13:46.294110 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:46.293918 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:13:46.296869 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:46.296844 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 03:13:46.297010 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:46.296943 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hmrz\"" Jun 14 03:13:46.407036 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:46.407010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:46.407182 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:46.407120 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:13:46.407182 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:46.407179 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls podName:f4fa9ace-4554-47df-9837-f3654d47b791 nodeName:}" failed. No retries permitted until 2026-06-14 03:13:48.407160739 +0000 UTC m=+38.566303623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls") pod "dns-default-rggv2" (UID: "f4fa9ace-4554-47df-9837-f3654d47b791") : secret "dns-default-metrics-tls" not found Jun 14 03:13:46.482221 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:46.482190 2581 generic.go:356] "Generic (PLEG): container finished" podID="fd57bf24-0839-4aa8-be56-63233ae1bce5" containerID="11a8884ee289d860630604ad0170628b2d681575d348bad368cdad0814ae9631" exitCode=0 Jun 14 03:13:46.482356 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:46.482240 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcnf6" event={"ID":"fd57bf24-0839-4aa8-be56-63233ae1bce5","Type":"ContainerDied","Data":"11a8884ee289d860630604ad0170628b2d681575d348bad368cdad0814ae9631"} Jun 14 03:13:47.489720 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:47.489691 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcnf6" event={"ID":"fd57bf24-0839-4aa8-be56-63233ae1bce5","Type":"ContainerStarted","Data":"eeca77d6c9470ba583b241f21c3cf85c4d5108470b7994ac41462c36660182a1"} Jun 14 03:13:47.515150 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:47.514532 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fcnf6" podStartSLOduration=8.11608886 podStartE2EDuration="37.514515291s" totalImagesPullingTime="29.398426431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:13:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:47.513300882 +0000 UTC m=+37.672443785" watchObservedRunningTime="2026-06-14 03:13:47.514515291 +0000 UTC m=+37.673658196" Jun 14 03:13:48.424288 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:48.424247 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:48.424482 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:48.424371 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:13:48.424482 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:48.424433 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls podName:f4fa9ace-4554-47df-9837-f3654d47b791 nodeName:}" failed. No retries permitted until 2026-06-14 03:13:52.424414721 +0000 UTC m=+42.583557617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls") pod "dns-default-rggv2" (UID: "f4fa9ace-4554-47df-9837-f3654d47b791") : secret "dns-default-metrics-tls" not found Jun 14 03:13:48.493295 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:48.493263 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gfm2z" event={"ID":"19be7501-2da6-48b0-945c-6d519237edcb","Type":"ContainerStarted","Data":"acbf251ed7e42036852b20819868dd1939a43d469d08d779892b5bbdbe857d8e"} Jun 14 03:13:48.508334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:48.508287 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gfm2z" podStartSLOduration=2.246959421 podStartE2EDuration="4.508274313s" totalImagesPullingTime="2.261314892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:48.508115083 +0000 UTC m=+38.667257989" watchObservedRunningTime="2026-06-14 03:13:48.508274313 +0000 UTC m=+38.667417217" Jun 14 03:13:52.452288 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:13:52.452254 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:13:52.452751 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:52.452371 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:13:52.452751 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:13:52.452428 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls podName:f4fa9ace-4554-47df-9837-f3654d47b791 nodeName:}" failed. No retries permitted until 2026-06-14 03:14:00.452411024 +0000 UTC m=+50.611553923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls") pod "dns-default-rggv2" (UID: "f4fa9ace-4554-47df-9837-f3654d47b791") : secret "dns-default-metrics-tls" not found Jun 14 03:14:00.505348 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.505307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:14:00.505835 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:14:00.505452 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:14:00.505835 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:14:00.505513 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls podName:f4fa9ace-4554-47df-9837-f3654d47b791 nodeName:}" failed. No retries permitted until 2026-06-14 03:14:16.505497892 +0000 UTC m=+66.664640773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls") pod "dns-default-rggv2" (UID: "f4fa9ace-4554-47df-9837-f3654d47b791") : secret "dns-default-metrics-tls" not found Jun 14 03:14:00.619166 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.619127 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl"] Jun 14 03:14:00.639790 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.639756 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl"] Jun 14 03:14:00.639955 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.639884 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.642420 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.642396 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 14 03:14:00.642534 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.642404 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 14 03:14:00.642601 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.642564 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 14 03:14:00.642693 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.642670 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 14 03:14:00.642887 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.642872 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 14 03:14:00.643647 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.643625 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 14 03:14:00.643735 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.643703 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 14 03:14:00.807909 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.807823 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e4396321-4b63-4599-bb8e-47417ed92d74-ca\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.807909 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.807861 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e4396321-4b63-4599-bb8e-47417ed92d74-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.807909 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.807882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4396321-4b63-4599-bb8e-47417ed92d74-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.807909 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.807912 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4396321-4b63-4599-bb8e-47417ed92d74-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.808159 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.807990 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e4396321-4b63-4599-bb8e-47417ed92d74-hub\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.808159 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.808008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rpt5\" (UniqueName: \"kubernetes.io/projected/e4396321-4b63-4599-bb8e-47417ed92d74-kube-api-access-5rpt5\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.908281 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.908247 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4396321-4b63-4599-bb8e-47417ed92d74-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.908420 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.908302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e4396321-4b63-4599-bb8e-47417ed92d74-hub\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.908420 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.908322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rpt5\" (UniqueName: \"kubernetes.io/projected/e4396321-4b63-4599-bb8e-47417ed92d74-kube-api-access-5rpt5\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.908420 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.908365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e4396321-4b63-4599-bb8e-47417ed92d74-ca\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.908420 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.908381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e4396321-4b63-4599-bb8e-47417ed92d74-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.908420 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.908396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4396321-4b63-4599-bb8e-47417ed92d74-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.909293 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.909143 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4396321-4b63-4599-bb8e-47417ed92d74-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.912000 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.911971 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e4396321-4b63-4599-bb8e-47417ed92d74-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.912000 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.911985 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e4396321-4b63-4599-bb8e-47417ed92d74-hub\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.912171 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.912068 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e4396321-4b63-4599-bb8e-47417ed92d74-ca\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.912232 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.912202 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4396321-4b63-4599-bb8e-47417ed92d74-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.916156 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.916134 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rpt5\" (UniqueName: \"kubernetes.io/projected/e4396321-4b63-4599-bb8e-47417ed92d74-kube-api-access-5rpt5\") pod \"cluster-proxy-proxy-agent-5d48dd77f5-5d8nl\" (UID: \"e4396321-4b63-4599-bb8e-47417ed92d74\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:00.975998 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:00.975964 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:14:01.123305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:01.123273 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl"] Jun 14 03:14:01.127129 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:14:01.127102 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4396321_4b63_4599_bb8e_47417ed92d74.slice/crio-9a4b9e89b41def171e51122983174ae0b9d6cdad85c37b6fcf938dcb558984e5 WatchSource:0}: Error finding container 9a4b9e89b41def171e51122983174ae0b9d6cdad85c37b6fcf938dcb558984e5: Status 404 returned error can't find the container with id 9a4b9e89b41def171e51122983174ae0b9d6cdad85c37b6fcf938dcb558984e5 Jun 14 03:14:01.524056 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:01.524020 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" event={"ID":"e4396321-4b63-4599-bb8e-47417ed92d74","Type":"ContainerStarted","Data":"9a4b9e89b41def171e51122983174ae0b9d6cdad85c37b6fcf938dcb558984e5"} Jun 14 03:14:05.535411 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:05.535222 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" event={"ID":"e4396321-4b63-4599-bb8e-47417ed92d74","Type":"ContainerStarted","Data":"f2414fb97ac1d5a6f30b0ed7ce8f799c596296bfaa56502d7a4bd76cee428130"} Jun 14 03:14:05.535822 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:05.535423 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" event={"ID":"e4396321-4b63-4599-bb8e-47417ed92d74","Type":"ContainerStarted","Data":"c4008006a6460a5013087252c99c4f556c94881a7d61338256f2c81d15e6997d"} Jun 14 03:14:05.535822 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:05.535442 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" event={"ID":"e4396321-4b63-4599-bb8e-47417ed92d74","Type":"ContainerStarted","Data":"9a58e6ea5098e55a96e92cd629cf1807639109e95a98c614748acab04df0481f"} Jun 14 03:14:05.554099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:05.554046 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" podStartSLOduration=1.8327449630000001 podStartE2EDuration="5.554028664s" totalImagesPullingTime="3.721283701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:14:05.553077787 +0000 UTC m=+55.712220715" watchObservedRunningTime="2026-06-14 03:14:05.554028664 +0000 UTC m=+55.713171546" Jun 14 03:14:09.469794 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:09.469769 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tg2sg" Jun 14 03:14:16.124892 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.124852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:14:16.125342 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.124905 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:14:16.127574 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.127553 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 03:14:16.127674 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.127615 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 03:14:16.135530 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:14:16.135514 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 03:14:16.135604 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:14:16.135577 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs podName:6aef466d-2db1-4d24-9c58-bf3c6859587f nodeName:}" failed. No retries permitted until 2026-06-14 03:15:20.13556236 +0000 UTC m=+130.294705245 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs") pod "network-metrics-daemon-lwmb5" (UID: "6aef466d-2db1-4d24-9c58-bf3c6859587f") : secret "metrics-daemon-secret" not found Jun 14 03:14:16.139266 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.139250 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8fda1d3-bf38-4112-9d1c-89cb07a96a5e-original-pull-secret\") pod \"global-pull-secret-syncer-vlbgl\" (UID: \"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e\") " pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:14:16.204000 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.203975 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlbgl" Jun 14 03:14:16.225617 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.225598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7kc\" (UniqueName: \"kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc\") pod \"network-check-target-z9v7r\" (UID: \"b5814b79-879c-469b-8793-8b54b6c7633a\") " pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:14:16.228356 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.228341 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 03:14:16.238617 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.238599 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 03:14:16.250472 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.250431 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j7kc\" (UniqueName: \"kubernetes.io/projected/b5814b79-879c-469b-8793-8b54b6c7633a-kube-api-access-7j7kc\") pod \"network-check-target-z9v7r\" (UID: \"b5814b79-879c-469b-8793-8b54b6c7633a\") " pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:14:16.362825 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.362796 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vlbgl"] Jun 14 03:14:16.366181 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:14:16.366155 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8fda1d3_bf38_4112_9d1c_89cb07a96a5e.slice/crio-f3d8ca2c441678d3460694d6b8aeafbaf1ed010bafba4e7e12b4dcfd8c0895fb WatchSource:0}: Error finding container f3d8ca2c441678d3460694d6b8aeafbaf1ed010bafba4e7e12b4dcfd8c0895fb: Status 404 returned error can't find the container with id f3d8ca2c441678d3460694d6b8aeafbaf1ed010bafba4e7e12b4dcfd8c0895fb Jun 14 03:14:16.511326 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.511256 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-68bfl\"" Jun 14 03:14:16.519180 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.519164 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:14:16.527566 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.527546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:14:16.527703 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:14:16.527686 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:14:16.527768 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:14:16.527754 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls podName:f4fa9ace-4554-47df-9837-f3654d47b791 nodeName:}" failed. No retries permitted until 2026-06-14 03:14:48.5277334 +0000 UTC m=+98.686876302 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls") pod "dns-default-rggv2" (UID: "f4fa9ace-4554-47df-9837-f3654d47b791") : secret "dns-default-metrics-tls" not found Jun 14 03:14:16.561480 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.561442 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vlbgl" event={"ID":"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e","Type":"ContainerStarted","Data":"f3d8ca2c441678d3460694d6b8aeafbaf1ed010bafba4e7e12b4dcfd8c0895fb"} Jun 14 03:14:16.638084 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:16.638053 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z9v7r"] Jun 14 03:14:16.641706 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:14:16.641678 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5814b79_879c_469b_8793_8b54b6c7633a.slice/crio-b9e7d01d2402a94f15522752f5cd914bea5a572eba96e1c4d9a8e9c0100d9002 WatchSource:0}: Error finding container b9e7d01d2402a94f15522752f5cd914bea5a572eba96e1c4d9a8e9c0100d9002: Status 404 returned error can't find the container with id b9e7d01d2402a94f15522752f5cd914bea5a572eba96e1c4d9a8e9c0100d9002 Jun 14 03:14:17.565360 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:17.565323 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z9v7r" event={"ID":"b5814b79-879c-469b-8793-8b54b6c7633a","Type":"ContainerStarted","Data":"b9e7d01d2402a94f15522752f5cd914bea5a572eba96e1c4d9a8e9c0100d9002"} Jun 14 03:14:21.578796 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:21.578753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vlbgl" event={"ID":"f8fda1d3-bf38-4112-9d1c-89cb07a96a5e","Type":"ContainerStarted","Data":"d3a0b276648395bd1e40144da31d052e9da8c36b8b0cead26294dcf75788f287"} Jun 14 03:14:21.580174 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:21.580151 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z9v7r" event={"ID":"b5814b79-879c-469b-8793-8b54b6c7633a","Type":"ContainerStarted","Data":"15081fb5acad8c7f2570b7c08aa09172e207535c0a3a2099b613a5ff915e645e"} Jun 14 03:14:21.580281 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:21.580224 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:14:21.594296 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:21.594249 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vlbgl" podStartSLOduration=67.104346482 podStartE2EDuration="1m11.594237591s" totalImagesPullingTime="4.489891109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:14:21.593727651 +0000 UTC m=+71.752870556" watchObservedRunningTime="2026-06-14 03:14:21.594237591 +0000 UTC m=+71.753380494" Jun 14 03:14:21.611338 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:21.611299 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z9v7r" podStartSLOduration=67.401849219 podStartE2EDuration="1m11.611287424s" totalImagesPullingTime="4.209438205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:14:21.610627202 +0000 UTC m=+71.769770117" watchObservedRunningTime="2026-06-14 03:14:21.611287424 +0000 UTC m=+71.770430328" Jun 14 03:14:48.538398 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:48.538365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:14:48.538739 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:14:48.538496 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:14:48.538739 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:14:48.538562 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls podName:f4fa9ace-4554-47df-9837-f3654d47b791 nodeName:}" failed. No retries permitted until 2026-06-14 03:15:52.538545082 +0000 UTC m=+162.697687965 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls") pod "dns-default-rggv2" (UID: "f4fa9ace-4554-47df-9837-f3654d47b791") : secret "dns-default-metrics-tls" not found Jun 14 03:14:52.585345 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:14:52.585312 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z9v7r" Jun 14 03:15:20.236598 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:15:20.236557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:15:20.237087 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:15:20.236681 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 03:15:20.237087 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:15:20.236744 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs podName:6aef466d-2db1-4d24-9c58-bf3c6859587f nodeName:}" failed. No retries permitted until 2026-06-14 03:17:22.236729462 +0000 UTC m=+252.395872344 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs") pod "network-metrics-daemon-lwmb5" (UID: "6aef466d-2db1-4d24-9c58-bf3c6859587f") : secret "metrics-daemon-secret" not found Jun 14 03:15:47.750509 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:15:47.750464 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rggv2" podUID="f4fa9ace-4554-47df-9837-f3654d47b791" Jun 14 03:15:47.817557 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:15:47.817529 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rggv2" Jun 14 03:15:49.303332 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:15:49.303283 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lwmb5" podUID="6aef466d-2db1-4d24-9c58-bf3c6859587f" Jun 14 03:15:52.539020 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:15:52.538979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:15:52.539478 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:15:52.539119 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:15:52.539478 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:15:52.539191 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls podName:f4fa9ace-4554-47df-9837-f3654d47b791 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:54.539172082 +0000 UTC m=+284.698314981 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls") pod "dns-default-rggv2" (UID: "f4fa9ace-4554-47df-9837-f3654d47b791") : secret "dns-default-metrics-tls" not found Jun 14 03:16:04.293501 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:04.293461 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:16:50.457102 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.457048 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf"] Jun 14 03:16:50.458700 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.458682 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:16:50.462360 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.462337 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 14 03:16:50.462948 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.462913 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 03:16:50.463494 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.463479 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mr88x\"" Jun 14 03:16:50.463584 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.463503 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 03:16:50.471572 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.471551 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 14 03:16:50.476241 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.476220 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf"] Jun 14 03:16:50.515028 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.515000 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:16:50.515125 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.515031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h28z\" (UniqueName: \"kubernetes.io/projected/e62edaa5-d92e-4400-b1bf-16fab4998321-kube-api-access-2h28z\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:16:50.515125 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.515053 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e62edaa5-d92e-4400-b1bf-16fab4998321-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:16:50.615530 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.615502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:16:50.615631 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.615538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h28z\" (UniqueName: \"kubernetes.io/projected/e62edaa5-d92e-4400-b1bf-16fab4998321-kube-api-access-2h28z\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:16:50.615631 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.615559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e62edaa5-d92e-4400-b1bf-16fab4998321-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:16:50.615710 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:50.615643 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 03:16:50.615748 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:50.615732 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls podName:e62edaa5-d92e-4400-b1bf-16fab4998321 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:51.115715907 +0000 UTC m=+221.274858789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-hshdf" (UID: "e62edaa5-d92e-4400-b1bf-16fab4998321") : secret "cluster-monitoring-operator-tls" not found Jun 14 03:16:50.616226 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.616208 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e62edaa5-d92e-4400-b1bf-16fab4998321-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:16:50.623638 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:50.623616 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h28z\" (UniqueName: \"kubernetes.io/projected/e62edaa5-d92e-4400-b1bf-16fab4998321-kube-api-access-2h28z\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:16:51.119887 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:51.119855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:16:51.120078 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:51.120017 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 03:16:51.120126 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:51.120094 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls podName:e62edaa5-d92e-4400-b1bf-16fab4998321 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:52.12007753 +0000 UTC m=+222.279220439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-hshdf" (UID: "e62edaa5-d92e-4400-b1bf-16fab4998321") : secret "cluster-monitoring-operator-tls" not found Jun 14 03:16:52.125896 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:52.125851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:16:52.126299 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:52.126012 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 03:16:52.126299 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:52.126072 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls podName:e62edaa5-d92e-4400-b1bf-16fab4998321 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:54.126057138 +0000 UTC m=+224.285200019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-hshdf" (UID: "e62edaa5-d92e-4400-b1bf-16fab4998321") : secret "cluster-monitoring-operator-tls" not found Jun 14 03:16:54.140436 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:54.140401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:16:54.140857 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:54.140516 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 03:16:54.140857 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:54.140567 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls podName:e62edaa5-d92e-4400-b1bf-16fab4998321 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:58.140553296 +0000 UTC m=+228.299696178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-hshdf" (UID: "e62edaa5-d92e-4400-b1bf-16fab4998321") : secret "cluster-monitoring-operator-tls" not found Jun 14 03:16:55.508153 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.508121 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jz99q"] Jun 14 03:16:55.511018 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.511001 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:55.513162 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.513133 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 03:16:55.513292 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.513227 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 03:16:55.513382 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.513365 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q7kdg\"" Jun 14 03:16:55.513422 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.513403 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 03:16:55.514245 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.514228 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 03:16:55.520601 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.520577 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jz99q"] Jun 14 03:16:55.549247 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.549221 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:55.549346 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.549262 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fxx2\" (UniqueName: \"kubernetes.io/projected/aab25c71-9578-4a64-9b09-021821ca1e63-kube-api-access-9fxx2\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:55.549346 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.549313 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aab25c71-9578-4a64-9b09-021821ca1e63-crio-socket\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:55.549346 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.549330 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aab25c71-9578-4a64-9b09-021821ca1e63-data-volume\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:55.549458 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.549347 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:55.650425 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.650401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fxx2\" (UniqueName: \"kubernetes.io/projected/aab25c71-9578-4a64-9b09-021821ca1e63-kube-api-access-9fxx2\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:55.650520 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.650478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aab25c71-9578-4a64-9b09-021821ca1e63-crio-socket\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:55.650520 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.650506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aab25c71-9578-4a64-9b09-021821ca1e63-data-volume\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:55.650625 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.650530 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:55.650625 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.650568 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:55.650727 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.650617 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aab25c71-9578-4a64-9b09-021821ca1e63-crio-socket\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:55.650727 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:55.650629 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 03:16:55.650727 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:55.650679 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 03:16:55.650727 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:55.650698 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm podName:aab25c71-9578-4a64-9b09-021821ca1e63 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:56.150682708 +0000 UTC m=+226.309825590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jz99q" (UID: "aab25c71-9578-4a64-9b09-021821ca1e63") : configmap "kube-rbac-proxy" not found Jun 14 03:16:55.650727 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:55.650727 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls podName:aab25c71-9578-4a64-9b09-021821ca1e63 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:56.150710925 +0000 UTC m=+226.309853822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jz99q" (UID: "aab25c71-9578-4a64-9b09-021821ca1e63") : secret "insights-runtime-extractor-tls" not found Jun 14 03:16:55.651023 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.650779 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aab25c71-9578-4a64-9b09-021821ca1e63-data-volume\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:55.658744 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:55.658722 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fxx2\" (UniqueName: \"kubernetes.io/projected/aab25c71-9578-4a64-9b09-021821ca1e63-kube-api-access-9fxx2\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:56.153126 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:56.153084 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:56.153126 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:56.153132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:56.153396 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:56.153214 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 03:16:56.153396 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:56.153237 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 03:16:56.153396 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:56.153286 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm podName:aab25c71-9578-4a64-9b09-021821ca1e63 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:57.153268093 +0000 UTC m=+227.312410985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jz99q" (UID: "aab25c71-9578-4a64-9b09-021821ca1e63") : configmap "kube-rbac-proxy" not found Jun 14 03:16:56.153396 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:56.153303 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls podName:aab25c71-9578-4a64-9b09-021821ca1e63 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:57.153295555 +0000 UTC m=+227.312438446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jz99q" (UID: "aab25c71-9578-4a64-9b09-021821ca1e63") : secret "insights-runtime-extractor-tls" not found Jun 14 03:16:57.160358 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.160318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:57.160358 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.160366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:57.160790 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:57.160432 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 03:16:57.160790 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:57.160454 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 03:16:57.160790 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:57.160490 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm podName:aab25c71-9578-4a64-9b09-021821ca1e63 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:59.160475538 +0000 UTC m=+229.319618419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jz99q" (UID: "aab25c71-9578-4a64-9b09-021821ca1e63") : configmap "kube-rbac-proxy" not found Jun 14 03:16:57.160790 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:57.160504 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls podName:aab25c71-9578-4a64-9b09-021821ca1e63 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:59.160498401 +0000 UTC m=+229.319641283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jz99q" (UID: "aab25c71-9578-4a64-9b09-021821ca1e63") : secret "insights-runtime-extractor-tls" not found Jun 14 03:16:57.416239 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.416167 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-2csvq"] Jun 14 03:16:57.419090 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.419074 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-2csvq" Jun 14 03:16:57.421465 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.421425 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 14 03:16:57.421598 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.421474 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 14 03:16:57.421598 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.421534 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 14 03:16:57.422603 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.422588 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 14 03:16:57.422692 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.422636 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fkpm8\"" Jun 14 03:16:57.425536 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.425514 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-2csvq"] Jun 14 03:16:57.462067 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.462047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/07cdc3ca-676a-4ba8-a5f6-56c9b03821c4-signing-key\") pod \"service-ca-7b994bc59-2csvq\" (UID: \"07cdc3ca-676a-4ba8-a5f6-56c9b03821c4\") " pod="openshift-service-ca/service-ca-7b994bc59-2csvq" Jun 14 03:16:57.462181 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.462079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-787dc\" (UniqueName: \"kubernetes.io/projected/07cdc3ca-676a-4ba8-a5f6-56c9b03821c4-kube-api-access-787dc\") pod \"service-ca-7b994bc59-2csvq\" (UID: \"07cdc3ca-676a-4ba8-a5f6-56c9b03821c4\") " pod="openshift-service-ca/service-ca-7b994bc59-2csvq" Jun 14 03:16:57.462181 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.462159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/07cdc3ca-676a-4ba8-a5f6-56c9b03821c4-signing-cabundle\") pod \"service-ca-7b994bc59-2csvq\" (UID: \"07cdc3ca-676a-4ba8-a5f6-56c9b03821c4\") " pod="openshift-service-ca/service-ca-7b994bc59-2csvq" Jun 14 03:16:57.562944 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.562900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/07cdc3ca-676a-4ba8-a5f6-56c9b03821c4-signing-cabundle\") pod \"service-ca-7b994bc59-2csvq\" (UID: \"07cdc3ca-676a-4ba8-a5f6-56c9b03821c4\") " pod="openshift-service-ca/service-ca-7b994bc59-2csvq" Jun 14 03:16:57.563116 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.563002 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/07cdc3ca-676a-4ba8-a5f6-56c9b03821c4-signing-key\") pod \"service-ca-7b994bc59-2csvq\" (UID: \"07cdc3ca-676a-4ba8-a5f6-56c9b03821c4\") " pod="openshift-service-ca/service-ca-7b994bc59-2csvq" Jun 14 03:16:57.563116 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.563033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-787dc\" (UniqueName: \"kubernetes.io/projected/07cdc3ca-676a-4ba8-a5f6-56c9b03821c4-kube-api-access-787dc\") pod \"service-ca-7b994bc59-2csvq\" (UID: \"07cdc3ca-676a-4ba8-a5f6-56c9b03821c4\") " pod="openshift-service-ca/service-ca-7b994bc59-2csvq" Jun 14 03:16:57.563519 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.563490 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/07cdc3ca-676a-4ba8-a5f6-56c9b03821c4-signing-cabundle\") pod \"service-ca-7b994bc59-2csvq\" (UID: \"07cdc3ca-676a-4ba8-a5f6-56c9b03821c4\") " pod="openshift-service-ca/service-ca-7b994bc59-2csvq" Jun 14 03:16:57.565454 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.565431 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/07cdc3ca-676a-4ba8-a5f6-56c9b03821c4-signing-key\") pod \"service-ca-7b994bc59-2csvq\" (UID: \"07cdc3ca-676a-4ba8-a5f6-56c9b03821c4\") " pod="openshift-service-ca/service-ca-7b994bc59-2csvq" Jun 14 03:16:57.571899 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.571879 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-787dc\" (UniqueName: \"kubernetes.io/projected/07cdc3ca-676a-4ba8-a5f6-56c9b03821c4-kube-api-access-787dc\") pod \"service-ca-7b994bc59-2csvq\" (UID: \"07cdc3ca-676a-4ba8-a5f6-56c9b03821c4\") " pod="openshift-service-ca/service-ca-7b994bc59-2csvq" Jun 14 03:16:57.728632 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.728565 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-2csvq" Jun 14 03:16:57.847444 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:57.847411 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-2csvq"] Jun 14 03:16:57.850685 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:16:57.850659 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07cdc3ca_676a_4ba8_a5f6_56c9b03821c4.slice/crio-b71673ad3cd024b3f43232c7457dffc15a80413478ec0bcc4d448cd9e15c15ad WatchSource:0}: Error finding container b71673ad3cd024b3f43232c7457dffc15a80413478ec0bcc4d448cd9e15c15ad: Status 404 returned error can't find the container with id b71673ad3cd024b3f43232c7457dffc15a80413478ec0bcc4d448cd9e15c15ad Jun 14 03:16:58.008729 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:58.008646 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-2csvq" event={"ID":"07cdc3ca-676a-4ba8-a5f6-56c9b03821c4","Type":"ContainerStarted","Data":"b71673ad3cd024b3f43232c7457dffc15a80413478ec0bcc4d448cd9e15c15ad"} Jun 14 03:16:58.098488 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:58.098462 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6cqlb_ab17fc73-f1d8-47d4-8d65-26cf473dbd8c/dns-node-resolver/0.log" Jun 14 03:16:58.169487 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:58.169463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:16:58.169820 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:58.169576 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 03:16:58.169820 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:58.169626 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls podName:e62edaa5-d92e-4400-b1bf-16fab4998321 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:06.169612624 +0000 UTC m=+236.328755506 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-hshdf" (UID: "e62edaa5-d92e-4400-b1bf-16fab4998321") : secret "cluster-monitoring-operator-tls" not found Jun 14 03:16:59.178282 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:59.178246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:59.178744 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:59.178365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:16:59.178744 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:59.178427 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 03:16:59.178744 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:59.178448 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 03:16:59.178744 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:59.178502 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm podName:aab25c71-9578-4a64-9b09-021821ca1e63 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:03.178487069 +0000 UTC m=+233.337629951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jz99q" (UID: "aab25c71-9578-4a64-9b09-021821ca1e63") : configmap "kube-rbac-proxy" not found Jun 14 03:16:59.178744 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:16:59.178516 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls podName:aab25c71-9578-4a64-9b09-021821ca1e63 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:03.178509545 +0000 UTC m=+233.337652427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jz99q" (UID: "aab25c71-9578-4a64-9b09-021821ca1e63") : secret "insights-runtime-extractor-tls" not found Jun 14 03:16:59.498305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:16:59.498289 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s6rwj_7aed657b-71d4-4eee-bea2-c86f8183cf31/node-ca/0.log" Jun 14 03:17:00.016223 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:00.016182 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-2csvq" event={"ID":"07cdc3ca-676a-4ba8-a5f6-56c9b03821c4","Type":"ContainerStarted","Data":"1069958076d233faff88ecc1395b5fb5b83e74aaac7a734077467f3d63800b6c"} Jun 14 03:17:00.033369 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:00.033328 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-2csvq" podStartSLOduration=1.396863162 podStartE2EDuration="3.033314976s" totalImagesPullingTime="1.636451814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:00.032417284 +0000 UTC m=+230.191560216" watchObservedRunningTime="2026-06-14 03:17:00.033314976 +0000 UTC m=+230.192457874" Jun 14 03:17:00.098457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:00.098432 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gfm2z_19be7501-2da6-48b0-945c-6d519237edcb/serve-healthcheck-canary/0.log" Jun 14 03:17:03.210755 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:03.210720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:17:03.211151 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:03.210762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:17:03.211151 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:17:03.210832 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 03:17:03.211151 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:17:03.210859 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 03:17:03.211151 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:17:03.210889 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm podName:aab25c71-9578-4a64-9b09-021821ca1e63 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:11.210875174 +0000 UTC m=+241.370018056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jz99q" (UID: "aab25c71-9578-4a64-9b09-021821ca1e63") : configmap "kube-rbac-proxy" not found Jun 14 03:17:03.211151 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:17:03.210907 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls podName:aab25c71-9578-4a64-9b09-021821ca1e63 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:11.210895762 +0000 UTC m=+241.370038648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jz99q" (UID: "aab25c71-9578-4a64-9b09-021821ca1e63") : secret "insights-runtime-extractor-tls" not found Jun 14 03:17:06.232353 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:06.232310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:17:06.232726 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:17:06.232431 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 03:17:06.232726 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:17:06.232498 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls podName:e62edaa5-d92e-4400-b1bf-16fab4998321 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:22.232480777 +0000 UTC m=+252.391623665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-hshdf" (UID: "e62edaa5-d92e-4400-b1bf-16fab4998321") : secret "cluster-monitoring-operator-tls" not found Jun 14 03:17:11.271400 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:11.271364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:17:11.271783 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:11.271449 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:17:11.271881 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:11.271865 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab25c71-9578-4a64-9b09-021821ca1e63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:17:11.273877 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:11.273857 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab25c71-9578-4a64-9b09-021821ca1e63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz99q\" (UID: \"aab25c71-9578-4a64-9b09-021821ca1e63\") " pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:17:11.422212 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:11.422181 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q7kdg\"" Jun 14 03:17:11.431101 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:11.431060 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jz99q" Jun 14 03:17:11.557383 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:11.557308 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jz99q"] Jun 14 03:17:11.560815 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:17:11.560792 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab25c71_9578_4a64_9b09_021821ca1e63.slice/crio-73dedbd39a08a16b19fa6d5e14bd3b92865394f43feebae2a90482bf427a66a8 WatchSource:0}: Error finding container 73dedbd39a08a16b19fa6d5e14bd3b92865394f43feebae2a90482bf427a66a8: Status 404 returned error can't find the container with id 73dedbd39a08a16b19fa6d5e14bd3b92865394f43feebae2a90482bf427a66a8 Jun 14 03:17:12.052534 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:12.052504 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jz99q" event={"ID":"aab25c71-9578-4a64-9b09-021821ca1e63","Type":"ContainerStarted","Data":"73dedbd39a08a16b19fa6d5e14bd3b92865394f43feebae2a90482bf427a66a8"} Jun 14 03:17:15.063236 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:15.063202 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jz99q" event={"ID":"aab25c71-9578-4a64-9b09-021821ca1e63","Type":"ContainerStarted","Data":"f3213a13e81c0d099206320265bb070323558a53dd5ba4a8f42f8017a62e06f7"} Jun 14 03:17:16.068625 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:16.068586 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jz99q" event={"ID":"aab25c71-9578-4a64-9b09-021821ca1e63","Type":"ContainerStarted","Data":"95a5a93f8e118a371a5a824abe51618d0fee11771980f5f823c8ea5beb898846"} Jun 14 03:17:18.077699 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:18.077662 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jz99q" event={"ID":"aab25c71-9578-4a64-9b09-021821ca1e63","Type":"ContainerStarted","Data":"f781e5ddfe84944d6372bbee1b95f0272c6fb954b21528723d09f0f6397a18d5"} Jun 14 03:17:18.095026 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:18.094979 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jz99q" podStartSLOduration=17.560397515 podStartE2EDuration="23.094966276s" totalImagesPullingTime="5.534568761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:16:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:18.093737094 +0000 UTC m=+248.252880010" watchObservedRunningTime="2026-06-14 03:17:18.094966276 +0000 UTC m=+248.254109180" Jun 14 03:17:22.256404 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:22.256370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:17:22.256762 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:22.256428 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:17:22.258812 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:22.258789 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aef466d-2db1-4d24-9c58-bf3c6859587f-metrics-certs\") pod \"network-metrics-daemon-lwmb5\" (UID: \"6aef466d-2db1-4d24-9c58-bf3c6859587f\") " pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:17:22.258918 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:22.258879 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62edaa5-d92e-4400-b1bf-16fab4998321-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-hshdf\" (UID: \"e62edaa5-d92e-4400-b1bf-16fab4998321\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:17:22.270206 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:22.270185 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mr88x\"" Jun 14 03:17:22.278118 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:22.278100 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" Jun 14 03:17:22.296592 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:22.296572 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hmrz\"" Jun 14 03:17:22.304524 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:22.304504 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwmb5" Jun 14 03:17:22.415355 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:22.415326 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf"] Jun 14 03:17:22.417675 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:17:22.417640 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62edaa5_d92e_4400_b1bf_16fab4998321.slice/crio-f4314b733750f5929aa61a45f751a0bc8df146a4e151fbec88e2f564ce16bfd3 WatchSource:0}: Error finding container f4314b733750f5929aa61a45f751a0bc8df146a4e151fbec88e2f564ce16bfd3: Status 404 returned error can't find the container with id f4314b733750f5929aa61a45f751a0bc8df146a4e151fbec88e2f564ce16bfd3 Jun 14 03:17:22.435477 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:22.435455 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lwmb5"] Jun 14 03:17:22.438332 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:17:22.438304 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aef466d_2db1_4d24_9c58_bf3c6859587f.slice/crio-9a4103857d9dc8a86ff1c76c1c638d4f74906eabff1a700a0e62fde10e2c86a2 WatchSource:0}: Error finding container 9a4103857d9dc8a86ff1c76c1c638d4f74906eabff1a700a0e62fde10e2c86a2: Status 404 returned error can't find the container with id 9a4103857d9dc8a86ff1c76c1c638d4f74906eabff1a700a0e62fde10e2c86a2 Jun 14 03:17:23.093767 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:23.093686 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lwmb5" event={"ID":"6aef466d-2db1-4d24-9c58-bf3c6859587f","Type":"ContainerStarted","Data":"9a4103857d9dc8a86ff1c76c1c638d4f74906eabff1a700a0e62fde10e2c86a2"} Jun 14 03:17:23.095116 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:23.095072 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" event={"ID":"e62edaa5-d92e-4400-b1bf-16fab4998321","Type":"ContainerStarted","Data":"f4314b733750f5929aa61a45f751a0bc8df146a4e151fbec88e2f564ce16bfd3"} Jun 14 03:17:24.100148 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:24.100121 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lwmb5" event={"ID":"6aef466d-2db1-4d24-9c58-bf3c6859587f","Type":"ContainerStarted","Data":"cd99171cb62dc3bf698a5358f3551ffc3b185ef0bb585e3d0205ed9767d36b4b"} Jun 14 03:17:24.100565 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:24.100178 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lwmb5" event={"ID":"6aef466d-2db1-4d24-9c58-bf3c6859587f","Type":"ContainerStarted","Data":"393f7ba8b8db0a0f9bc8b2e4a2a4ee9c68be0278b33fba7fc0c63543f3d6a47e"} Jun 14 03:17:24.101763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:24.101731 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" event={"ID":"e62edaa5-d92e-4400-b1bf-16fab4998321","Type":"ContainerStarted","Data":"9704869f18f46399eff4cbb7c185946c3a2ad517e047a9469b8023fcb4ebe59a"} Jun 14 03:17:24.129971 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:24.129910 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-hshdf" podStartSLOduration=32.52677625 podStartE2EDuration="34.129895788s" totalImagesPullingTime="1.603119538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:24.129173526 +0000 UTC m=+254.288316635" watchObservedRunningTime="2026-06-14 03:17:24.129895788 +0000 UTC m=+254.289038730" Jun 14 03:17:24.130200 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:24.130178 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lwmb5" podStartSLOduration=253.125867624 podStartE2EDuration="4m14.130171549s" totalImagesPullingTime="1.004303925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:24.1147682 +0000 UTC m=+254.273911125" watchObservedRunningTime="2026-06-14 03:17:24.130171549 +0000 UTC m=+254.289314453" Jun 14 03:17:31.900288 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:31.900212 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ttr6d"] Jun 14 03:17:31.903819 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:31.903800 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:31.907363 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:31.907339 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wf949\"" Jun 14 03:17:31.907502 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:31.907485 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 03:17:31.907809 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:31.907791 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 03:17:31.908529 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:31.908510 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 03:17:31.908631 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:31.908510 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 03:17:32.027334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.027297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-tls\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.027494 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.027349 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e37088a-d74f-4509-b481-0aa915bc9145-sys\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.027494 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.027429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-textfile\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.027494 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.027462 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e37088a-d74f-4509-b481-0aa915bc9145-metrics-client-ca\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.027630 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.027501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-accelerators-collector-config\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.027630 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.027559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e37088a-d74f-4509-b481-0aa915bc9145-root\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.027630 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.027607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-wtmp\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.027769 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.027639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.027769 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.027671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnlht\" (UniqueName: \"kubernetes.io/projected/0e37088a-d74f-4509-b481-0aa915bc9145-kube-api-access-gnlht\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.128692 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.128654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.128859 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.128699 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnlht\" (UniqueName: \"kubernetes.io/projected/0e37088a-d74f-4509-b481-0aa915bc9145-kube-api-access-gnlht\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.128859 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.128804 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-tls\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.129013 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.128882 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e37088a-d74f-4509-b481-0aa915bc9145-sys\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.129097 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.129078 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e37088a-d74f-4509-b481-0aa915bc9145-sys\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.129222 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.129201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-textfile\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.129347 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.129327 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e37088a-d74f-4509-b481-0aa915bc9145-metrics-client-ca\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.129480 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.129371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-accelerators-collector-config\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.129545 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.129503 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e37088a-d74f-4509-b481-0aa915bc9145-root\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.129598 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.129567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-wtmp\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.129756 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.129740 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-wtmp\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.130300 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.130203 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e37088a-d74f-4509-b481-0aa915bc9145-metrics-client-ca\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.130300 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.130274 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e37088a-d74f-4509-b481-0aa915bc9145-root\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.130453 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.130309 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-accelerators-collector-config\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.130785 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.130764 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-textfile\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.131541 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.131520 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.131973 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.131953 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e37088a-d74f-4509-b481-0aa915bc9145-node-exporter-tls\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.137563 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.137525 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnlht\" (UniqueName: \"kubernetes.io/projected/0e37088a-d74f-4509-b481-0aa915bc9145-kube-api-access-gnlht\") pod \"node-exporter-ttr6d\" (UID: \"0e37088a-d74f-4509-b481-0aa915bc9145\") " pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.215382 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.215309 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ttr6d" Jun 14 03:17:32.227115 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:17:32.227084 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e37088a_d74f_4509_b481_0aa915bc9145.slice/crio-e94757170332f38a8102f4541bfc7812209ad9827c64439769eca3a621005dd6 WatchSource:0}: Error finding container e94757170332f38a8102f4541bfc7812209ad9827c64439769eca3a621005dd6: Status 404 returned error can't find the container with id e94757170332f38a8102f4541bfc7812209ad9827c64439769eca3a621005dd6 Jun 14 03:17:32.950100 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.950059 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 03:17:32.954183 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.954156 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:32.957141 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.956923 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 03:17:32.957141 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.956977 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 03:17:32.957141 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.956988 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tj674\"" Jun 14 03:17:32.957141 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.957006 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 03:17:32.957141 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.956976 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 03:17:32.957141 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.956923 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 03:17:32.957487 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.957266 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 03:17:32.957487 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.957293 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 03:17:32.957583 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.957491 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 03:17:32.957667 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.957647 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 03:17:32.968904 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:32.968881 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 03:17:33.038298 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.038215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w64l7\" (UniqueName: \"kubernetes.io/projected/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-kube-api-access-w64l7\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.038298 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.038273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.038298 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.038302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.038578 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.038335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.038578 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.038400 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.038578 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.038443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-config-out\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.038578 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.038473 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.038578 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.038539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.038819 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.038586 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.038819 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.038656 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-web-config\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.038819 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.038697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.038819 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.038720 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.038819 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.038748 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.130757 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.130719 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ttr6d" event={"ID":"0e37088a-d74f-4509-b481-0aa915bc9145","Type":"ContainerStarted","Data":"e94757170332f38a8102f4541bfc7812209ad9827c64439769eca3a621005dd6"} Jun 14 03:17:33.139536 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.139510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-config-out\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.139654 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.139551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.139654 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.139587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.139654 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.139616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.139814 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.139655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-web-config\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.139814 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.139681 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.139814 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.139706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.139814 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.139735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.139814 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.139773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w64l7\" (UniqueName: \"kubernetes.io/projected/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-kube-api-access-w64l7\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.139814 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.139810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.140126 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.139834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.140126 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.139870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.140126 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.139901 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.140126 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:17:33.140090 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-trusted-ca-bundle podName:5c3db3d4-a4d8-4046-9bea-7b3dc58d0175 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:33.640062767 +0000 UTC m=+263.799205666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175") : configmap references non-existent config key: ca-bundle.crt Jun 14 03:17:33.144027 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.141968 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.144027 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.142195 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.144027 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.142591 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-config-out\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.144027 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.143800 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.145282 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.144838 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.145282 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.145235 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-web-config\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.145615 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.145592 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.146171 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.146136 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.147081 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.147054 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.147755 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.147732 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.147855 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.147779 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.148975 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.148949 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w64l7\" (UniqueName: \"kubernetes.io/projected/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-kube-api-access-w64l7\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.643809 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.643771 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.644664 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.644643 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:33.872470 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:33.872430 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:17:34.011077 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:34.011045 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 03:17:34.015259 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:17:34.015228 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3db3d4_a4d8_4046_9bea_7b3dc58d0175.slice/crio-2297c92bbd93340fb4884ae711e4b3b44b590318db1fbf9d7c22031822699586 WatchSource:0}: Error finding container 2297c92bbd93340fb4884ae711e4b3b44b590318db1fbf9d7c22031822699586: Status 404 returned error can't find the container with id 2297c92bbd93340fb4884ae711e4b3b44b590318db1fbf9d7c22031822699586 Jun 14 03:17:34.135223 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:34.135194 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerStarted","Data":"2297c92bbd93340fb4884ae711e4b3b44b590318db1fbf9d7c22031822699586"} Jun 14 03:17:34.136713 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:34.136688 2581 generic.go:356] "Generic (PLEG): container finished" podID="0e37088a-d74f-4509-b481-0aa915bc9145" containerID="f5823b04ba478d7d90f7f4fc2a16ca6266859b3bdee92e6635c82c856b239c29" exitCode=0 Jun 14 03:17:34.136805 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:34.136738 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ttr6d" event={"ID":"0e37088a-d74f-4509-b481-0aa915bc9145","Type":"ContainerDied","Data":"f5823b04ba478d7d90f7f4fc2a16ca6266859b3bdee92e6635c82c856b239c29"} Jun 14 03:17:35.140911 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:35.140872 2581 generic.go:356] "Generic (PLEG): container finished" podID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerID="556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3" exitCode=0 Jun 14 03:17:35.141312 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:35.140957 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerDied","Data":"556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3"} Jun 14 03:17:35.143326 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:35.143300 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ttr6d" event={"ID":"0e37088a-d74f-4509-b481-0aa915bc9145","Type":"ContainerStarted","Data":"e18896ac072b5466a709938bd8bd95fd8d9dada308b54dd9760f2c2f0fd7bcb5"} Jun 14 03:17:35.143414 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:35.143346 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ttr6d" event={"ID":"0e37088a-d74f-4509-b481-0aa915bc9145","Type":"ContainerStarted","Data":"db143295bfc21ef81bb3fc0b4222814a294c7962cc7fc8d902e0d4ed0445cbc2"} Jun 14 03:17:35.180897 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:35.180825 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ttr6d" podStartSLOduration=3.232735545 podStartE2EDuration="4.180811567s" totalImagesPullingTime="876.503303ms" totalInitContainerRuntime="71.572719ms" isStatefulPod=true podCreationTimestamp="2026-06-14 03:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:35.179718709 +0000 UTC m=+265.338861611" watchObservedRunningTime="2026-06-14 03:17:35.180811567 +0000 UTC m=+265.339954471" Jun 14 03:17:36.663726 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:36.663702 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2"] Jun 14 03:17:36.665807 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:36.665753 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2" Jun 14 03:17:36.668412 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:36.668390 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 14 03:17:36.668412 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:36.668408 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-g7mhq\"" Jun 14 03:17:36.675831 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:36.675785 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2"] Jun 14 03:17:36.771334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:36.771301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2841f9a8-f60e-49b4-a365-4b341eeb072b-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-cdkf2\" (UID: \"2841f9a8-f60e-49b4-a365-4b341eeb072b\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2" Jun 14 03:17:36.771513 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:36.771370 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt9j2\" (UniqueName: \"kubernetes.io/projected/2841f9a8-f60e-49b4-a365-4b341eeb072b-kube-api-access-lt9j2\") pod \"monitoring-plugin-589576dfc7-cdkf2\" (UID: \"2841f9a8-f60e-49b4-a365-4b341eeb072b\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2" Jun 14 03:17:36.872713 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:36.872621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2841f9a8-f60e-49b4-a365-4b341eeb072b-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-cdkf2\" (UID: \"2841f9a8-f60e-49b4-a365-4b341eeb072b\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2" Jun 14 03:17:36.872713 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:36.872703 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt9j2\" (UniqueName: \"kubernetes.io/projected/2841f9a8-f60e-49b4-a365-4b341eeb072b-kube-api-access-lt9j2\") pod \"monitoring-plugin-589576dfc7-cdkf2\" (UID: \"2841f9a8-f60e-49b4-a365-4b341eeb072b\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2" Jun 14 03:17:36.872889 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:17:36.872797 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 14 03:17:36.872889 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:17:36.872868 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2841f9a8-f60e-49b4-a365-4b341eeb072b-monitoring-plugin-cert podName:2841f9a8-f60e-49b4-a365-4b341eeb072b nodeName:}" failed. No retries permitted until 2026-06-14 03:17:37.372848531 +0000 UTC m=+267.531991417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2841f9a8-f60e-49b4-a365-4b341eeb072b-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-cdkf2" (UID: "2841f9a8-f60e-49b4-a365-4b341eeb072b") : secret "monitoring-plugin-cert" not found Jun 14 03:17:36.881369 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:36.881343 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt9j2\" (UniqueName: \"kubernetes.io/projected/2841f9a8-f60e-49b4-a365-4b341eeb072b-kube-api-access-lt9j2\") pod \"monitoring-plugin-589576dfc7-cdkf2\" (UID: \"2841f9a8-f60e-49b4-a365-4b341eeb072b\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2" Jun 14 03:17:37.111807 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.111765 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-568677f997-9swjq"] Jun 14 03:17:37.114181 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.114163 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.116883 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.116858 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 14 03:17:37.117028 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.116977 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 14 03:17:37.117095 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.117041 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 14 03:17:37.117146 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.117108 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 14 03:17:37.117199 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.117146 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2vvdx\"" Jun 14 03:17:37.117494 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.117464 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 14 03:17:37.122177 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.122157 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 14 03:17:37.130257 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.130238 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-568677f997-9swjq"] Jun 14 03:17:37.155421 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.155385 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerStarted","Data":"ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808"} Jun 14 03:17:37.155518 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.155450 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerStarted","Data":"b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477"} Jun 14 03:17:37.155518 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.155479 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerStarted","Data":"dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f"} Jun 14 03:17:37.155518 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.155504 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerStarted","Data":"23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441"} Jun 14 03:17:37.155648 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.155526 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerStarted","Data":"88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658"} Jun 14 03:17:37.275519 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.275495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2ec6dec-7aa7-42dc-94b0-1c6798183753-telemeter-client-tls\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.275609 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.275529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2ec6dec-7aa7-42dc-94b0-1c6798183753-metrics-client-ca\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.275609 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.275549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db8g5\" (UniqueName: \"kubernetes.io/projected/a2ec6dec-7aa7-42dc-94b0-1c6798183753-kube-api-access-db8g5\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.275690 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.275646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2ec6dec-7aa7-42dc-94b0-1c6798183753-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.275690 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.275678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2ec6dec-7aa7-42dc-94b0-1c6798183753-federate-client-tls\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.275757 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.275697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ec6dec-7aa7-42dc-94b0-1c6798183753-telemeter-trusted-ca-bundle\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.275757 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.275748 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2ec6dec-7aa7-42dc-94b0-1c6798183753-secret-telemeter-client\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.275826 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.275789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ec6dec-7aa7-42dc-94b0-1c6798183753-serving-certs-ca-bundle\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.376765 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.376709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2ec6dec-7aa7-42dc-94b0-1c6798183753-telemeter-client-tls\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.376765 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.376742 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2ec6dec-7aa7-42dc-94b0-1c6798183753-metrics-client-ca\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.376765 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.376762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db8g5\" (UniqueName: \"kubernetes.io/projected/a2ec6dec-7aa7-42dc-94b0-1c6798183753-kube-api-access-db8g5\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.377018 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.376794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2841f9a8-f60e-49b4-a365-4b341eeb072b-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-cdkf2\" (UID: \"2841f9a8-f60e-49b4-a365-4b341eeb072b\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2" Jun 14 03:17:37.377018 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.376820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2ec6dec-7aa7-42dc-94b0-1c6798183753-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.377018 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.376850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2ec6dec-7aa7-42dc-94b0-1c6798183753-federate-client-tls\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.377018 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.376872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ec6dec-7aa7-42dc-94b0-1c6798183753-telemeter-trusted-ca-bundle\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.377018 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.376900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2ec6dec-7aa7-42dc-94b0-1c6798183753-secret-telemeter-client\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.377018 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.376979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ec6dec-7aa7-42dc-94b0-1c6798183753-serving-certs-ca-bundle\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.377636 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.377613 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2ec6dec-7aa7-42dc-94b0-1c6798183753-metrics-client-ca\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.377883 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.377827 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ec6dec-7aa7-42dc-94b0-1c6798183753-serving-certs-ca-bundle\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.378404 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.378377 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ec6dec-7aa7-42dc-94b0-1c6798183753-telemeter-trusted-ca-bundle\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.379514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.379489 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2ec6dec-7aa7-42dc-94b0-1c6798183753-telemeter-client-tls\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.379628 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.379602 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2ec6dec-7aa7-42dc-94b0-1c6798183753-federate-client-tls\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.380054 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.380025 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2841f9a8-f60e-49b4-a365-4b341eeb072b-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-cdkf2\" (UID: \"2841f9a8-f60e-49b4-a365-4b341eeb072b\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2" Jun 14 03:17:37.380144 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.380123 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2ec6dec-7aa7-42dc-94b0-1c6798183753-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.380887 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.380865 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2ec6dec-7aa7-42dc-94b0-1c6798183753-secret-telemeter-client\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.386219 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.386200 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db8g5\" (UniqueName: \"kubernetes.io/projected/a2ec6dec-7aa7-42dc-94b0-1c6798183753-kube-api-access-db8g5\") pod \"telemeter-client-568677f997-9swjq\" (UID: \"a2ec6dec-7aa7-42dc-94b0-1c6798183753\") " pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.426197 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.426174 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-568677f997-9swjq" Jun 14 03:17:37.572238 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.572209 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-568677f997-9swjq"] Jun 14 03:17:37.575257 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:17:37.575222 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ec6dec_7aa7_42dc_94b0_1c6798183753.slice/crio-8bd3c2182ea4a626817ca204f6880c8788997c784be31f9b153bb9d857d5e3e5 WatchSource:0}: Error finding container 8bd3c2182ea4a626817ca204f6880c8788997c784be31f9b153bb9d857d5e3e5: Status 404 returned error can't find the container with id 8bd3c2182ea4a626817ca204f6880c8788997c784be31f9b153bb9d857d5e3e5 Jun 14 03:17:37.576694 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.576678 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2" Jun 14 03:17:37.696043 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:37.696016 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2"] Jun 14 03:17:37.699199 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:17:37.699167 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2841f9a8_f60e_49b4_a365_4b341eeb072b.slice/crio-d704a59212e9051d7072d7f26cdef219689aadef0a752416073cfafdcdcc3ee1 WatchSource:0}: Error finding container d704a59212e9051d7072d7f26cdef219689aadef0a752416073cfafdcdcc3ee1: Status 404 returned error can't find the container with id d704a59212e9051d7072d7f26cdef219689aadef0a752416073cfafdcdcc3ee1 Jun 14 03:17:38.161701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:38.161668 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerStarted","Data":"a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a"} Jun 14 03:17:38.162814 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:38.162790 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2" event={"ID":"2841f9a8-f60e-49b4-a365-4b341eeb072b","Type":"ContainerStarted","Data":"d704a59212e9051d7072d7f26cdef219689aadef0a752416073cfafdcdcc3ee1"} Jun 14 03:17:38.163946 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:38.163903 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-568677f997-9swjq" event={"ID":"a2ec6dec-7aa7-42dc-94b0-1c6798183753","Type":"ContainerStarted","Data":"8bd3c2182ea4a626817ca204f6880c8788997c784be31f9b153bb9d857d5e3e5"} Jun 14 03:17:38.187385 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:38.187339 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.493296642 podStartE2EDuration="6.187325759s" totalImagesPullingTime="2.678517015s" totalInitContainerRuntime="15.512102ms" isStatefulPod=false podCreationTimestamp="2026-06-14 03:17:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:38.186038349 +0000 UTC m=+268.345181270" watchObservedRunningTime="2026-06-14 03:17:38.187325759 +0000 UTC m=+268.346468663" Jun 14 03:17:40.172617 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:40.172583 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2" event={"ID":"2841f9a8-f60e-49b4-a365-4b341eeb072b","Type":"ContainerStarted","Data":"f6abf01ee504ad8ff9ca7f44cce1243098055be880b7675394b65312e3822388"} Jun 14 03:17:40.173054 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:40.172676 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2" Jun 14 03:17:40.174986 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:40.174960 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-568677f997-9swjq" event={"ID":"a2ec6dec-7aa7-42dc-94b0-1c6798183753","Type":"ContainerStarted","Data":"66e448461a68e572deeeee0296ecdac286db5597cb5595ccdfa6145be7fcf569"} Jun 14 03:17:40.175100 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:40.175015 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-568677f997-9swjq" event={"ID":"a2ec6dec-7aa7-42dc-94b0-1c6798183753","Type":"ContainerStarted","Data":"4049b3eb8d5c77887106e86985afd080eb8dab93e1f61fa194275e8d280e2626"} Jun 14 03:17:40.175100 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:40.175034 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-568677f997-9swjq" event={"ID":"a2ec6dec-7aa7-42dc-94b0-1c6798183753","Type":"ContainerStarted","Data":"90c95b1c46e961cdb0a90df69f7f0dc96c585afe751f01e4b7ad9ddf6cdae75e"} Jun 14 03:17:40.177428 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:40.177409 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2" Jun 14 03:17:40.187594 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:40.187535 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cdkf2" podStartSLOduration=2.273069616 podStartE2EDuration="4.187522387s" totalImagesPullingTime="1.914452771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:40.186824348 +0000 UTC m=+270.345967246" watchObservedRunningTime="2026-06-14 03:17:40.187522387 +0000 UTC m=+270.346665290" Jun 14 03:17:40.205535 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:40.205502 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-568677f997-9swjq" podStartSLOduration=1.162918671 podStartE2EDuration="3.205488265s" totalImagesPullingTime="2.042569594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:40.204417958 +0000 UTC m=+270.363560862" watchObservedRunningTime="2026-06-14 03:17:40.205488265 +0000 UTC m=+270.364631172" Jun 14 03:17:50.818947 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:17:50.818892 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rggv2" podUID="f4fa9ace-4554-47df-9837-f3654d47b791" Jun 14 03:17:50.977960 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:50.977892 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" podUID="e4396321-4b63-4599-bb8e-47417ed92d74" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 03:17:51.215382 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:51.215354 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rggv2" Jun 14 03:17:54.615067 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:54.615032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:17:54.617376 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:54.617355 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fa9ace-4554-47df-9837-f3654d47b791-metrics-tls\") pod \"dns-default-rggv2\" (UID: \"f4fa9ace-4554-47df-9837-f3654d47b791\") " pod="openshift-dns/dns-default-rggv2" Jun 14 03:17:54.819216 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:54.819184 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ctq98\"" Jun 14 03:17:54.827235 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:54.827206 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rggv2" Jun 14 03:17:54.957030 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:54.957000 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rggv2"] Jun 14 03:17:54.959896 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:17:54.959871 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4fa9ace_4554_47df_9837_f3654d47b791.slice/crio-ac0273b2d662e521803009998e513602539912ac867adff28d55dbba5f4ab4be WatchSource:0}: Error finding container ac0273b2d662e521803009998e513602539912ac867adff28d55dbba5f4ab4be: Status 404 returned error can't find the container with id ac0273b2d662e521803009998e513602539912ac867adff28d55dbba5f4ab4be Jun 14 03:17:55.230030 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:55.229954 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rggv2" event={"ID":"f4fa9ace-4554-47df-9837-f3654d47b791","Type":"ContainerStarted","Data":"ac0273b2d662e521803009998e513602539912ac867adff28d55dbba5f4ab4be"} Jun 14 03:17:57.239188 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.239160 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rggv2" event={"ID":"f4fa9ace-4554-47df-9837-f3654d47b791","Type":"ContainerStarted","Data":"b01eb0005c8ac923d3b4068c325a543c184dd0559b9ac6f7332e055343ce12fb"} Jun 14 03:17:57.239556 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.239209 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rggv2" event={"ID":"f4fa9ace-4554-47df-9837-f3654d47b791","Type":"ContainerStarted","Data":"c9f3b8757d5c4bb3fbd15bb92cea9e7bbd749e5cd735dc49fc4f7ec1be7bce5f"} Jun 14 03:17:57.239556 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.239287 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rggv2" Jun 14 03:17:57.257495 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.257449 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rggv2" podStartSLOduration=251.501337894 podStartE2EDuration="4m13.257434877s" totalImagesPullingTime="1.756096983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:57.256300609 +0000 UTC m=+287.415443514" watchObservedRunningTime="2026-06-14 03:17:57.257434877 +0000 UTC m=+287.416577796" Jun 14 03:17:57.873948 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.873894 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-697cb7549f-84pdb"] Jun 14 03:17:57.875873 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.875856 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:57.878939 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.878907 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 03:17:57.879047 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.878908 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 03:17:57.879047 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.879021 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 03:17:57.879141 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.879054 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 03:17:57.880224 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.880205 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 03:17:57.880305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.880239 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 03:17:57.880305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.880247 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 03:17:57.880305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.880242 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8qxtj\"" Jun 14 03:17:57.886459 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.886439 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697cb7549f-84pdb"] Jun 14 03:17:57.937379 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.937346 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-config\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:57.937379 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.937384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-oauth-config\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:57.937588 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.937406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-serving-cert\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:57.937588 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.937420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-service-ca\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:57.937588 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.937481 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-oauth-serving-cert\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:57.937588 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:57.937512 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnfvq\" (UniqueName: \"kubernetes.io/projected/f833c1d7-b65b-45ec-a9e7-68d21a7045da-kube-api-access-qnfvq\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:58.038532 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:58.038499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-oauth-config\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:58.038722 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:58.038540 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-serving-cert\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:58.038722 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:58.038558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-service-ca\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:58.038722 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:58.038584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-oauth-serving-cert\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:58.038722 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:58.038611 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnfvq\" (UniqueName: \"kubernetes.io/projected/f833c1d7-b65b-45ec-a9e7-68d21a7045da-kube-api-access-qnfvq\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:58.038722 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:58.038645 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-config\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:58.039305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:58.039277 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-service-ca\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:58.039416 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:58.039344 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-config\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:58.039660 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:58.039641 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-oauth-serving-cert\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:58.041181 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:58.041161 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-serving-cert\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:58.041260 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:58.041214 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-oauth-config\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:58.047578 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:58.047552 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnfvq\" (UniqueName: \"kubernetes.io/projected/f833c1d7-b65b-45ec-a9e7-68d21a7045da-kube-api-access-qnfvq\") pod \"console-697cb7549f-84pdb\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:58.185182 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:58.185116 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:17:58.311907 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:58.311878 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697cb7549f-84pdb"] Jun 14 03:17:58.314207 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:17:58.314181 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf833c1d7_b65b_45ec_a9e7_68d21a7045da.slice/crio-ae2beb2c04c5a36f0ac27cd0b1230b633fef07ad175bcf75a49fd1790854785b WatchSource:0}: Error finding container ae2beb2c04c5a36f0ac27cd0b1230b633fef07ad175bcf75a49fd1790854785b: Status 404 returned error can't find the container with id ae2beb2c04c5a36f0ac27cd0b1230b633fef07ad175bcf75a49fd1790854785b Jun 14 03:17:59.249377 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:17:59.249344 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697cb7549f-84pdb" event={"ID":"f833c1d7-b65b-45ec-a9e7-68d21a7045da","Type":"ContainerStarted","Data":"ae2beb2c04c5a36f0ac27cd0b1230b633fef07ad175bcf75a49fd1790854785b"} Jun 14 03:18:00.977885 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:00.977830 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" podUID="e4396321-4b63-4599-bb8e-47417ed92d74" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 03:18:02.261716 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:02.261681 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697cb7549f-84pdb" event={"ID":"f833c1d7-b65b-45ec-a9e7-68d21a7045da","Type":"ContainerStarted","Data":"fac4371127dc9c731cfe6fe322b3f3d6aabd36e9e9c6dac96883923142bae8c3"} Jun 14 03:18:02.279872 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:02.279823 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-697cb7549f-84pdb" podStartSLOduration=2.298737766 podStartE2EDuration="5.279808059s" totalImagesPullingTime="2.981070293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:18:02.278754323 +0000 UTC m=+292.437897227" watchObservedRunningTime="2026-06-14 03:18:02.279808059 +0000 UTC m=+292.438950963" Jun 14 03:18:07.246063 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:07.246029 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rggv2" Jun 14 03:18:08.186197 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:08.186150 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:18:08.186353 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:08.186217 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:18:08.192591 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:08.192563 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:18:08.288360 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:08.288331 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:18:10.255716 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:10.255686 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:18:10.256196 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:10.256129 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:18:10.258751 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:10.258733 2581 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 03:18:10.977840 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:10.977802 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" podUID="e4396321-4b63-4599-bb8e-47417ed92d74" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 03:18:10.980111 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:10.977868 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" Jun 14 03:18:10.980111 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:10.978303 2581 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"f2414fb97ac1d5a6f30b0ed7ce8f799c596296bfaa56502d7a4bd76cee428130"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 14 03:18:10.980111 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:10.978350 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" podUID="e4396321-4b63-4599-bb8e-47417ed92d74" containerName="service-proxy" containerID="cri-o://f2414fb97ac1d5a6f30b0ed7ce8f799c596296bfaa56502d7a4bd76cee428130" gracePeriod=30 Jun 14 03:18:11.296883 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:11.296796 2581 generic.go:356] "Generic (PLEG): container finished" podID="e4396321-4b63-4599-bb8e-47417ed92d74" containerID="f2414fb97ac1d5a6f30b0ed7ce8f799c596296bfaa56502d7a4bd76cee428130" exitCode=2 Jun 14 03:18:11.296883 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:11.296854 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" event={"ID":"e4396321-4b63-4599-bb8e-47417ed92d74","Type":"ContainerDied","Data":"f2414fb97ac1d5a6f30b0ed7ce8f799c596296bfaa56502d7a4bd76cee428130"} Jun 14 03:18:11.297274 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:11.296889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d48dd77f5-5d8nl" event={"ID":"e4396321-4b63-4599-bb8e-47417ed92d74","Type":"ContainerStarted","Data":"bb515e55de6ada36cf43e9f1e79e9f55412de6c765ffa40483cbae2482025743"} Jun 14 03:18:17.495321 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:17.495289 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-697cb7549f-84pdb"] Jun 14 03:18:42.519780 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.519735 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-697cb7549f-84pdb" podUID="f833c1d7-b65b-45ec-a9e7-68d21a7045da" containerName="console" containerID="cri-o://fac4371127dc9c731cfe6fe322b3f3d6aabd36e9e9c6dac96883923142bae8c3" gracePeriod=15 Jun 14 03:18:42.754016 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.753992 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:18:42.836971 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.836883 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-service-ca\") pod \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " Jun 14 03:18:42.836971 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.836956 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-oauth-config\") pod \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " Jun 14 03:18:42.837183 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.836986 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-config\") pod \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " Jun 14 03:18:42.837183 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.837022 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-serving-cert\") pod \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " Jun 14 03:18:42.837183 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.837062 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnfvq\" (UniqueName: \"kubernetes.io/projected/f833c1d7-b65b-45ec-a9e7-68d21a7045da-kube-api-access-qnfvq\") pod \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " Jun 14 03:18:42.837183 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.837106 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-oauth-serving-cert\") pod \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\" (UID: \"f833c1d7-b65b-45ec-a9e7-68d21a7045da\") " Jun 14 03:18:42.837379 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.837364 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-service-ca" (OuterVolumeSpecName: "service-ca") pod "f833c1d7-b65b-45ec-a9e7-68d21a7045da" (UID: "f833c1d7-b65b-45ec-a9e7-68d21a7045da"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:18:42.837504 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.837464 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-config" (OuterVolumeSpecName: "console-config") pod "f833c1d7-b65b-45ec-a9e7-68d21a7045da" (UID: "f833c1d7-b65b-45ec-a9e7-68d21a7045da"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:18:42.837586 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.837561 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f833c1d7-b65b-45ec-a9e7-68d21a7045da" (UID: "f833c1d7-b65b-45ec-a9e7-68d21a7045da"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:18:42.839429 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.839403 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f833c1d7-b65b-45ec-a9e7-68d21a7045da" (UID: "f833c1d7-b65b-45ec-a9e7-68d21a7045da"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:18:42.839666 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.839646 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f833c1d7-b65b-45ec-a9e7-68d21a7045da" (UID: "f833c1d7-b65b-45ec-a9e7-68d21a7045da"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:18:42.839738 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.839674 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f833c1d7-b65b-45ec-a9e7-68d21a7045da-kube-api-access-qnfvq" (OuterVolumeSpecName: "kube-api-access-qnfvq") pod "f833c1d7-b65b-45ec-a9e7-68d21a7045da" (UID: "f833c1d7-b65b-45ec-a9e7-68d21a7045da"). InnerVolumeSpecName "kube-api-access-qnfvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:18:42.937822 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.937780 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-service-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:42.937822 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.937816 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-oauth-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:42.937822 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.937826 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:42.937822 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.937835 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f833c1d7-b65b-45ec-a9e7-68d21a7045da-console-serving-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:42.938087 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.937844 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnfvq\" (UniqueName: \"kubernetes.io/projected/f833c1d7-b65b-45ec-a9e7-68d21a7045da-kube-api-access-qnfvq\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:42.938087 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:42.937853 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f833c1d7-b65b-45ec-a9e7-68d21a7045da-oauth-serving-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:43.410567 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:43.410529 2581 generic.go:356] "Generic (PLEG): container finished" podID="f833c1d7-b65b-45ec-a9e7-68d21a7045da" containerID="fac4371127dc9c731cfe6fe322b3f3d6aabd36e9e9c6dac96883923142bae8c3" exitCode=0 Jun 14 03:18:43.410567 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:43.410568 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697cb7549f-84pdb" Jun 14 03:18:43.410817 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:43.410584 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697cb7549f-84pdb" event={"ID":"f833c1d7-b65b-45ec-a9e7-68d21a7045da","Type":"ContainerDied","Data":"fac4371127dc9c731cfe6fe322b3f3d6aabd36e9e9c6dac96883923142bae8c3"} Jun 14 03:18:43.410817 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:43.410630 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697cb7549f-84pdb" event={"ID":"f833c1d7-b65b-45ec-a9e7-68d21a7045da","Type":"ContainerDied","Data":"ae2beb2c04c5a36f0ac27cd0b1230b633fef07ad175bcf75a49fd1790854785b"} Jun 14 03:18:43.410817 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:43.410664 2581 scope.go:117] "RemoveContainer" containerID="fac4371127dc9c731cfe6fe322b3f3d6aabd36e9e9c6dac96883923142bae8c3" Jun 14 03:18:43.421287 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:43.421262 2581 scope.go:117] "RemoveContainer" containerID="fac4371127dc9c731cfe6fe322b3f3d6aabd36e9e9c6dac96883923142bae8c3" Jun 14 03:18:43.421870 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:18:43.421845 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fac4371127dc9c731cfe6fe322b3f3d6aabd36e9e9c6dac96883923142bae8c3\": container with ID starting with fac4371127dc9c731cfe6fe322b3f3d6aabd36e9e9c6dac96883923142bae8c3 not found: ID does not exist" containerID="fac4371127dc9c731cfe6fe322b3f3d6aabd36e9e9c6dac96883923142bae8c3" Jun 14 03:18:43.421991 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:43.421875 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fac4371127dc9c731cfe6fe322b3f3d6aabd36e9e9c6dac96883923142bae8c3"} err="failed to get container status \"fac4371127dc9c731cfe6fe322b3f3d6aabd36e9e9c6dac96883923142bae8c3\": rpc error: code = NotFound desc = could not find container \"fac4371127dc9c731cfe6fe322b3f3d6aabd36e9e9c6dac96883923142bae8c3\": container with ID starting with fac4371127dc9c731cfe6fe322b3f3d6aabd36e9e9c6dac96883923142bae8c3 not found: ID does not exist" Jun 14 03:18:43.433190 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:43.433168 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-697cb7549f-84pdb"] Jun 14 03:18:43.436625 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:43.436598 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-697cb7549f-84pdb"] Jun 14 03:18:44.298703 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:44.298671 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f833c1d7-b65b-45ec-a9e7-68d21a7045da" path="/var/lib/kubelet/pods/f833c1d7-b65b-45ec-a9e7-68d21a7045da/volumes" Jun 14 03:18:48.529658 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.529632 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bbff4d758-jhkdr"] Jun 14 03:18:48.529970 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.529865 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f833c1d7-b65b-45ec-a9e7-68d21a7045da" containerName="console" Jun 14 03:18:48.529970 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.529876 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f833c1d7-b65b-45ec-a9e7-68d21a7045da" containerName="console" Jun 14 03:18:48.529970 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.529958 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f833c1d7-b65b-45ec-a9e7-68d21a7045da" containerName="console" Jun 14 03:18:48.532518 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.532503 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.534757 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.534735 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 03:18:48.534893 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.534757 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 03:18:48.534893 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.534866 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 03:18:48.535860 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.535844 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 03:18:48.535961 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.535908 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 03:18:48.536017 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.535993 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 03:18:48.536075 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.536027 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 03:18:48.536135 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.536078 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8qxtj\"" Jun 14 03:18:48.540706 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.540688 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 03:18:48.543645 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.543619 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bbff4d758-jhkdr"] Jun 14 03:18:48.574722 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.574703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-serving-cert\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.574826 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.574729 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-oauth-config\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.574826 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.574758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-service-ca\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.574826 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.574806 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-config\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.574945 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.574833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-oauth-serving-cert\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.574945 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.574852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdn2c\" (UniqueName: \"kubernetes.io/projected/6fe6f7d7-0636-4d5d-a337-c923720f81c6-kube-api-access-rdn2c\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.574945 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.574908 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-trusted-ca-bundle\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.675913 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.675885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-serving-cert\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.676050 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.675918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-oauth-config\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.676050 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.675988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-service-ca\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.676050 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.676014 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-config\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.676202 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.676146 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-oauth-serving-cert\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.676202 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.676175 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdn2c\" (UniqueName: \"kubernetes.io/projected/6fe6f7d7-0636-4d5d-a337-c923720f81c6-kube-api-access-rdn2c\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.676311 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.676224 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-trusted-ca-bundle\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.676736 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.676711 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-config\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.676860 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.676840 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-oauth-serving-cert\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.677002 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.676980 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-service-ca\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.677094 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.677079 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-trusted-ca-bundle\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.678502 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.678477 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-serving-cert\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.678581 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.678566 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-oauth-config\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.683777 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.683761 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdn2c\" (UniqueName: \"kubernetes.io/projected/6fe6f7d7-0636-4d5d-a337-c923720f81c6-kube-api-access-rdn2c\") pod \"console-bbff4d758-jhkdr\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.842114 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.842040 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:48.967102 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:48.967074 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bbff4d758-jhkdr"] Jun 14 03:18:48.970037 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:18:48.969976 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe6f7d7_0636_4d5d_a337_c923720f81c6.slice/crio-8190c69e8f29dce397b64905383a545001a218ed4873e1082b9f645489c7119e WatchSource:0}: Error finding container 8190c69e8f29dce397b64905383a545001a218ed4873e1082b9f645489c7119e: Status 404 returned error can't find the container with id 8190c69e8f29dce397b64905383a545001a218ed4873e1082b9f645489c7119e Jun 14 03:18:49.432763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:49.432725 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbff4d758-jhkdr" event={"ID":"6fe6f7d7-0636-4d5d-a337-c923720f81c6","Type":"ContainerStarted","Data":"eb5185ded5fb9db1ad82ff94344cfa6cf23f5abba18df6642dfbdb0ebe67486a"} Jun 14 03:18:49.432962 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:49.432783 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbff4d758-jhkdr" event={"ID":"6fe6f7d7-0636-4d5d-a337-c923720f81c6","Type":"ContainerStarted","Data":"8190c69e8f29dce397b64905383a545001a218ed4873e1082b9f645489c7119e"} Jun 14 03:18:49.452333 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:49.452282 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bbff4d758-jhkdr" podStartSLOduration=1.452264309 podStartE2EDuration="1.452264309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:18:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:18:49.451343551 +0000 UTC m=+339.610486460" watchObservedRunningTime="2026-06-14 03:18:49.452264309 +0000 UTC m=+339.611407213" Jun 14 03:18:52.171984 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.171948 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 03:18:52.172385 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.172240 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="alertmanager" containerID="cri-o://88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658" gracePeriod=120 Jun 14 03:18:52.172385 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.172284 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="kube-rbac-proxy-metric" containerID="cri-o://ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808" gracePeriod=120 Jun 14 03:18:52.172385 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.172309 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="kube-rbac-proxy-web" containerID="cri-o://dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f" gracePeriod=120 Jun 14 03:18:52.172385 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.172339 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="config-reloader" containerID="cri-o://23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441" gracePeriod=120 Jun 14 03:18:52.172385 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.172362 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="kube-rbac-proxy" containerID="cri-o://b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477" gracePeriod=120 Jun 14 03:18:52.172385 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.172387 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="prom-label-proxy" containerID="cri-o://a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a" gracePeriod=120 Jun 14 03:18:52.446495 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.446429 2581 generic.go:356] "Generic (PLEG): container finished" podID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerID="a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a" exitCode=0 Jun 14 03:18:52.446495 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.446457 2581 generic.go:356] "Generic (PLEG): container finished" podID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerID="b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477" exitCode=0 Jun 14 03:18:52.446495 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.446464 2581 generic.go:356] "Generic (PLEG): container finished" podID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerID="23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441" exitCode=0 Jun 14 03:18:52.446495 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.446470 2581 generic.go:356] "Generic (PLEG): container finished" podID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerID="88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658" exitCode=0 Jun 14 03:18:52.446691 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.446493 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerDied","Data":"a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a"} Jun 14 03:18:52.446691 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.446560 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerDied","Data":"b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477"} Jun 14 03:18:52.446691 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.446588 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerDied","Data":"23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441"} Jun 14 03:18:52.446691 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:52.446611 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerDied","Data":"88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658"} Jun 14 03:18:53.414375 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.414353 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.453982 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.453947 2581 generic.go:356] "Generic (PLEG): container finished" podID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerID="ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808" exitCode=0 Jun 14 03:18:53.453982 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.453978 2581 generic.go:356] "Generic (PLEG): container finished" podID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerID="dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f" exitCode=0 Jun 14 03:18:53.454173 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.454036 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.454173 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.454029 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerDied","Data":"ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808"} Jun 14 03:18:53.454273 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.454173 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerDied","Data":"dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f"} Jun 14 03:18:53.454273 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.454204 2581 scope.go:117] "RemoveContainer" containerID="a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a" Jun 14 03:18:53.454273 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.454213 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175","Type":"ContainerDied","Data":"2297c92bbd93340fb4884ae711e4b3b44b590318db1fbf9d7c22031822699586"} Jun 14 03:18:53.468540 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.468507 2581 scope.go:117] "RemoveContainer" containerID="ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808" Jun 14 03:18:53.475807 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.475783 2581 scope.go:117] "RemoveContainer" containerID="b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477" Jun 14 03:18:53.482558 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.482541 2581 scope.go:117] "RemoveContainer" containerID="dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f" Jun 14 03:18:53.489803 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.489784 2581 scope.go:117] "RemoveContainer" containerID="23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441" Jun 14 03:18:53.496745 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.496726 2581 scope.go:117] "RemoveContainer" containerID="88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658" Jun 14 03:18:53.503630 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.503614 2581 scope.go:117] "RemoveContainer" containerID="556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3" Jun 14 03:18:53.508617 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.508599 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w64l7\" (UniqueName: \"kubernetes.io/projected/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-kube-api-access-w64l7\") pod \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " Jun 14 03:18:53.508712 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.508633 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy\") pod \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " Jun 14 03:18:53.508712 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.508660 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-config-out\") pod \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " Jun 14 03:18:53.508821 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.508800 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-config-volume\") pod \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " Jun 14 03:18:53.508922 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.508901 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-web-config\") pod \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " Jun 14 03:18:53.509052 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.508983 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-main-tls\") pod \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " Jun 14 03:18:53.509052 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.509014 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-main-db\") pod \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " Jun 14 03:18:53.509161 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.509058 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-tls-assets\") pod \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " Jun 14 03:18:53.509161 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.509102 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-trusted-ca-bundle\") pod \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " Jun 14 03:18:53.509161 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.509133 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-cluster-tls-config\") pod \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " Jun 14 03:18:53.509445 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.509161 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-metrics-client-ca\") pod \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " Jun 14 03:18:53.509445 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.509188 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy-web\") pod \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " Jun 14 03:18:53.509445 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.509253 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\" (UID: \"5c3db3d4-a4d8-4046-9bea-7b3dc58d0175\") " Jun 14 03:18:53.509623 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.509569 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" (UID: "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:18:53.509995 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.509914 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" (UID: "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:18:53.510297 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.510256 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" (UID: "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:18:53.511602 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.511573 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" (UID: "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:18:53.511849 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.511828 2581 scope.go:117] "RemoveContainer" containerID="a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a" Jun 14 03:18:53.512194 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:18:53.512167 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a\": container with ID starting with a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a not found: ID does not exist" containerID="a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a" Jun 14 03:18:53.512282 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.512206 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a"} err="failed to get container status \"a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a\": rpc error: code = NotFound desc = could not find container \"a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a\": container with ID starting with a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a not found: ID does not exist" Jun 14 03:18:53.512282 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.512234 2581 scope.go:117] "RemoveContainer" containerID="ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808" Jun 14 03:18:53.512409 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.512284 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-kube-api-access-w64l7" (OuterVolumeSpecName: "kube-api-access-w64l7") pod "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" (UID: "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175"). InnerVolumeSpecName "kube-api-access-w64l7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:18:53.512709 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.512685 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-config-out" (OuterVolumeSpecName: "config-out") pod "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" (UID: "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:18:53.512786 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:18:53.512697 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808\": container with ID starting with ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808 not found: ID does not exist" containerID="ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808" Jun 14 03:18:53.512786 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.512732 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808"} err="failed to get container status \"ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808\": rpc error: code = NotFound desc = could not find container \"ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808\": container with ID starting with ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808 not found: ID does not exist" Jun 14 03:18:53.512786 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.512755 2581 scope.go:117] "RemoveContainer" containerID="b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477" Jun 14 03:18:53.513072 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:18:53.513043 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477\": container with ID starting with b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477 not found: ID does not exist" containerID="b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477" Jun 14 03:18:53.513186 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.513095 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477"} err="failed to get container status \"b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477\": rpc error: code = NotFound desc = could not find container \"b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477\": container with ID starting with b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477 not found: ID does not exist" Jun 14 03:18:53.513186 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.513116 2581 scope.go:117] "RemoveContainer" containerID="dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f" Jun 14 03:18:53.513306 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.513270 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" (UID: "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:18:53.513434 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.513385 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" (UID: "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:18:53.513434 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:18:53.513398 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f\": container with ID starting with dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f not found: ID does not exist" containerID="dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f" Jun 14 03:18:53.513582 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.513429 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f"} err="failed to get container status \"dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f\": rpc error: code = NotFound desc = could not find container \"dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f\": container with ID starting with dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f not found: ID does not exist" Jun 14 03:18:53.513582 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.513451 2581 scope.go:117] "RemoveContainer" containerID="23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441" Jun 14 03:18:53.513690 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.513590 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-config-volume" (OuterVolumeSpecName: "config-volume") pod "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" (UID: "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:18:53.513775 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:18:53.513748 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441\": container with ID starting with 23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441 not found: ID does not exist" containerID="23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441" Jun 14 03:18:53.513831 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.513780 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441"} err="failed to get container status \"23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441\": rpc error: code = NotFound desc = could not find container \"23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441\": container with ID starting with 23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441 not found: ID does not exist" Jun 14 03:18:53.513831 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.513802 2581 scope.go:117] "RemoveContainer" containerID="88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658" Jun 14 03:18:53.514098 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.514072 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" (UID: "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:18:53.514194 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:18:53.514170 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658\": container with ID starting with 88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658 not found: ID does not exist" containerID="88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658" Jun 14 03:18:53.514260 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.514203 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658"} err="failed to get container status \"88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658\": rpc error: code = NotFound desc = could not find container \"88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658\": container with ID starting with 88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658 not found: ID does not exist" Jun 14 03:18:53.514260 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.514224 2581 scope.go:117] "RemoveContainer" containerID="556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3" Jun 14 03:18:53.514260 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.514248 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" (UID: "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:18:53.514506 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:18:53.514477 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3\": container with ID starting with 556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3 not found: ID does not exist" containerID="556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3" Jun 14 03:18:53.514563 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.514511 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3"} err="failed to get container status \"556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3\": rpc error: code = NotFound desc = could not find container \"556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3\": container with ID starting with 556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3 not found: ID does not exist" Jun 14 03:18:53.514563 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.514525 2581 scope.go:117] "RemoveContainer" containerID="a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a" Jun 14 03:18:53.514748 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.514726 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a"} err="failed to get container status \"a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a\": rpc error: code = NotFound desc = could not find container \"a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a\": container with ID starting with a0c8a0511231a17fb87e5384e0c1f8bfdfba38c1f5dabde3ab660c5c7361409a not found: ID does not exist" Jun 14 03:18:53.514808 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.514749 2581 scope.go:117] "RemoveContainer" containerID="ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808" Jun 14 03:18:53.515017 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.514997 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808"} err="failed to get container status \"ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808\": rpc error: code = NotFound desc = could not find container \"ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808\": container with ID starting with ce30e5e5b8bdf3ddabfb434c9518d58988cf2ba9cecef5497a4be2b5168f0808 not found: ID does not exist" Jun 14 03:18:53.515082 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.515019 2581 scope.go:117] "RemoveContainer" containerID="b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477" Jun 14 03:18:53.515267 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.515250 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477"} err="failed to get container status \"b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477\": rpc error: code = NotFound desc = could not find container \"b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477\": container with ID starting with b868aaf36eb20b45162456bd6ff28983bb014be2537bd3ba60e3b09b0ab14477 not found: ID does not exist" Jun 14 03:18:53.515329 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.515268 2581 scope.go:117] "RemoveContainer" containerID="dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f" Jun 14 03:18:53.515526 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.515507 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f"} err="failed to get container status \"dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f\": rpc error: code = NotFound desc = could not find container \"dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f\": container with ID starting with dc3d1a0e89d4557ee2d11d1eb3d2fa5037d5e5fe8a34fd853615141530fab90f not found: ID does not exist" Jun 14 03:18:53.515642 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.515527 2581 scope.go:117] "RemoveContainer" containerID="23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441" Jun 14 03:18:53.515766 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.515748 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441"} err="failed to get container status \"23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441\": rpc error: code = NotFound desc = could not find container \"23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441\": container with ID starting with 23466e90a3ccd27963c9fd6b9ef859d99f1840df6f170d5c28fc8a5d980a5441 not found: ID does not exist" Jun 14 03:18:53.515827 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.515766 2581 scope.go:117] "RemoveContainer" containerID="88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658" Jun 14 03:18:53.516012 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.515993 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658"} err="failed to get container status \"88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658\": rpc error: code = NotFound desc = could not find container \"88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658\": container with ID starting with 88d7566acb759c5ff55b369372efaaa36a2b231b83e79c8cc8f5b94b4f7c2658 not found: ID does not exist" Jun 14 03:18:53.516012 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.516011 2581 scope.go:117] "RemoveContainer" containerID="556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3" Jun 14 03:18:53.516272 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.516253 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3"} err="failed to get container status \"556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3\": rpc error: code = NotFound desc = could not find container \"556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3\": container with ID starting with 556532d5395139d64174946af9fcf959c32ff781dcbab3cc861498f03896c9d3 not found: ID does not exist" Jun 14 03:18:53.518314 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.518292 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" (UID: "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:18:53.524440 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.524417 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-web-config" (OuterVolumeSpecName: "web-config") pod "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" (UID: "5c3db3d4-a4d8-4046-9bea-7b3dc58d0175"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:18:53.610193 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.610169 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:53.610193 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.610191 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w64l7\" (UniqueName: \"kubernetes.io/projected/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-kube-api-access-w64l7\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:53.610305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.610202 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:53.610305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.610212 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-config-out\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:53.610305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.610220 2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-config-volume\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:53.610305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.610227 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-web-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:53.610305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.610235 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-main-tls\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:53.610305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.610243 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-main-db\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:53.610305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.610251 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-tls-assets\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:53.610305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.610259 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:53.610305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.610267 2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-cluster-tls-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:53.610305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.610275 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-metrics-client-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:53.610305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.610283 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:18:53.776070 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.776044 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 03:18:53.780521 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.780499 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 03:18:53.803992 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.803970 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 03:18:53.804237 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804224 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="kube-rbac-proxy-metric" Jun 14 03:18:53.804285 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804240 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="kube-rbac-proxy-metric" Jun 14 03:18:53.804285 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804252 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="prom-label-proxy" Jun 14 03:18:53.804285 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804257 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="prom-label-proxy" Jun 14 03:18:53.804285 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804266 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="alertmanager" Jun 14 03:18:53.804285 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804272 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="alertmanager" Jun 14 03:18:53.804285 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804278 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="config-reloader" Jun 14 03:18:53.804285 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804283 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="config-reloader" Jun 14 03:18:53.804285 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804287 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="kube-rbac-proxy" Jun 14 03:18:53.804531 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804293 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="kube-rbac-proxy" Jun 14 03:18:53.804531 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804299 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="kube-rbac-proxy-web" Jun 14 03:18:53.804531 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804305 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="kube-rbac-proxy-web" Jun 14 03:18:53.804531 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804312 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="init-config-reloader" Jun 14 03:18:53.804531 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804317 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="init-config-reloader" Jun 14 03:18:53.804531 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804356 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="config-reloader" Jun 14 03:18:53.804531 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804364 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="prom-label-proxy" Jun 14 03:18:53.804531 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804370 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="kube-rbac-proxy-metric" Jun 14 03:18:53.804531 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804376 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="kube-rbac-proxy" Jun 14 03:18:53.804531 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804382 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="alertmanager" Jun 14 03:18:53.804531 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.804387 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" containerName="kube-rbac-proxy-web" Jun 14 03:18:53.809048 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.809034 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.811404 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.811383 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 03:18:53.811540 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.811497 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 03:18:53.811540 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.811519 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 03:18:53.811679 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.811547 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 03:18:53.811679 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.811582 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 03:18:53.811679 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.811519 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 03:18:53.811798 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.811684 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tj674\"" Jun 14 03:18:53.811845 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.811797 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 03:18:53.811996 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.811983 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 03:18:53.816422 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.816403 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 03:18:53.821297 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.821277 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 03:18:53.912245 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.912216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.912245 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.912244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgvqg\" (UniqueName: \"kubernetes.io/projected/e809a410-a9c0-45be-b061-8d39d670ae4f-kube-api-access-tgvqg\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.912398 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.912276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e809a410-a9c0-45be-b061-8d39d670ae4f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.912398 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.912333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.912398 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.912372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.912490 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.912417 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.912490 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.912434 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-web-config\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.912490 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.912470 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e809a410-a9c0-45be-b061-8d39d670ae4f-config-out\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.912569 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.912490 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e809a410-a9c0-45be-b061-8d39d670ae4f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.912569 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.912511 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e809a410-a9c0-45be-b061-8d39d670ae4f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.912569 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.912552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e809a410-a9c0-45be-b061-8d39d670ae4f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.912652 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.912573 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:53.912652 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:53.912599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-config-volume\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.013391 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.013335 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.013391 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.013366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-config-volume\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.013391 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.013383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.013580 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.013397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgvqg\" (UniqueName: \"kubernetes.io/projected/e809a410-a9c0-45be-b061-8d39d670ae4f-kube-api-access-tgvqg\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.013580 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.013432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e809a410-a9c0-45be-b061-8d39d670ae4f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.013678 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.013606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.013678 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.013646 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.013779 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.013714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.013779 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.013741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-web-config\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.013779 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.013770 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e809a410-a9c0-45be-b061-8d39d670ae4f-config-out\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.013917 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.013796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e809a410-a9c0-45be-b061-8d39d670ae4f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.013917 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.013822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e809a410-a9c0-45be-b061-8d39d670ae4f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.013917 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.013853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e809a410-a9c0-45be-b061-8d39d670ae4f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.014377 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.014319 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e809a410-a9c0-45be-b061-8d39d670ae4f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.014871 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.014844 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e809a410-a9c0-45be-b061-8d39d670ae4f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.015780 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.015737 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e809a410-a9c0-45be-b061-8d39d670ae4f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.016719 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.016679 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.016809 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.016729 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e809a410-a9c0-45be-b061-8d39d670ae4f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.016809 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.016773 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.016910 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.016856 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.017062 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.017041 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e809a410-a9c0-45be-b061-8d39d670ae4f-config-out\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.017112 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.017100 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.017491 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.017476 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-config-volume\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.018207 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.018188 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-web-config\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.018717 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.018698 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e809a410-a9c0-45be-b061-8d39d670ae4f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.021277 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.021254 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgvqg\" (UniqueName: \"kubernetes.io/projected/e809a410-a9c0-45be-b061-8d39d670ae4f-kube-api-access-tgvqg\") pod \"alertmanager-main-0\" (UID: \"e809a410-a9c0-45be-b061-8d39d670ae4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.118013 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.117991 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 03:18:54.256258 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.256227 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 03:18:54.261370 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:18:54.259279 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode809a410_a9c0_45be_b061_8d39d670ae4f.slice/crio-1b897d15d2c55d0c164c603288dd450234aae536927e27e1d180679f0199d19f WatchSource:0}: Error finding container 1b897d15d2c55d0c164c603288dd450234aae536927e27e1d180679f0199d19f: Status 404 returned error can't find the container with id 1b897d15d2c55d0c164c603288dd450234aae536927e27e1d180679f0199d19f Jun 14 03:18:54.310390 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.310355 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c3db3d4-a4d8-4046-9bea-7b3dc58d0175" path="/var/lib/kubelet/pods/5c3db3d4-a4d8-4046-9bea-7b3dc58d0175/volumes" Jun 14 03:18:54.459557 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.459525 2581 generic.go:356] "Generic (PLEG): container finished" podID="e809a410-a9c0-45be-b061-8d39d670ae4f" containerID="be7b7c8641b9f0e02558312d23216c6f9cab7cee46dd9eb75ccd4dd2929ec4c7" exitCode=0 Jun 14 03:18:54.459963 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.459614 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e809a410-a9c0-45be-b061-8d39d670ae4f","Type":"ContainerDied","Data":"be7b7c8641b9f0e02558312d23216c6f9cab7cee46dd9eb75ccd4dd2929ec4c7"} Jun 14 03:18:54.459963 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:54.459675 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e809a410-a9c0-45be-b061-8d39d670ae4f","Type":"ContainerStarted","Data":"1b897d15d2c55d0c164c603288dd450234aae536927e27e1d180679f0199d19f"} Jun 14 03:18:55.467787 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:55.467749 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e809a410-a9c0-45be-b061-8d39d670ae4f","Type":"ContainerStarted","Data":"b31542dc7690a26395879c1e2c888625644c21137c63e718aa44ee198c3187a2"} Jun 14 03:18:55.468172 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:55.467864 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e809a410-a9c0-45be-b061-8d39d670ae4f","Type":"ContainerStarted","Data":"7a2c6e5ad1ddb721ea56c5a39020e49f350ad7da94425ac4045dc740c1736aea"} Jun 14 03:18:55.468172 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:55.467906 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e809a410-a9c0-45be-b061-8d39d670ae4f","Type":"ContainerStarted","Data":"94e1916e160e515ad17cf26b199e755940ef9a6d88af0f04b9de3f55d73ec9ed"} Jun 14 03:18:55.468172 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:55.467972 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e809a410-a9c0-45be-b061-8d39d670ae4f","Type":"ContainerStarted","Data":"0098c730485b8004cd7239b05fc9b61bdd100f7e233bf162e3a3a268465894e1"} Jun 14 03:18:55.468172 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:55.468037 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e809a410-a9c0-45be-b061-8d39d670ae4f","Type":"ContainerStarted","Data":"07ce319f2efbba70a6954f18f37711b8be5683e249fbef2b28e07da2b71482b9"} Jun 14 03:18:55.468172 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:55.468076 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e809a410-a9c0-45be-b061-8d39d670ae4f","Type":"ContainerStarted","Data":"3d99597b1d0274d6dfad9c25fc37f6164cde340f5053a360f4b0f7dd836a28ee"} Jun 14 03:18:55.495083 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:55.494993 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.478792195 podStartE2EDuration="2.49497841s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.186215ms" isStatefulPod=false podCreationTimestamp="2026-06-14 03:18:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:18:55.492333207 +0000 UTC m=+345.651476128" watchObservedRunningTime="2026-06-14 03:18:55.49497841 +0000 UTC m=+345.654121314" Jun 14 03:18:58.843210 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:58.843171 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:58.843659 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:58.843275 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:58.847902 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:58.847877 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:18:59.486897 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:18:59.486861 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:20:30.096204 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.096119 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-p7tg6"] Jun 14 03:20:30.099100 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.099084 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-p7tg6" Jun 14 03:20:30.101540 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.101520 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 14 03:20:30.102447 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.102432 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 14 03:20:30.102517 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.102434 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-b2bkn\"" Jun 14 03:20:30.106414 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.106392 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-p7tg6"] Jun 14 03:20:30.207283 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.207242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d73c824d-11aa-4b46-b260-9dd34a8b8467-bound-sa-token\") pod \"cert-manager-59c77684cc-p7tg6\" (UID: \"d73c824d-11aa-4b46-b260-9dd34a8b8467\") " pod="cert-manager/cert-manager-59c77684cc-p7tg6" Jun 14 03:20:30.207440 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.207316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjgkj\" (UniqueName: \"kubernetes.io/projected/d73c824d-11aa-4b46-b260-9dd34a8b8467-kube-api-access-bjgkj\") pod \"cert-manager-59c77684cc-p7tg6\" (UID: \"d73c824d-11aa-4b46-b260-9dd34a8b8467\") " pod="cert-manager/cert-manager-59c77684cc-p7tg6" Jun 14 03:20:30.308615 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.308584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjgkj\" (UniqueName: \"kubernetes.io/projected/d73c824d-11aa-4b46-b260-9dd34a8b8467-kube-api-access-bjgkj\") pod \"cert-manager-59c77684cc-p7tg6\" (UID: \"d73c824d-11aa-4b46-b260-9dd34a8b8467\") " pod="cert-manager/cert-manager-59c77684cc-p7tg6" Jun 14 03:20:30.308764 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.308628 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d73c824d-11aa-4b46-b260-9dd34a8b8467-bound-sa-token\") pod \"cert-manager-59c77684cc-p7tg6\" (UID: \"d73c824d-11aa-4b46-b260-9dd34a8b8467\") " pod="cert-manager/cert-manager-59c77684cc-p7tg6" Jun 14 03:20:30.316995 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.316968 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d73c824d-11aa-4b46-b260-9dd34a8b8467-bound-sa-token\") pod \"cert-manager-59c77684cc-p7tg6\" (UID: \"d73c824d-11aa-4b46-b260-9dd34a8b8467\") " pod="cert-manager/cert-manager-59c77684cc-p7tg6" Jun 14 03:20:30.317103 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.317035 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjgkj\" (UniqueName: \"kubernetes.io/projected/d73c824d-11aa-4b46-b260-9dd34a8b8467-kube-api-access-bjgkj\") pod \"cert-manager-59c77684cc-p7tg6\" (UID: \"d73c824d-11aa-4b46-b260-9dd34a8b8467\") " pod="cert-manager/cert-manager-59c77684cc-p7tg6" Jun 14 03:20:30.408565 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.408539 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-p7tg6" Jun 14 03:20:30.531195 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.531130 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-p7tg6"] Jun 14 03:20:30.533941 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:20:30.533900 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd73c824d_11aa_4b46_b260_9dd34a8b8467.slice/crio-0cab632b07a8f2bb3490e6eecdb25c2edf022502060b35e242616f716dcc095c WatchSource:0}: Error finding container 0cab632b07a8f2bb3490e6eecdb25c2edf022502060b35e242616f716dcc095c: Status 404 returned error can't find the container with id 0cab632b07a8f2bb3490e6eecdb25c2edf022502060b35e242616f716dcc095c Jun 14 03:20:30.536050 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.536033 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 03:20:30.802583 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:30.802499 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-p7tg6" event={"ID":"d73c824d-11aa-4b46-b260-9dd34a8b8467","Type":"ContainerStarted","Data":"0cab632b07a8f2bb3490e6eecdb25c2edf022502060b35e242616f716dcc095c"} Jun 14 03:20:33.816667 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:33.816632 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-p7tg6" event={"ID":"d73c824d-11aa-4b46-b260-9dd34a8b8467","Type":"ContainerStarted","Data":"eef5bae8f5784a7b4984930f82e3efaf26bc15d47a76d2cfc44a87797cab7c76"} Jun 14 03:20:33.841589 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:33.841537 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-p7tg6" podStartSLOduration=1.193453636 podStartE2EDuration="3.841521404s" totalImagesPullingTime="2.648067768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:20:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:20:33.840444027 +0000 UTC m=+443.999586932" watchObservedRunningTime="2026-06-14 03:20:33.841521404 +0000 UTC m=+444.000664308" Jun 14 03:20:52.750251 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.750213 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f"] Jun 14 03:20:52.754731 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.754707 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:52.758431 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.758398 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 03:20:52.758560 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.758542 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 14 03:20:52.758621 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.758607 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-drth5\"" Jun 14 03:20:52.758683 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.758663 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 03:20:52.758727 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.758663 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 14 03:20:52.758727 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.758710 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 14 03:20:52.766766 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.766744 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f"] Jun 14 03:20:52.880791 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.880763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmp6d\" (UniqueName: \"kubernetes.io/projected/9177afb9-c7dc-4760-9154-8dc6456d2d47-kube-api-access-jmp6d\") pod \"lws-controller-manager-7bfc4d86bf-r676f\" (UID: \"9177afb9-c7dc-4760-9154-8dc6456d2d47\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:52.880948 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.880814 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9177afb9-c7dc-4760-9154-8dc6456d2d47-metrics-cert\") pod \"lws-controller-manager-7bfc4d86bf-r676f\" (UID: \"9177afb9-c7dc-4760-9154-8dc6456d2d47\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:52.880948 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.880871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9177afb9-c7dc-4760-9154-8dc6456d2d47-manager-config\") pod \"lws-controller-manager-7bfc4d86bf-r676f\" (UID: \"9177afb9-c7dc-4760-9154-8dc6456d2d47\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:52.880948 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.880900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9177afb9-c7dc-4760-9154-8dc6456d2d47-cert\") pod \"lws-controller-manager-7bfc4d86bf-r676f\" (UID: \"9177afb9-c7dc-4760-9154-8dc6456d2d47\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:52.981905 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.981875 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9177afb9-c7dc-4760-9154-8dc6456d2d47-cert\") pod \"lws-controller-manager-7bfc4d86bf-r676f\" (UID: \"9177afb9-c7dc-4760-9154-8dc6456d2d47\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:52.982067 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.981916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmp6d\" (UniqueName: \"kubernetes.io/projected/9177afb9-c7dc-4760-9154-8dc6456d2d47-kube-api-access-jmp6d\") pod \"lws-controller-manager-7bfc4d86bf-r676f\" (UID: \"9177afb9-c7dc-4760-9154-8dc6456d2d47\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:52.982067 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.981970 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9177afb9-c7dc-4760-9154-8dc6456d2d47-metrics-cert\") pod \"lws-controller-manager-7bfc4d86bf-r676f\" (UID: \"9177afb9-c7dc-4760-9154-8dc6456d2d47\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:52.982067 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.981994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9177afb9-c7dc-4760-9154-8dc6456d2d47-manager-config\") pod \"lws-controller-manager-7bfc4d86bf-r676f\" (UID: \"9177afb9-c7dc-4760-9154-8dc6456d2d47\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:52.982754 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.982656 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9177afb9-c7dc-4760-9154-8dc6456d2d47-manager-config\") pod \"lws-controller-manager-7bfc4d86bf-r676f\" (UID: \"9177afb9-c7dc-4760-9154-8dc6456d2d47\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:52.984559 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.984529 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9177afb9-c7dc-4760-9154-8dc6456d2d47-cert\") pod \"lws-controller-manager-7bfc4d86bf-r676f\" (UID: \"9177afb9-c7dc-4760-9154-8dc6456d2d47\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:52.984559 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.984532 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9177afb9-c7dc-4760-9154-8dc6456d2d47-metrics-cert\") pod \"lws-controller-manager-7bfc4d86bf-r676f\" (UID: \"9177afb9-c7dc-4760-9154-8dc6456d2d47\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:52.990576 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:52.990555 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmp6d\" (UniqueName: \"kubernetes.io/projected/9177afb9-c7dc-4760-9154-8dc6456d2d47-kube-api-access-jmp6d\") pod \"lws-controller-manager-7bfc4d86bf-r676f\" (UID: \"9177afb9-c7dc-4760-9154-8dc6456d2d47\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:53.064244 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:53.064176 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:53.209221 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:53.209197 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f"] Jun 14 03:20:53.211401 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:20:53.211373 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9177afb9_c7dc_4760_9154_8dc6456d2d47.slice/crio-d8a1703bf6304d42154f5b253977248467fe88ef4bee0789f175faff18ff9c94 WatchSource:0}: Error finding container d8a1703bf6304d42154f5b253977248467fe88ef4bee0789f175faff18ff9c94: Status 404 returned error can't find the container with id d8a1703bf6304d42154f5b253977248467fe88ef4bee0789f175faff18ff9c94 Jun 14 03:20:53.890753 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:53.890718 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" event={"ID":"9177afb9-c7dc-4760-9154-8dc6456d2d47","Type":"ContainerStarted","Data":"d8a1703bf6304d42154f5b253977248467fe88ef4bee0789f175faff18ff9c94"} Jun 14 03:20:54.978432 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:54.978385 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw"] Jun 14 03:20:54.984743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:54.984715 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:54.988251 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:54.988044 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 03:20:54.988251 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:54.988064 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 03:20:54.988251 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:54.988083 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 03:20:54.988251 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:54.988237 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jbsvm\"" Jun 14 03:20:54.988544 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:54.988498 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 03:20:55.004068 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.004043 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw"] Jun 14 03:20:55.101204 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.101167 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c86a5358-899b-4970-9035-f16b1258280e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.101382 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.101217 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp7x7\" (UniqueName: \"kubernetes.io/projected/c86a5358-899b-4970-9035-f16b1258280e-kube-api-access-qp7x7\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.101382 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.101295 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c86a5358-899b-4970-9035-f16b1258280e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.101382 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.101355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c86a5358-899b-4970-9035-f16b1258280e-tmp\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.101559 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.101415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c86a5358-899b-4970-9035-f16b1258280e-manifests\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.202079 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.202040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c86a5358-899b-4970-9035-f16b1258280e-tmp\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.202079 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.202083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c86a5358-899b-4970-9035-f16b1258280e-manifests\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.202315 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.202120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c86a5358-899b-4970-9035-f16b1258280e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.202315 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.202151 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp7x7\" (UniqueName: \"kubernetes.io/projected/c86a5358-899b-4970-9035-f16b1258280e-kube-api-access-qp7x7\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.202315 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.202222 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c86a5358-899b-4970-9035-f16b1258280e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.202518 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.202494 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c86a5358-899b-4970-9035-f16b1258280e-manifests\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.205010 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.204978 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c86a5358-899b-4970-9035-f16b1258280e-tmp\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.205152 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.205132 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c86a5358-899b-4970-9035-f16b1258280e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.205218 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.205199 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c86a5358-899b-4970-9035-f16b1258280e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.211222 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.211198 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp7x7\" (UniqueName: \"kubernetes.io/projected/c86a5358-899b-4970-9035-f16b1258280e-kube-api-access-qp7x7\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-svqzw\" (UID: \"c86a5358-899b-4970-9035-f16b1258280e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.298014 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.297921 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:20:55.851535 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.851227 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw"] Jun 14 03:20:55.901408 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.901374 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" event={"ID":"9177afb9-c7dc-4760-9154-8dc6456d2d47","Type":"ContainerStarted","Data":"8e347a0e553a2077b6d52fcae847dc493be9311e69e2f661eba6caabcc39616e"} Jun 14 03:20:55.901554 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.901440 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:20:55.902547 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.902524 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" event={"ID":"c86a5358-899b-4970-9035-f16b1258280e","Type":"ContainerStarted","Data":"c34d9845f8e6d5ac6693d1f4d99781c00f87012934764462f648e4e136cf906d"} Jun 14 03:20:55.918514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:55.918463 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" podStartSLOduration=1.3563574680000001 podStartE2EDuration="3.918445504s" totalImagesPullingTime="2.562088036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:20:55.918305488 +0000 UTC m=+466.077448393" watchObservedRunningTime="2026-06-14 03:20:55.918445504 +0000 UTC m=+466.077588409" Jun 14 03:20:58.917449 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:58.917410 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" event={"ID":"c86a5358-899b-4970-9035-f16b1258280e","Type":"ContainerStarted","Data":"ec404ca84d60466eac6a323d5debc541ede88f4894d171e926c4b5b311593079"} Jun 14 03:20:59.923151 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:59.923122 2581 generic.go:356] "Generic (PLEG): container finished" podID="c86a5358-899b-4970-9035-f16b1258280e" containerID="ec404ca84d60466eac6a323d5debc541ede88f4894d171e926c4b5b311593079" exitCode=0 Jun 14 03:20:59.923529 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:20:59.923171 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" event={"ID":"c86a5358-899b-4970-9035-f16b1258280e","Type":"ContainerDied","Data":"ec404ca84d60466eac6a323d5debc541ede88f4894d171e926c4b5b311593079"} Jun 14 03:21:00.929110 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:00.929079 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" event={"ID":"c86a5358-899b-4970-9035-f16b1258280e","Type":"ContainerStarted","Data":"0cbec888b3850a5303459b5ac81da357799e7c73bdd0f7c8f1c1bd335141bc10"} Jun 14 03:21:00.929521 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:00.929230 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:21:00.951424 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:00.951378 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" podStartSLOduration=3.00224243 podStartE2EDuration="6.951362639s" totalImagesPullingTime="2.993762608s" totalInitContainerRuntime="955.357601ms" isStatefulPod=false podCreationTimestamp="2026-06-14 03:20:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:21:00.948836504 +0000 UTC m=+471.107979418" watchObservedRunningTime="2026-06-14 03:21:00.951362639 +0000 UTC m=+471.110505543" Jun 14 03:21:06.908200 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:06.908169 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-r676f" Jun 14 03:21:11.934988 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:11.934958 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-svqzw" Jun 14 03:21:48.267333 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.267302 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc"] Jun 14 03:21:48.275723 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.275701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.278166 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.278141 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-92d4w\"" Jun 14 03:21:48.278284 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.278186 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 03:21:48.278284 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.278209 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 03:21:48.278284 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.278141 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 03:21:48.281025 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.281004 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc"] Jun 14 03:21:48.438696 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.438661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb40c3e7-5b08-4277-ac47-3f471eba334c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.438696 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.438702 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.438888 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.438736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.438888 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.438829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.438888 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.438857 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8tn4\" (UniqueName: \"kubernetes.io/projected/fb40c3e7-5b08-4277-ac47-3f471eba334c-kube-api-access-d8tn4\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.439025 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.438888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.439025 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.438913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb40c3e7-5b08-4277-ac47-3f471eba334c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.439025 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.438969 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.439025 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.438993 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb40c3e7-5b08-4277-ac47-3f471eba334c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.539749 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.539717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.539870 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.539753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8tn4\" (UniqueName: \"kubernetes.io/projected/fb40c3e7-5b08-4277-ac47-3f471eba334c-kube-api-access-d8tn4\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.539870 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.539775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.540019 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.539902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb40c3e7-5b08-4277-ac47-3f471eba334c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.540019 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.539978 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.540019 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.540010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb40c3e7-5b08-4277-ac47-3f471eba334c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.540176 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.540050 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb40c3e7-5b08-4277-ac47-3f471eba334c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.540176 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.540092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.540176 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.540162 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.540326 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.540263 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.540443 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.540423 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.540540 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.540519 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.540604 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.540577 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.540852 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.540830 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb40c3e7-5b08-4277-ac47-3f471eba334c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.542260 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.542241 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb40c3e7-5b08-4277-ac47-3f471eba334c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.542584 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.542566 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb40c3e7-5b08-4277-ac47-3f471eba334c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.548484 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.548458 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8tn4\" (UniqueName: \"kubernetes.io/projected/fb40c3e7-5b08-4277-ac47-3f471eba334c-kube-api-access-d8tn4\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.549100 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.549075 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb40c3e7-5b08-4277-ac47-3f471eba334c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sd8pc\" (UID: \"fb40c3e7-5b08-4277-ac47-3f471eba334c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.587147 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.587128 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:48.721778 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.721753 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6d54cc8554-zx4vm"] Jun 14 03:21:48.726714 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.726231 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc"] Jun 14 03:21:48.726714 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.726346 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d54cc8554-zx4vm" Jun 14 03:21:48.726714 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:21:48.726580 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb40c3e7_5b08_4277_ac47_3f471eba334c.slice/crio-457bf972cd1fc544be3be2b3d0ea1b3f58f25dcee228f4cdff083adb06337ca9 WatchSource:0}: Error finding container 457bf972cd1fc544be3be2b3d0ea1b3f58f25dcee228f4cdff083adb06337ca9: Status 404 returned error can't find the container with id 457bf972cd1fc544be3be2b3d0ea1b3f58f25dcee228f4cdff083adb06337ca9 Jun 14 03:21:48.728867 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.728844 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4kshk\"" Jun 14 03:21:48.728867 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.728857 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 03:21:48.736505 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.736484 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d54cc8554-zx4vm"] Jun 14 03:21:48.842682 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.842585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6ec91a46-5222-4fdf-8608-7bb43486bcb4-redirect-config\") pod \"dashboard-redirect-6d54cc8554-zx4vm\" (UID: \"6ec91a46-5222-4fdf-8608-7bb43486bcb4\") " pod="opendatahub/dashboard-redirect-6d54cc8554-zx4vm" Jun 14 03:21:48.842820 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.842713 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgkrj\" (UniqueName: \"kubernetes.io/projected/6ec91a46-5222-4fdf-8608-7bb43486bcb4-kube-api-access-xgkrj\") pod \"dashboard-redirect-6d54cc8554-zx4vm\" (UID: \"6ec91a46-5222-4fdf-8608-7bb43486bcb4\") " pod="opendatahub/dashboard-redirect-6d54cc8554-zx4vm" Jun 14 03:21:48.943920 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.943886 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6ec91a46-5222-4fdf-8608-7bb43486bcb4-redirect-config\") pod \"dashboard-redirect-6d54cc8554-zx4vm\" (UID: \"6ec91a46-5222-4fdf-8608-7bb43486bcb4\") " pod="opendatahub/dashboard-redirect-6d54cc8554-zx4vm" Jun 14 03:21:48.944068 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.943985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgkrj\" (UniqueName: \"kubernetes.io/projected/6ec91a46-5222-4fdf-8608-7bb43486bcb4-kube-api-access-xgkrj\") pod \"dashboard-redirect-6d54cc8554-zx4vm\" (UID: \"6ec91a46-5222-4fdf-8608-7bb43486bcb4\") " pod="opendatahub/dashboard-redirect-6d54cc8554-zx4vm" Jun 14 03:21:48.944571 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.944551 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6ec91a46-5222-4fdf-8608-7bb43486bcb4-redirect-config\") pod \"dashboard-redirect-6d54cc8554-zx4vm\" (UID: \"6ec91a46-5222-4fdf-8608-7bb43486bcb4\") " pod="opendatahub/dashboard-redirect-6d54cc8554-zx4vm" Jun 14 03:21:48.952249 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:48.952221 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgkrj\" (UniqueName: \"kubernetes.io/projected/6ec91a46-5222-4fdf-8608-7bb43486bcb4-kube-api-access-xgkrj\") pod \"dashboard-redirect-6d54cc8554-zx4vm\" (UID: \"6ec91a46-5222-4fdf-8608-7bb43486bcb4\") " pod="opendatahub/dashboard-redirect-6d54cc8554-zx4vm" Jun 14 03:21:49.049079 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:49.049057 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d54cc8554-zx4vm" Jun 14 03:21:49.134857 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:49.134827 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" event={"ID":"fb40c3e7-5b08-4277-ac47-3f471eba334c","Type":"ContainerStarted","Data":"457bf972cd1fc544be3be2b3d0ea1b3f58f25dcee228f4cdff083adb06337ca9"} Jun 14 03:21:49.176465 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:49.176399 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d54cc8554-zx4vm"] Jun 14 03:21:49.178440 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:21:49.178415 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec91a46_5222_4fdf_8608_7bb43486bcb4.slice/crio-d07970576e0714eb1e1673828d69d35f2969ea727b3abd32657296dd8ddb80a8 WatchSource:0}: Error finding container d07970576e0714eb1e1673828d69d35f2969ea727b3abd32657296dd8ddb80a8: Status 404 returned error can't find the container with id d07970576e0714eb1e1673828d69d35f2969ea727b3abd32657296dd8ddb80a8 Jun 14 03:21:50.147476 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:50.147394 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d54cc8554-zx4vm" event={"ID":"6ec91a46-5222-4fdf-8608-7bb43486bcb4","Type":"ContainerStarted","Data":"d07970576e0714eb1e1673828d69d35f2969ea727b3abd32657296dd8ddb80a8"} Jun 14 03:21:52.169912 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:52.169865 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:21:52.170196 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:52.169987 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:21:52.170196 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:52.170035 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:21:53.162002 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:53.161961 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" event={"ID":"fb40c3e7-5b08-4277-ac47-3f471eba334c","Type":"ContainerStarted","Data":"0d96a733ad16d53fc49fad42a15f104bef439f428bdef37f3b2abafe60fb8a56"} Jun 14 03:21:53.163368 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:53.163343 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d54cc8554-zx4vm" event={"ID":"6ec91a46-5222-4fdf-8608-7bb43486bcb4","Type":"ContainerStarted","Data":"c963706ff44d886db6de5de7e89932df725b3268c91a136a9c199b0abc4aefb6"} Jun 14 03:21:53.181827 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:53.181780 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" podStartSLOduration=1.742043939 podStartE2EDuration="5.181767559s" totalImagesPullingTime="3.43972362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:21:53.180108441 +0000 UTC m=+523.339251324" watchObservedRunningTime="2026-06-14 03:21:53.181767559 +0000 UTC m=+523.340910462" Jun 14 03:21:53.195143 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:53.195099 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6d54cc8554-zx4vm" podStartSLOduration=2.211736096 podStartE2EDuration="5.195085647s" totalImagesPullingTime="2.983349551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:21:53.193418446 +0000 UTC m=+523.352561351" watchObservedRunningTime="2026-06-14 03:21:53.195085647 +0000 UTC m=+523.354228550" Jun 14 03:21:53.587842 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:53.587758 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:53.592085 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:53.592062 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:54.168003 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:54.167965 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:21:54.168958 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:21:54.168917 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sd8pc" Jun 14 03:22:15.706937 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:15.706884 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8mt9m"] Jun 14 03:22:15.716659 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:15.716629 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8mt9m" Jun 14 03:22:15.719180 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:15.719158 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 03:22:15.720226 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:15.720198 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dfhnd\"" Jun 14 03:22:15.720334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:15.720239 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 03:22:15.722995 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:15.722973 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8mt9m"] Jun 14 03:22:15.757358 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:15.757334 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qxbp\" (UniqueName: \"kubernetes.io/projected/8fc01da8-ec0c-447d-be46-05b36f6eb44f-kube-api-access-6qxbp\") pod \"kuadrant-operator-catalog-8mt9m\" (UID: \"8fc01da8-ec0c-447d-be46-05b36f6eb44f\") " pod="kuadrant-system/kuadrant-operator-catalog-8mt9m" Jun 14 03:22:15.858633 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:15.858596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qxbp\" (UniqueName: \"kubernetes.io/projected/8fc01da8-ec0c-447d-be46-05b36f6eb44f-kube-api-access-6qxbp\") pod \"kuadrant-operator-catalog-8mt9m\" (UID: \"8fc01da8-ec0c-447d-be46-05b36f6eb44f\") " pod="kuadrant-system/kuadrant-operator-catalog-8mt9m" Jun 14 03:22:15.866563 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:15.866535 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qxbp\" (UniqueName: \"kubernetes.io/projected/8fc01da8-ec0c-447d-be46-05b36f6eb44f-kube-api-access-6qxbp\") pod \"kuadrant-operator-catalog-8mt9m\" (UID: \"8fc01da8-ec0c-447d-be46-05b36f6eb44f\") " pod="kuadrant-system/kuadrant-operator-catalog-8mt9m" Jun 14 03:22:16.027729 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:16.027648 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8mt9m" Jun 14 03:22:16.075999 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:16.075965 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8mt9m"] Jun 14 03:22:16.168907 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:16.168883 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8mt9m"] Jun 14 03:22:16.171455 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:22:16.171420 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc01da8_ec0c_447d_be46_05b36f6eb44f.slice/crio-7ebf3b100f02376bdc5363a52eeb083f92bebeb29ab9a1521867598c4731d37e WatchSource:0}: Error finding container 7ebf3b100f02376bdc5363a52eeb083f92bebeb29ab9a1521867598c4731d37e: Status 404 returned error can't find the container with id 7ebf3b100f02376bdc5363a52eeb083f92bebeb29ab9a1521867598c4731d37e Jun 14 03:22:16.258896 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:16.258869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8mt9m" event={"ID":"8fc01da8-ec0c-447d-be46-05b36f6eb44f","Type":"ContainerStarted","Data":"7ebf3b100f02376bdc5363a52eeb083f92bebeb29ab9a1521867598c4731d37e"} Jun 14 03:22:16.299481 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:16.299429 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6bbjg"] Jun 14 03:22:16.302259 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:16.302242 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6bbjg" Jun 14 03:22:16.310546 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:16.310521 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6bbjg"] Jun 14 03:22:16.363216 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:16.363196 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgnr8\" (UniqueName: \"kubernetes.io/projected/81ee4d61-d499-436e-b8b7-2cc5662e461f-kube-api-access-kgnr8\") pod \"kuadrant-operator-catalog-6bbjg\" (UID: \"81ee4d61-d499-436e-b8b7-2cc5662e461f\") " pod="kuadrant-system/kuadrant-operator-catalog-6bbjg" Jun 14 03:22:16.463956 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:16.463913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgnr8\" (UniqueName: \"kubernetes.io/projected/81ee4d61-d499-436e-b8b7-2cc5662e461f-kube-api-access-kgnr8\") pod \"kuadrant-operator-catalog-6bbjg\" (UID: \"81ee4d61-d499-436e-b8b7-2cc5662e461f\") " pod="kuadrant-system/kuadrant-operator-catalog-6bbjg" Jun 14 03:22:16.473254 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:16.473232 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgnr8\" (UniqueName: \"kubernetes.io/projected/81ee4d61-d499-436e-b8b7-2cc5662e461f-kube-api-access-kgnr8\") pod \"kuadrant-operator-catalog-6bbjg\" (UID: \"81ee4d61-d499-436e-b8b7-2cc5662e461f\") " pod="kuadrant-system/kuadrant-operator-catalog-6bbjg" Jun 14 03:22:16.612822 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:16.612766 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6bbjg" Jun 14 03:22:16.753690 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:16.753663 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6bbjg"] Jun 14 03:22:16.792405 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:22:16.792373 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81ee4d61_d499_436e_b8b7_2cc5662e461f.slice/crio-9ff2edc7a3c90f3372f6a2772ef96d3e68880a7c98fd39e44b03de9835e46a0d WatchSource:0}: Error finding container 9ff2edc7a3c90f3372f6a2772ef96d3e68880a7c98fd39e44b03de9835e46a0d: Status 404 returned error can't find the container with id 9ff2edc7a3c90f3372f6a2772ef96d3e68880a7c98fd39e44b03de9835e46a0d Jun 14 03:22:17.265427 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:17.265391 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6bbjg" event={"ID":"81ee4d61-d499-436e-b8b7-2cc5662e461f","Type":"ContainerStarted","Data":"9ff2edc7a3c90f3372f6a2772ef96d3e68880a7c98fd39e44b03de9835e46a0d"} Jun 14 03:22:19.276259 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:19.276213 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6bbjg" event={"ID":"81ee4d61-d499-436e-b8b7-2cc5662e461f","Type":"ContainerStarted","Data":"fe9d4191a058dd91643064131bda25f819b8714ac4c641eb7af13c9b27a4fe16"} Jun 14 03:22:19.277637 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:19.277615 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8mt9m" event={"ID":"8fc01da8-ec0c-447d-be46-05b36f6eb44f","Type":"ContainerStarted","Data":"1e668313f342b031ca72bda6e5325061ffaecc2548703c5436990eaca571917a"} Jun 14 03:22:19.277733 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:19.277689 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8mt9m" podUID="8fc01da8-ec0c-447d-be46-05b36f6eb44f" containerName="registry-server" containerID="cri-o://1e668313f342b031ca72bda6e5325061ffaecc2548703c5436990eaca571917a" gracePeriod=2 Jun 14 03:22:19.292379 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:19.292340 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6bbjg" podStartSLOduration=1.828860491 podStartE2EDuration="3.292302761s" totalImagesPullingTime="1.46344227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:22:19.291260388 +0000 UTC m=+549.450403291" watchObservedRunningTime="2026-06-14 03:22:19.292302761 +0000 UTC m=+549.451445665" Jun 14 03:22:19.306387 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:19.306345 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8mt9m" podStartSLOduration=2.224874886 podStartE2EDuration="4.306331347s" totalImagesPullingTime="2.081456461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:22:19.305495078 +0000 UTC m=+549.464638002" watchObservedRunningTime="2026-06-14 03:22:19.306331347 +0000 UTC m=+549.465474252" Jun 14 03:22:19.511533 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:19.511513 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8mt9m" Jun 14 03:22:19.592910 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:19.592850 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qxbp\" (UniqueName: \"kubernetes.io/projected/8fc01da8-ec0c-447d-be46-05b36f6eb44f-kube-api-access-6qxbp\") pod \"8fc01da8-ec0c-447d-be46-05b36f6eb44f\" (UID: \"8fc01da8-ec0c-447d-be46-05b36f6eb44f\") " Jun 14 03:22:19.595134 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:19.595112 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fc01da8-ec0c-447d-be46-05b36f6eb44f-kube-api-access-6qxbp" (OuterVolumeSpecName: "kube-api-access-6qxbp") pod "8fc01da8-ec0c-447d-be46-05b36f6eb44f" (UID: "8fc01da8-ec0c-447d-be46-05b36f6eb44f"). InnerVolumeSpecName "kube-api-access-6qxbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:22:19.694212 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:19.694181 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qxbp\" (UniqueName: \"kubernetes.io/projected/8fc01da8-ec0c-447d-be46-05b36f6eb44f-kube-api-access-6qxbp\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:22:20.282827 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:20.282790 2581 generic.go:356] "Generic (PLEG): container finished" podID="8fc01da8-ec0c-447d-be46-05b36f6eb44f" containerID="1e668313f342b031ca72bda6e5325061ffaecc2548703c5436990eaca571917a" exitCode=0 Jun 14 03:22:20.283244 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:20.282838 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8mt9m" Jun 14 03:22:20.283244 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:20.282873 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8mt9m" event={"ID":"8fc01da8-ec0c-447d-be46-05b36f6eb44f","Type":"ContainerDied","Data":"1e668313f342b031ca72bda6e5325061ffaecc2548703c5436990eaca571917a"} Jun 14 03:22:20.283244 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:20.282947 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8mt9m" event={"ID":"8fc01da8-ec0c-447d-be46-05b36f6eb44f","Type":"ContainerDied","Data":"7ebf3b100f02376bdc5363a52eeb083f92bebeb29ab9a1521867598c4731d37e"} Jun 14 03:22:20.283244 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:20.282970 2581 scope.go:117] "RemoveContainer" containerID="1e668313f342b031ca72bda6e5325061ffaecc2548703c5436990eaca571917a" Jun 14 03:22:20.291424 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:20.291409 2581 scope.go:117] "RemoveContainer" containerID="1e668313f342b031ca72bda6e5325061ffaecc2548703c5436990eaca571917a" Jun 14 03:22:20.291676 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:22:20.291660 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e668313f342b031ca72bda6e5325061ffaecc2548703c5436990eaca571917a\": container with ID starting with 1e668313f342b031ca72bda6e5325061ffaecc2548703c5436990eaca571917a not found: ID does not exist" containerID="1e668313f342b031ca72bda6e5325061ffaecc2548703c5436990eaca571917a" Jun 14 03:22:20.291714 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:20.291683 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e668313f342b031ca72bda6e5325061ffaecc2548703c5436990eaca571917a"} err="failed to get container status \"1e668313f342b031ca72bda6e5325061ffaecc2548703c5436990eaca571917a\": rpc error: code = NotFound desc = could not find container \"1e668313f342b031ca72bda6e5325061ffaecc2548703c5436990eaca571917a\": container with ID starting with 1e668313f342b031ca72bda6e5325061ffaecc2548703c5436990eaca571917a not found: ID does not exist" Jun 14 03:22:20.302816 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:20.302791 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8mt9m"] Jun 14 03:22:20.306331 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:20.306312 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8mt9m"] Jun 14 03:22:22.298148 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:22.298119 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fc01da8-ec0c-447d-be46-05b36f6eb44f" path="/var/lib/kubelet/pods/8fc01da8-ec0c-447d-be46-05b36f6eb44f/volumes" Jun 14 03:22:26.613222 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:26.613187 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-6bbjg" Jun 14 03:22:26.613775 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:26.613240 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-6bbjg" Jun 14 03:22:26.636299 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:26.636277 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-6bbjg" Jun 14 03:22:27.334741 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:27.334715 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-6bbjg" Jun 14 03:22:48.914795 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:48.914762 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9"] Jun 14 03:22:48.915157 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:48.915097 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc01da8-ec0c-447d-be46-05b36f6eb44f" containerName="registry-server" Jun 14 03:22:48.915157 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:48.915111 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc01da8-ec0c-447d-be46-05b36f6eb44f" containerName="registry-server" Jun 14 03:22:48.915229 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:48.915168 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fc01da8-ec0c-447d-be46-05b36f6eb44f" containerName="registry-server" Jun 14 03:22:48.921387 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:48.921367 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:22:48.924064 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:48.924043 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6nm8r\"" Jun 14 03:22:48.931255 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:48.931204 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9"] Jun 14 03:22:49.038568 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:49.038544 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b629215e-5825-4a0e-a802-4f3be3abc81c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t9ck9\" (UID: \"b629215e-5825-4a0e-a802-4f3be3abc81c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:22:49.038693 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:49.038631 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgxzf\" (UniqueName: \"kubernetes.io/projected/b629215e-5825-4a0e-a802-4f3be3abc81c-kube-api-access-tgxzf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t9ck9\" (UID: \"b629215e-5825-4a0e-a802-4f3be3abc81c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:22:49.139393 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:49.139368 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b629215e-5825-4a0e-a802-4f3be3abc81c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t9ck9\" (UID: \"b629215e-5825-4a0e-a802-4f3be3abc81c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:22:49.139531 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:49.139420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgxzf\" (UniqueName: \"kubernetes.io/projected/b629215e-5825-4a0e-a802-4f3be3abc81c-kube-api-access-tgxzf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t9ck9\" (UID: \"b629215e-5825-4a0e-a802-4f3be3abc81c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:22:49.139668 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:49.139651 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b629215e-5825-4a0e-a802-4f3be3abc81c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t9ck9\" (UID: \"b629215e-5825-4a0e-a802-4f3be3abc81c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:22:49.151055 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:49.151026 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgxzf\" (UniqueName: \"kubernetes.io/projected/b629215e-5825-4a0e-a802-4f3be3abc81c-kube-api-access-tgxzf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t9ck9\" (UID: \"b629215e-5825-4a0e-a802-4f3be3abc81c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:22:49.232245 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:49.232181 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:22:49.383822 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:49.383798 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9"] Jun 14 03:22:49.385996 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:22:49.385968 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb629215e_5825_4a0e_a802_4f3be3abc81c.slice/crio-fb4f5f6acbb2ccda72c437333ff8172acd311a4f498fa682f8065f90d1407194 WatchSource:0}: Error finding container fb4f5f6acbb2ccda72c437333ff8172acd311a4f498fa682f8065f90d1407194: Status 404 returned error can't find the container with id fb4f5f6acbb2ccda72c437333ff8172acd311a4f498fa682f8065f90d1407194 Jun 14 03:22:49.401402 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:49.401376 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" event={"ID":"b629215e-5825-4a0e-a802-4f3be3abc81c","Type":"ContainerStarted","Data":"fb4f5f6acbb2ccda72c437333ff8172acd311a4f498fa682f8065f90d1407194"} Jun 14 03:22:50.811790 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:50.811755 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzqfg"] Jun 14 03:22:50.814989 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:50.814973 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzqfg" Jun 14 03:22:50.817391 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:50.817366 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 14 03:22:50.817514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:50.817456 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2twgb\"" Jun 14 03:22:50.826002 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:50.825982 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzqfg"] Jun 14 03:22:50.953315 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:50.953286 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbmpv\" (UniqueName: \"kubernetes.io/projected/3f6af334-d711-4c51-8e15-a445de51258c-kube-api-access-qbmpv\") pod \"dns-operator-controller-manager-864dd78c4c-qzqfg\" (UID: \"3f6af334-d711-4c51-8e15-a445de51258c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzqfg" Jun 14 03:22:51.054560 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:51.054525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbmpv\" (UniqueName: \"kubernetes.io/projected/3f6af334-d711-4c51-8e15-a445de51258c-kube-api-access-qbmpv\") pod \"dns-operator-controller-manager-864dd78c4c-qzqfg\" (UID: \"3f6af334-d711-4c51-8e15-a445de51258c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzqfg" Jun 14 03:22:51.080293 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:51.080230 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbmpv\" (UniqueName: \"kubernetes.io/projected/3f6af334-d711-4c51-8e15-a445de51258c-kube-api-access-qbmpv\") pod \"dns-operator-controller-manager-864dd78c4c-qzqfg\" (UID: \"3f6af334-d711-4c51-8e15-a445de51258c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzqfg" Jun 14 03:22:51.125062 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:51.125033 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzqfg" Jun 14 03:22:51.279829 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:51.279803 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzqfg"] Jun 14 03:22:51.281895 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:22:51.281860 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f6af334_d711_4c51_8e15_a445de51258c.slice/crio-ce0f7fdbbc3c590a10677a691d43f14bd3160287b3daa416a0742827d2a6b98c WatchSource:0}: Error finding container ce0f7fdbbc3c590a10677a691d43f14bd3160287b3daa416a0742827d2a6b98c: Status 404 returned error can't find the container with id ce0f7fdbbc3c590a10677a691d43f14bd3160287b3daa416a0742827d2a6b98c Jun 14 03:22:51.410416 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:51.410382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzqfg" event={"ID":"3f6af334-d711-4c51-8e15-a445de51258c","Type":"ContainerStarted","Data":"ce0f7fdbbc3c590a10677a691d43f14bd3160287b3daa416a0742827d2a6b98c"} Jun 14 03:22:53.423132 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:53.423033 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzqfg" event={"ID":"3f6af334-d711-4c51-8e15-a445de51258c","Type":"ContainerStarted","Data":"1de08d8bc4a70463eed313dbd402dacf28e8275467a6adcc7eb66a018a305700"} Jun 14 03:22:53.423541 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:53.423142 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzqfg" Jun 14 03:22:53.452813 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:53.452769 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzqfg" podStartSLOduration=1.56409628 podStartE2EDuration="3.452754776s" totalImagesPullingTime="1.888658496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:22:53.45120275 +0000 UTC m=+583.610345647" watchObservedRunningTime="2026-06-14 03:22:53.452754776 +0000 UTC m=+583.611897682" Jun 14 03:22:53.773011 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:53.772909 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx"] Jun 14 03:22:53.776476 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:53.776449 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:22:53.779032 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:53.779006 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qmxg8\"" Jun 14 03:22:53.781508 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:53.781479 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcb95\" (UniqueName: \"kubernetes.io/projected/2681337a-4d76-4af5-8cd0-363b10c74ec1-kube-api-access-dcb95\") pod \"limitador-operator-controller-manager-859d7b78bd-c9lvx\" (UID: \"2681337a-4d76-4af5-8cd0-363b10c74ec1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:22:53.784755 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:53.784727 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx"] Jun 14 03:22:53.882893 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:53.882858 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcb95\" (UniqueName: \"kubernetes.io/projected/2681337a-4d76-4af5-8cd0-363b10c74ec1-kube-api-access-dcb95\") pod \"limitador-operator-controller-manager-859d7b78bd-c9lvx\" (UID: \"2681337a-4d76-4af5-8cd0-363b10c74ec1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:22:53.893492 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:53.893468 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcb95\" (UniqueName: \"kubernetes.io/projected/2681337a-4d76-4af5-8cd0-363b10c74ec1-kube-api-access-dcb95\") pod \"limitador-operator-controller-manager-859d7b78bd-c9lvx\" (UID: \"2681337a-4d76-4af5-8cd0-363b10c74ec1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:22:54.088649 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:54.088575 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:22:54.235094 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:54.235063 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx"] Jun 14 03:22:54.238766 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:22:54.238738 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2681337a_4d76_4af5_8cd0_363b10c74ec1.slice/crio-85c0bacdee2572152cda404ff333cb8478113e26a22d334acdf257592669f857 WatchSource:0}: Error finding container 85c0bacdee2572152cda404ff333cb8478113e26a22d334acdf257592669f857: Status 404 returned error can't find the container with id 85c0bacdee2572152cda404ff333cb8478113e26a22d334acdf257592669f857 Jun 14 03:22:54.429177 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:54.429147 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" event={"ID":"2681337a-4d76-4af5-8cd0-363b10c74ec1","Type":"ContainerStarted","Data":"85c0bacdee2572152cda404ff333cb8478113e26a22d334acdf257592669f857"} Jun 14 03:22:56.440424 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:56.440386 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" event={"ID":"2681337a-4d76-4af5-8cd0-363b10c74ec1","Type":"ContainerStarted","Data":"400bbd982e0b42fbb5647701c0dd0a57588d3f3906cb09d4b03867f464442e31"} Jun 14 03:22:56.440775 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:56.440523 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:22:56.457247 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:56.457201 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" podStartSLOduration=1.6469026310000001 podStartE2EDuration="3.457186519s" totalImagesPullingTime="1.810283888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:22:56.455568271 +0000 UTC m=+586.614711175" watchObservedRunningTime="2026-06-14 03:22:56.457186519 +0000 UTC m=+586.616329423" Jun 14 03:22:58.451619 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:58.451587 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" event={"ID":"b629215e-5825-4a0e-a802-4f3be3abc81c","Type":"ContainerStarted","Data":"e6978721ec4a3c799ba7415aabb528b0258964ce9abd8921809178f18eb8c3eb"} Jun 14 03:22:58.451989 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:58.451652 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:22:58.475811 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:58.475755 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" podStartSLOduration=1.530121589 podStartE2EDuration="10.475742397s" totalImagesPullingTime="8.945620808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:22:58.473264841 +0000 UTC m=+588.632407744" watchObservedRunningTime="2026-06-14 03:22:58.475742397 +0000 UTC m=+588.634885301" Jun 14 03:22:59.192669 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.192629 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56dbd6b9b7-7jdkq"] Jun 14 03:22:59.196131 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.196104 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.208788 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.208766 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56dbd6b9b7-7jdkq"] Jun 14 03:22:59.228912 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.228890 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67a84267-3915-401e-8cfb-224aa0e2c2d7-console-oauth-config\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.229043 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.228919 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67a84267-3915-401e-8cfb-224aa0e2c2d7-console-serving-cert\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.229043 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.229024 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67a84267-3915-401e-8cfb-224aa0e2c2d7-service-ca\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.229122 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.229053 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25t5c\" (UniqueName: \"kubernetes.io/projected/67a84267-3915-401e-8cfb-224aa0e2c2d7-kube-api-access-25t5c\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.229122 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.229073 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67a84267-3915-401e-8cfb-224aa0e2c2d7-console-config\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.229122 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.229097 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67a84267-3915-401e-8cfb-224aa0e2c2d7-trusted-ca-bundle\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.229216 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.229132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67a84267-3915-401e-8cfb-224aa0e2c2d7-oauth-serving-cert\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.330049 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.330014 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67a84267-3915-401e-8cfb-224aa0e2c2d7-trusted-ca-bundle\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.330226 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.330060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67a84267-3915-401e-8cfb-224aa0e2c2d7-oauth-serving-cert\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.330226 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.330109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67a84267-3915-401e-8cfb-224aa0e2c2d7-console-oauth-config\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.330355 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.330287 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67a84267-3915-401e-8cfb-224aa0e2c2d7-console-serving-cert\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.330437 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.330420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67a84267-3915-401e-8cfb-224aa0e2c2d7-service-ca\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.330498 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.330452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25t5c\" (UniqueName: \"kubernetes.io/projected/67a84267-3915-401e-8cfb-224aa0e2c2d7-kube-api-access-25t5c\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.330498 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.330483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67a84267-3915-401e-8cfb-224aa0e2c2d7-console-config\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.330826 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.330800 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67a84267-3915-401e-8cfb-224aa0e2c2d7-oauth-serving-cert\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.330978 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.330907 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67a84267-3915-401e-8cfb-224aa0e2c2d7-trusted-ca-bundle\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.331089 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.331060 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67a84267-3915-401e-8cfb-224aa0e2c2d7-service-ca\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.331153 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.331126 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67a84267-3915-401e-8cfb-224aa0e2c2d7-console-config\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.333344 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.333320 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67a84267-3915-401e-8cfb-224aa0e2c2d7-console-oauth-config\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.333496 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.333476 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67a84267-3915-401e-8cfb-224aa0e2c2d7-console-serving-cert\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.339149 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.339123 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25t5c\" (UniqueName: \"kubernetes.io/projected/67a84267-3915-401e-8cfb-224aa0e2c2d7-kube-api-access-25t5c\") pod \"console-56dbd6b9b7-7jdkq\" (UID: \"67a84267-3915-401e-8cfb-224aa0e2c2d7\") " pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.505471 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.505390 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:22:59.642444 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:22:59.642420 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56dbd6b9b7-7jdkq"] Jun 14 03:22:59.644460 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:22:59.644433 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a84267_3915_401e_8cfb_224aa0e2c2d7.slice/crio-d1c9bed80e86342ca871752f8d22948eea5ffddef88f442f61a25fd7c22c0a2e WatchSource:0}: Error finding container d1c9bed80e86342ca871752f8d22948eea5ffddef88f442f61a25fd7c22c0a2e: Status 404 returned error can't find the container with id d1c9bed80e86342ca871752f8d22948eea5ffddef88f442f61a25fd7c22c0a2e Jun 14 03:23:00.462113 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:00.462074 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dbd6b9b7-7jdkq" event={"ID":"67a84267-3915-401e-8cfb-224aa0e2c2d7","Type":"ContainerStarted","Data":"7774d082ac77fb92791352fc1dfa8f88b527d2c7652215a102f861b9ea62e5b0"} Jun 14 03:23:00.462276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:00.462128 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dbd6b9b7-7jdkq" event={"ID":"67a84267-3915-401e-8cfb-224aa0e2c2d7","Type":"ContainerStarted","Data":"d1c9bed80e86342ca871752f8d22948eea5ffddef88f442f61a25fd7c22c0a2e"} Jun 14 03:23:00.481418 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:00.481371 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56dbd6b9b7-7jdkq" podStartSLOduration=1.481355459 podStartE2EDuration="1.481355459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:22:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:23:00.479653844 +0000 UTC m=+590.638796752" watchObservedRunningTime="2026-06-14 03:23:00.481355459 +0000 UTC m=+590.640498362" Jun 14 03:23:04.431816 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:04.431788 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzqfg" Jun 14 03:23:07.448558 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:07.448529 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:23:09.458388 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:09.458356 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:23:09.505979 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:09.505954 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:23:09.506177 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:09.506009 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:23:09.510507 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:09.510486 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:23:10.292441 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:10.292415 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:23:10.293672 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:10.293628 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:23:10.511745 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:10.511714 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56dbd6b9b7-7jdkq" Jun 14 03:23:10.568242 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:10.568143 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bbff4d758-jhkdr"] Jun 14 03:23:11.118562 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.118534 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9"] Jun 14 03:23:11.122088 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.118725 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" podUID="b629215e-5825-4a0e-a802-4f3be3abc81c" containerName="manager" containerID="cri-o://e6978721ec4a3c799ba7415aabb528b0258964ce9abd8921809178f18eb8c3eb" gracePeriod=2 Jun 14 03:23:11.129540 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.129504 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9"] Jun 14 03:23:11.146816 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.146789 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx"] Jun 14 03:23:11.147059 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.147032 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" podUID="2681337a-4d76-4af5-8cd0-363b10c74ec1" containerName="manager" containerID="cri-o://400bbd982e0b42fbb5647701c0dd0a57588d3f3906cb09d4b03867f464442e31" gracePeriod=2 Jun 14 03:23:11.184197 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.184164 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7"] Jun 14 03:23:11.184803 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.184778 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b629215e-5825-4a0e-a802-4f3be3abc81c" containerName="manager" Jun 14 03:23:11.184803 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.184799 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b629215e-5825-4a0e-a802-4f3be3abc81c" containerName="manager" Jun 14 03:23:11.184948 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.184857 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b629215e-5825-4a0e-a802-4f3be3abc81c" containerName="manager" Jun 14 03:23:11.188183 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.188164 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx"] Jun 14 03:23:11.188270 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.188252 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" Jun 14 03:23:11.197445 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.197406 2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"2681337a-4d76-4af5-8cd0-363b10c74ec1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-c9lvx\": pods \"limitador-operator-controller-manager-859d7b78bd-c9lvx\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:23:11.207218 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.207192 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t9ck9\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="b629215e-5825-4a0e-a802-4f3be3abc81c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:23:11.210281 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.210248 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t9ck9\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="b629215e-5825-4a0e-a802-4f3be3abc81c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:23:11.214601 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.214574 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-c9lvx\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="2681337a-4d76-4af5-8cd0-363b10c74ec1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:23:11.227341 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.227319 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7"] Jun 14 03:23:11.231244 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.231222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpwbh\" (UniqueName: \"kubernetes.io/projected/b09ee8b1-06a5-4918-b69a-de7e14d25057-kube-api-access-xpwbh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-45bn7\" (UID: \"b09ee8b1-06a5-4918-b69a-de7e14d25057\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" Jun 14 03:23:11.231244 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.231265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b09ee8b1-06a5-4918-b69a-de7e14d25057-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-45bn7\" (UID: \"b09ee8b1-06a5-4918-b69a-de7e14d25057\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" Jun 14 03:23:11.332574 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.332541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpwbh\" (UniqueName: \"kubernetes.io/projected/b09ee8b1-06a5-4918-b69a-de7e14d25057-kube-api-access-xpwbh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-45bn7\" (UID: \"b09ee8b1-06a5-4918-b69a-de7e14d25057\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" Jun 14 03:23:11.333341 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.332589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b09ee8b1-06a5-4918-b69a-de7e14d25057-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-45bn7\" (UID: \"b09ee8b1-06a5-4918-b69a-de7e14d25057\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" Jun 14 03:23:11.333341 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.333080 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b09ee8b1-06a5-4918-b69a-de7e14d25057-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-45bn7\" (UID: \"b09ee8b1-06a5-4918-b69a-de7e14d25057\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" Jun 14 03:23:11.344572 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.344544 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpwbh\" (UniqueName: \"kubernetes.io/projected/b09ee8b1-06a5-4918-b69a-de7e14d25057-kube-api-access-xpwbh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-45bn7\" (UID: \"b09ee8b1-06a5-4918-b69a-de7e14d25057\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" Jun 14 03:23:11.386578 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.386552 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:23:11.389356 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.389337 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:23:11.389718 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.389695 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t9ck9\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="b629215e-5825-4a0e-a802-4f3be3abc81c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:23:11.393775 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.393754 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-c9lvx\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="2681337a-4d76-4af5-8cd0-363b10c74ec1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:23:11.396283 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.396249 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-c9lvx\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="2681337a-4d76-4af5-8cd0-363b10c74ec1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:23:11.398310 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.398275 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t9ck9\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="b629215e-5825-4a0e-a802-4f3be3abc81c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:23:11.433819 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.433795 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcb95\" (UniqueName: \"kubernetes.io/projected/2681337a-4d76-4af5-8cd0-363b10c74ec1-kube-api-access-dcb95\") pod \"2681337a-4d76-4af5-8cd0-363b10c74ec1\" (UID: \"2681337a-4d76-4af5-8cd0-363b10c74ec1\") " Jun 14 03:23:11.433979 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.433917 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b629215e-5825-4a0e-a802-4f3be3abc81c-extensions-socket-volume\") pod \"b629215e-5825-4a0e-a802-4f3be3abc81c\" (UID: \"b629215e-5825-4a0e-a802-4f3be3abc81c\") " Jun 14 03:23:11.433979 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.433963 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgxzf\" (UniqueName: \"kubernetes.io/projected/b629215e-5825-4a0e-a802-4f3be3abc81c-kube-api-access-tgxzf\") pod \"b629215e-5825-4a0e-a802-4f3be3abc81c\" (UID: \"b629215e-5825-4a0e-a802-4f3be3abc81c\") " Jun 14 03:23:11.434312 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.434280 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b629215e-5825-4a0e-a802-4f3be3abc81c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b629215e-5825-4a0e-a802-4f3be3abc81c" (UID: "b629215e-5825-4a0e-a802-4f3be3abc81c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:23:11.436032 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.436005 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2681337a-4d76-4af5-8cd0-363b10c74ec1-kube-api-access-dcb95" (OuterVolumeSpecName: "kube-api-access-dcb95") pod "2681337a-4d76-4af5-8cd0-363b10c74ec1" (UID: "2681337a-4d76-4af5-8cd0-363b10c74ec1"). InnerVolumeSpecName "kube-api-access-dcb95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:23:11.436179 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.436162 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b629215e-5825-4a0e-a802-4f3be3abc81c-kube-api-access-tgxzf" (OuterVolumeSpecName: "kube-api-access-tgxzf") pod "b629215e-5825-4a0e-a802-4f3be3abc81c" (UID: "b629215e-5825-4a0e-a802-4f3be3abc81c"). InnerVolumeSpecName "kube-api-access-tgxzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:23:11.513497 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.513458 2581 generic.go:356] "Generic (PLEG): container finished" podID="b629215e-5825-4a0e-a802-4f3be3abc81c" containerID="e6978721ec4a3c799ba7415aabb528b0258964ce9abd8921809178f18eb8c3eb" exitCode=0 Jun 14 03:23:11.513961 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.513502 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:23:11.513961 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.513553 2581 scope.go:117] "RemoveContainer" containerID="e6978721ec4a3c799ba7415aabb528b0258964ce9abd8921809178f18eb8c3eb" Jun 14 03:23:11.514813 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.514789 2581 generic.go:356] "Generic (PLEG): container finished" podID="2681337a-4d76-4af5-8cd0-363b10c74ec1" containerID="400bbd982e0b42fbb5647701c0dd0a57588d3f3906cb09d4b03867f464442e31" exitCode=0 Jun 14 03:23:11.514891 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.514859 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:23:11.516307 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.516283 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-c9lvx\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="2681337a-4d76-4af5-8cd0-363b10c74ec1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:23:11.519879 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.519850 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t9ck9\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="b629215e-5825-4a0e-a802-4f3be3abc81c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:23:11.521903 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.521876 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t9ck9\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="b629215e-5825-4a0e-a802-4f3be3abc81c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:23:11.523959 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.523818 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-c9lvx\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="2681337a-4d76-4af5-8cd0-363b10c74ec1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:23:11.523959 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.523896 2581 scope.go:117] "RemoveContainer" containerID="e6978721ec4a3c799ba7415aabb528b0258964ce9abd8921809178f18eb8c3eb" Jun 14 03:23:11.524368 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.524347 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6978721ec4a3c799ba7415aabb528b0258964ce9abd8921809178f18eb8c3eb\": container with ID starting with e6978721ec4a3c799ba7415aabb528b0258964ce9abd8921809178f18eb8c3eb not found: ID does not exist" containerID="e6978721ec4a3c799ba7415aabb528b0258964ce9abd8921809178f18eb8c3eb" Jun 14 03:23:11.524471 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.524373 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6978721ec4a3c799ba7415aabb528b0258964ce9abd8921809178f18eb8c3eb"} err="failed to get container status \"e6978721ec4a3c799ba7415aabb528b0258964ce9abd8921809178f18eb8c3eb\": rpc error: code = NotFound desc = could not find container \"e6978721ec4a3c799ba7415aabb528b0258964ce9abd8921809178f18eb8c3eb\": container with ID starting with e6978721ec4a3c799ba7415aabb528b0258964ce9abd8921809178f18eb8c3eb not found: ID does not exist" Jun 14 03:23:11.524471 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.524388 2581 scope.go:117] "RemoveContainer" containerID="400bbd982e0b42fbb5647701c0dd0a57588d3f3906cb09d4b03867f464442e31" Jun 14 03:23:11.530105 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.530075 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-c9lvx\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="2681337a-4d76-4af5-8cd0-363b10c74ec1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:23:11.532660 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.532631 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t9ck9\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="b629215e-5825-4a0e-a802-4f3be3abc81c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:23:11.533042 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.533023 2581 scope.go:117] "RemoveContainer" containerID="400bbd982e0b42fbb5647701c0dd0a57588d3f3906cb09d4b03867f464442e31" Jun 14 03:23:11.533323 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.533303 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"400bbd982e0b42fbb5647701c0dd0a57588d3f3906cb09d4b03867f464442e31\": container with ID starting with 400bbd982e0b42fbb5647701c0dd0a57588d3f3906cb09d4b03867f464442e31 not found: ID does not exist" containerID="400bbd982e0b42fbb5647701c0dd0a57588d3f3906cb09d4b03867f464442e31" Jun 14 03:23:11.533403 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.533328 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"400bbd982e0b42fbb5647701c0dd0a57588d3f3906cb09d4b03867f464442e31"} err="failed to get container status \"400bbd982e0b42fbb5647701c0dd0a57588d3f3906cb09d4b03867f464442e31\": rpc error: code = NotFound desc = could not find container \"400bbd982e0b42fbb5647701c0dd0a57588d3f3906cb09d4b03867f464442e31\": container with ID starting with 400bbd982e0b42fbb5647701c0dd0a57588d3f3906cb09d4b03867f464442e31 not found: ID does not exist" Jun 14 03:23:11.534650 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.534629 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-c9lvx\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="2681337a-4d76-4af5-8cd0-363b10c74ec1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c9lvx" Jun 14 03:23:11.534767 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.534749 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b629215e-5825-4a0e-a802-4f3be3abc81c-extensions-socket-volume\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:23:11.534824 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.534774 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgxzf\" (UniqueName: \"kubernetes.io/projected/b629215e-5825-4a0e-a802-4f3be3abc81c-kube-api-access-tgxzf\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:23:11.534824 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.534789 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcb95\" (UniqueName: \"kubernetes.io/projected/2681337a-4d76-4af5-8cd0-363b10c74ec1-kube-api-access-dcb95\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:23:11.536661 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:11.536636 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t9ck9\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="b629215e-5825-4a0e-a802-4f3be3abc81c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9ck9" Jun 14 03:23:11.562218 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.562193 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" Jun 14 03:23:11.706176 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:11.706141 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7"] Jun 14 03:23:11.709086 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:23:11.709061 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb09ee8b1_06a5_4918_b69a_de7e14d25057.slice/crio-7f47889f6f35bfc3becae381c751facc0a2abe08966047428c9be85dec485dbe WatchSource:0}: Error finding container 7f47889f6f35bfc3becae381c751facc0a2abe08966047428c9be85dec485dbe: Status 404 returned error can't find the container with id 7f47889f6f35bfc3becae381c751facc0a2abe08966047428c9be85dec485dbe Jun 14 03:23:12.303639 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:12.303604 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2681337a-4d76-4af5-8cd0-363b10c74ec1" path="/var/lib/kubelet/pods/2681337a-4d76-4af5-8cd0-363b10c74ec1/volumes" Jun 14 03:23:12.303970 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:12.303956 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b629215e-5825-4a0e-a802-4f3be3abc81c" path="/var/lib/kubelet/pods/b629215e-5825-4a0e-a802-4f3be3abc81c/volumes" Jun 14 03:23:12.521803 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:12.521711 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" event={"ID":"b09ee8b1-06a5-4918-b69a-de7e14d25057","Type":"ContainerStarted","Data":"dd65e972a4f1377ca1407ae52bd12fed2e3367458f94ec02813f3e430b6155c7"} Jun 14 03:23:12.521803 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:12.521773 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" event={"ID":"b09ee8b1-06a5-4918-b69a-de7e14d25057","Type":"ContainerStarted","Data":"7f47889f6f35bfc3becae381c751facc0a2abe08966047428c9be85dec485dbe"} Jun 14 03:23:12.522299 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:12.521823 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" Jun 14 03:23:12.558816 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:12.558764 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" podStartSLOduration=1.558748596 podStartE2EDuration="1.558748596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:23:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:23:12.554643469 +0000 UTC m=+602.713786383" watchObservedRunningTime="2026-06-14 03:23:12.558748596 +0000 UTC m=+602.717891500" Jun 14 03:23:23.529499 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:23.529467 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" Jun 14 03:23:30.033492 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.033414 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7"] Jun 14 03:23:30.033912 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.033596 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" podUID="b09ee8b1-06a5-4918-b69a-de7e14d25057" containerName="manager" containerID="cri-o://dd65e972a4f1377ca1407ae52bd12fed2e3367458f94ec02813f3e430b6155c7" gracePeriod=10 Jun 14 03:23:30.252948 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.252894 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb"] Jun 14 03:23:30.253259 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.253245 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2681337a-4d76-4af5-8cd0-363b10c74ec1" containerName="manager" Jun 14 03:23:30.253303 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.253261 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2681337a-4d76-4af5-8cd0-363b10c74ec1" containerName="manager" Jun 14 03:23:30.253522 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.253324 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2681337a-4d76-4af5-8cd0-363b10c74ec1" containerName="manager" Jun 14 03:23:30.264733 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.264710 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" Jun 14 03:23:30.273303 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.273215 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb"] Jun 14 03:23:30.314563 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.314535 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" Jun 14 03:23:30.399525 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.399494 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpwbh\" (UniqueName: \"kubernetes.io/projected/b09ee8b1-06a5-4918-b69a-de7e14d25057-kube-api-access-xpwbh\") pod \"b09ee8b1-06a5-4918-b69a-de7e14d25057\" (UID: \"b09ee8b1-06a5-4918-b69a-de7e14d25057\") " Jun 14 03:23:30.399707 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.399601 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b09ee8b1-06a5-4918-b69a-de7e14d25057-extensions-socket-volume\") pod \"b09ee8b1-06a5-4918-b69a-de7e14d25057\" (UID: \"b09ee8b1-06a5-4918-b69a-de7e14d25057\") " Jun 14 03:23:30.399758 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.399742 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w78d5\" (UniqueName: \"kubernetes.io/projected/14e6219f-6f4f-4452-877f-139c60586a00-kube-api-access-w78d5\") pod \"kuadrant-operator-controller-manager-86878c769f-xzlbb\" (UID: \"14e6219f-6f4f-4452-877f-139c60586a00\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" Jun 14 03:23:30.399799 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.399773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14e6219f-6f4f-4452-877f-139c60586a00-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xzlbb\" (UID: \"14e6219f-6f4f-4452-877f-139c60586a00\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" Jun 14 03:23:30.400018 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.399997 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b09ee8b1-06a5-4918-b69a-de7e14d25057-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b09ee8b1-06a5-4918-b69a-de7e14d25057" (UID: "b09ee8b1-06a5-4918-b69a-de7e14d25057"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:23:30.401775 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.401754 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b09ee8b1-06a5-4918-b69a-de7e14d25057-kube-api-access-xpwbh" (OuterVolumeSpecName: "kube-api-access-xpwbh") pod "b09ee8b1-06a5-4918-b69a-de7e14d25057" (UID: "b09ee8b1-06a5-4918-b69a-de7e14d25057"). InnerVolumeSpecName "kube-api-access-xpwbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:23:30.500423 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.500387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w78d5\" (UniqueName: \"kubernetes.io/projected/14e6219f-6f4f-4452-877f-139c60586a00-kube-api-access-w78d5\") pod \"kuadrant-operator-controller-manager-86878c769f-xzlbb\" (UID: \"14e6219f-6f4f-4452-877f-139c60586a00\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" Jun 14 03:23:30.500581 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.500430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14e6219f-6f4f-4452-877f-139c60586a00-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xzlbb\" (UID: \"14e6219f-6f4f-4452-877f-139c60586a00\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" Jun 14 03:23:30.500581 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.500495 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b09ee8b1-06a5-4918-b69a-de7e14d25057-extensions-socket-volume\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:23:30.500581 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.500512 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpwbh\" (UniqueName: \"kubernetes.io/projected/b09ee8b1-06a5-4918-b69a-de7e14d25057-kube-api-access-xpwbh\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:23:30.500796 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.500777 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14e6219f-6f4f-4452-877f-139c60586a00-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xzlbb\" (UID: \"14e6219f-6f4f-4452-877f-139c60586a00\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" Jun 14 03:23:30.508344 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.508323 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w78d5\" (UniqueName: \"kubernetes.io/projected/14e6219f-6f4f-4452-877f-139c60586a00-kube-api-access-w78d5\") pod \"kuadrant-operator-controller-manager-86878c769f-xzlbb\" (UID: \"14e6219f-6f4f-4452-877f-139c60586a00\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" Jun 14 03:23:30.601540 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.601469 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" Jun 14 03:23:30.608508 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.608484 2581 generic.go:356] "Generic (PLEG): container finished" podID="b09ee8b1-06a5-4918-b69a-de7e14d25057" containerID="dd65e972a4f1377ca1407ae52bd12fed2e3367458f94ec02813f3e430b6155c7" exitCode=0 Jun 14 03:23:30.608620 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.608525 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" event={"ID":"b09ee8b1-06a5-4918-b69a-de7e14d25057","Type":"ContainerDied","Data":"dd65e972a4f1377ca1407ae52bd12fed2e3367458f94ec02813f3e430b6155c7"} Jun 14 03:23:30.608620 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.608524 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" Jun 14 03:23:30.608620 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.608568 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7" event={"ID":"b09ee8b1-06a5-4918-b69a-de7e14d25057","Type":"ContainerDied","Data":"7f47889f6f35bfc3becae381c751facc0a2abe08966047428c9be85dec485dbe"} Jun 14 03:23:30.608620 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.608591 2581 scope.go:117] "RemoveContainer" containerID="dd65e972a4f1377ca1407ae52bd12fed2e3367458f94ec02813f3e430b6155c7" Jun 14 03:23:30.617763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.617740 2581 scope.go:117] "RemoveContainer" containerID="dd65e972a4f1377ca1407ae52bd12fed2e3367458f94ec02813f3e430b6155c7" Jun 14 03:23:30.618080 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:30.618054 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd65e972a4f1377ca1407ae52bd12fed2e3367458f94ec02813f3e430b6155c7\": container with ID starting with dd65e972a4f1377ca1407ae52bd12fed2e3367458f94ec02813f3e430b6155c7 not found: ID does not exist" containerID="dd65e972a4f1377ca1407ae52bd12fed2e3367458f94ec02813f3e430b6155c7" Jun 14 03:23:30.618626 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.618574 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd65e972a4f1377ca1407ae52bd12fed2e3367458f94ec02813f3e430b6155c7"} err="failed to get container status \"dd65e972a4f1377ca1407ae52bd12fed2e3367458f94ec02813f3e430b6155c7\": rpc error: code = NotFound desc = could not find container \"dd65e972a4f1377ca1407ae52bd12fed2e3367458f94ec02813f3e430b6155c7\": container with ID starting with dd65e972a4f1377ca1407ae52bd12fed2e3367458f94ec02813f3e430b6155c7 not found: ID does not exist" Jun 14 03:23:30.632080 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.632055 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7"] Jun 14 03:23:30.638582 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.638557 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45bn7"] Jun 14 03:23:30.747559 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:30.747530 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb"] Jun 14 03:23:30.750424 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:23:30.750392 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14e6219f_6f4f_4452_877f_139c60586a00.slice/crio-dcd83cd6f9d5d88f66daaa68a6ec69bafa8f7b44e1027e098330c0f851a7b4ec WatchSource:0}: Error finding container dcd83cd6f9d5d88f66daaa68a6ec69bafa8f7b44e1027e098330c0f851a7b4ec: Status 404 returned error can't find the container with id dcd83cd6f9d5d88f66daaa68a6ec69bafa8f7b44e1027e098330c0f851a7b4ec Jun 14 03:23:31.615099 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:31.615058 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" event={"ID":"14e6219f-6f4f-4452-877f-139c60586a00","Type":"ContainerStarted","Data":"c9e8e1ee4f204dadc38187ff986c181eceb455ba113b68a08c385d0352950b47"} Jun 14 03:23:31.615535 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:31.615110 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" event={"ID":"14e6219f-6f4f-4452-877f-139c60586a00","Type":"ContainerStarted","Data":"dcd83cd6f9d5d88f66daaa68a6ec69bafa8f7b44e1027e098330c0f851a7b4ec"} Jun 14 03:23:31.615535 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:31.615174 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" Jun 14 03:23:32.300052 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:32.300021 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b09ee8b1-06a5-4918-b69a-de7e14d25057" path="/var/lib/kubelet/pods/b09ee8b1-06a5-4918-b69a-de7e14d25057/volumes" Jun 14 03:23:35.589286 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.589237 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bbff4d758-jhkdr" podUID="6fe6f7d7-0636-4d5d-a337-c923720f81c6" containerName="console" containerID="cri-o://eb5185ded5fb9db1ad82ff94344cfa6cf23f5abba18df6642dfbdb0ebe67486a" gracePeriod=15 Jun 14 03:23:35.837691 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.837669 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:23:35.860120 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.860034 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" podStartSLOduration=5.860012901 podStartE2EDuration="5.860012901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:23:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:23:31.643560008 +0000 UTC m=+621.802702922" watchObservedRunningTime="2026-06-14 03:23:35.860012901 +0000 UTC m=+626.019155857" Jun 14 03:23:35.947130 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.947104 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-trusted-ca-bundle\") pod \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " Jun 14 03:23:35.947276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.947148 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdn2c\" (UniqueName: \"kubernetes.io/projected/6fe6f7d7-0636-4d5d-a337-c923720f81c6-kube-api-access-rdn2c\") pod \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " Jun 14 03:23:35.947276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.947184 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-config\") pod \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " Jun 14 03:23:35.947276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.947220 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-serving-cert\") pod \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " Jun 14 03:23:35.947276 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.947238 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-service-ca\") pod \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " Jun 14 03:23:35.947488 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.947279 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-oauth-config\") pod \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " Jun 14 03:23:35.947488 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.947303 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-oauth-serving-cert\") pod \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\" (UID: \"6fe6f7d7-0636-4d5d-a337-c923720f81c6\") " Jun 14 03:23:35.947586 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.947562 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6fe6f7d7-0636-4d5d-a337-c923720f81c6" (UID: "6fe6f7d7-0636-4d5d-a337-c923720f81c6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:23:35.947680 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.947658 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-service-ca" (OuterVolumeSpecName: "service-ca") pod "6fe6f7d7-0636-4d5d-a337-c923720f81c6" (UID: "6fe6f7d7-0636-4d5d-a337-c923720f81c6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:23:35.947853 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.947827 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-config" (OuterVolumeSpecName: "console-config") pod "6fe6f7d7-0636-4d5d-a337-c923720f81c6" (UID: "6fe6f7d7-0636-4d5d-a337-c923720f81c6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:23:35.947853 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.947833 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6fe6f7d7-0636-4d5d-a337-c923720f81c6" (UID: "6fe6f7d7-0636-4d5d-a337-c923720f81c6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:23:35.949599 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.949568 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6fe6f7d7-0636-4d5d-a337-c923720f81c6" (UID: "6fe6f7d7-0636-4d5d-a337-c923720f81c6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:23:35.949979 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.949964 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fe6f7d7-0636-4d5d-a337-c923720f81c6-kube-api-access-rdn2c" (OuterVolumeSpecName: "kube-api-access-rdn2c") pod "6fe6f7d7-0636-4d5d-a337-c923720f81c6" (UID: "6fe6f7d7-0636-4d5d-a337-c923720f81c6"). InnerVolumeSpecName "kube-api-access-rdn2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:23:35.950044 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:35.949975 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6fe6f7d7-0636-4d5d-a337-c923720f81c6" (UID: "6fe6f7d7-0636-4d5d-a337-c923720f81c6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:23:36.048253 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.048229 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdn2c\" (UniqueName: \"kubernetes.io/projected/6fe6f7d7-0636-4d5d-a337-c923720f81c6-kube-api-access-rdn2c\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:23:36.048253 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.048252 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:23:36.048383 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.048262 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-serving-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:23:36.048383 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.048271 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-service-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:23:36.048383 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.048281 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fe6f7d7-0636-4d5d-a337-c923720f81c6-console-oauth-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:23:36.048383 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.048289 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-oauth-serving-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:23:36.048383 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.048298 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fe6f7d7-0636-4d5d-a337-c923720f81c6-trusted-ca-bundle\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:23:36.640100 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.640059 2581 generic.go:356] "Generic (PLEG): container finished" podID="6fe6f7d7-0636-4d5d-a337-c923720f81c6" containerID="eb5185ded5fb9db1ad82ff94344cfa6cf23f5abba18df6642dfbdb0ebe67486a" exitCode=0 Jun 14 03:23:36.640449 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.640118 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbff4d758-jhkdr" Jun 14 03:23:36.640449 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.640143 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbff4d758-jhkdr" event={"ID":"6fe6f7d7-0636-4d5d-a337-c923720f81c6","Type":"ContainerDied","Data":"eb5185ded5fb9db1ad82ff94344cfa6cf23f5abba18df6642dfbdb0ebe67486a"} Jun 14 03:23:36.640449 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.640204 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbff4d758-jhkdr" event={"ID":"6fe6f7d7-0636-4d5d-a337-c923720f81c6","Type":"ContainerDied","Data":"8190c69e8f29dce397b64905383a545001a218ed4873e1082b9f645489c7119e"} Jun 14 03:23:36.640449 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.640226 2581 scope.go:117] "RemoveContainer" containerID="eb5185ded5fb9db1ad82ff94344cfa6cf23f5abba18df6642dfbdb0ebe67486a" Jun 14 03:23:36.648227 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.648198 2581 scope.go:117] "RemoveContainer" containerID="eb5185ded5fb9db1ad82ff94344cfa6cf23f5abba18df6642dfbdb0ebe67486a" Jun 14 03:23:36.648562 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:36.648543 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb5185ded5fb9db1ad82ff94344cfa6cf23f5abba18df6642dfbdb0ebe67486a\": container with ID starting with eb5185ded5fb9db1ad82ff94344cfa6cf23f5abba18df6642dfbdb0ebe67486a not found: ID does not exist" containerID="eb5185ded5fb9db1ad82ff94344cfa6cf23f5abba18df6642dfbdb0ebe67486a" Jun 14 03:23:36.648652 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.648590 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb5185ded5fb9db1ad82ff94344cfa6cf23f5abba18df6642dfbdb0ebe67486a"} err="failed to get container status \"eb5185ded5fb9db1ad82ff94344cfa6cf23f5abba18df6642dfbdb0ebe67486a\": rpc error: code = NotFound desc = could not find container \"eb5185ded5fb9db1ad82ff94344cfa6cf23f5abba18df6642dfbdb0ebe67486a\": container with ID starting with eb5185ded5fb9db1ad82ff94344cfa6cf23f5abba18df6642dfbdb0ebe67486a not found: ID does not exist" Jun 14 03:23:36.661238 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.661170 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bbff4d758-jhkdr"] Jun 14 03:23:36.663329 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:36.663307 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bbff4d758-jhkdr"] Jun 14 03:23:38.298459 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:38.298429 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fe6f7d7-0636-4d5d-a337-c923720f81c6" path="/var/lib/kubelet/pods/6fe6f7d7-0636-4d5d-a337-c923720f81c6/volumes" Jun 14 03:23:42.623573 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:42.623544 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" Jun 14 03:23:46.327859 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.327830 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd"] Jun 14 03:23:46.328229 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.328177 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fe6f7d7-0636-4d5d-a337-c923720f81c6" containerName="console" Jun 14 03:23:46.328229 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.328189 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fe6f7d7-0636-4d5d-a337-c923720f81c6" containerName="console" Jun 14 03:23:46.328229 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.328200 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b09ee8b1-06a5-4918-b69a-de7e14d25057" containerName="manager" Jun 14 03:23:46.328229 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.328205 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b09ee8b1-06a5-4918-b69a-de7e14d25057" containerName="manager" Jun 14 03:23:46.328422 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.328255 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b09ee8b1-06a5-4918-b69a-de7e14d25057" containerName="manager" Jun 14 03:23:46.328422 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.328266 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fe6f7d7-0636-4d5d-a337-c923720f81c6" containerName="console" Jun 14 03:23:46.331101 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.331081 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.333422 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.333401 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5nqr2\"" Jun 14 03:23:46.341682 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.341660 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd"] Jun 14 03:23:46.424698 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.424664 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzb4t\" (UniqueName: \"kubernetes.io/projected/490a1968-f136-43d8-877e-e72b8feaf0c5-kube-api-access-nzb4t\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.424849 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.424707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.424849 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.424774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.424849 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.424833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490a1968-f136-43d8-877e-e72b8feaf0c5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.425074 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.424893 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.425074 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.424956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.425074 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.424984 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.425074 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.425028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490a1968-f136-43d8-877e-e72b8feaf0c5-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.425340 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.425087 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490a1968-f136-43d8-877e-e72b8feaf0c5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.525649 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.525619 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490a1968-f136-43d8-877e-e72b8feaf0c5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.525778 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.525660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzb4t\" (UniqueName: \"kubernetes.io/projected/490a1968-f136-43d8-877e-e72b8feaf0c5-kube-api-access-nzb4t\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.525778 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.525680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.525778 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.525725 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.525778 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.525756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490a1968-f136-43d8-877e-e72b8feaf0c5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.525995 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.525806 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.525995 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.525877 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.526097 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.526064 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.526158 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.526103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490a1968-f136-43d8-877e-e72b8feaf0c5-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.526230 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.526204 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.526346 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.526327 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.526429 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.526334 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.526480 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.526445 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490a1968-f136-43d8-877e-e72b8feaf0c5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.526480 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.526461 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.528684 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.528662 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490a1968-f136-43d8-877e-e72b8feaf0c5-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.529009 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.528989 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490a1968-f136-43d8-877e-e72b8feaf0c5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.533943 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.533907 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490a1968-f136-43d8-877e-e72b8feaf0c5-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.534089 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.534072 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzb4t\" (UniqueName: \"kubernetes.io/projected/490a1968-f136-43d8-877e-e72b8feaf0c5-kube-api-access-nzb4t\") pod \"maas-default-gateway-openshift-default-687ff6996-lwpgd\" (UID: \"490a1968-f136-43d8-877e-e72b8feaf0c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.642624 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.642600 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:46.783718 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.783576 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd"] Jun 14 03:23:46.786518 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:23:46.786485 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490a1968_f136_43d8_877e_e72b8feaf0c5.slice/crio-0eea07ec2947fc593e9a2046a62e799cf3d2be433d4d44f2769cb2a1349e8c26 WatchSource:0}: Error finding container 0eea07ec2947fc593e9a2046a62e799cf3d2be433d4d44f2769cb2a1349e8c26: Status 404 returned error can't find the container with id 0eea07ec2947fc593e9a2046a62e799cf3d2be433d4d44f2769cb2a1349e8c26 Jun 14 03:23:46.788903 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.788865 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:23:46.789025 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.788965 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:23:46.789025 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:46.789008 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:23:47.693102 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:47.693067 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" event={"ID":"490a1968-f136-43d8-877e-e72b8feaf0c5","Type":"ContainerStarted","Data":"030b76801362d6431c0c5a5a42998388a1afa789778bf050375e0b89a9d0e933"} Jun 14 03:23:47.693600 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:47.693117 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" event={"ID":"490a1968-f136-43d8-877e-e72b8feaf0c5","Type":"ContainerStarted","Data":"0eea07ec2947fc593e9a2046a62e799cf3d2be433d4d44f2769cb2a1349e8c26"} Jun 14 03:23:47.713776 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:47.713730 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" podStartSLOduration=1.71371623 podStartE2EDuration="1.71371623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:23:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:23:47.711597931 +0000 UTC m=+637.870740834" watchObservedRunningTime="2026-06-14 03:23:47.71371623 +0000 UTC m=+637.872859193" Jun 14 03:23:48.643664 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.643632 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:48.648823 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.648803 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:48.696248 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.696216 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-82d92"] Jun 14 03:23:48.698781 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.698760 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:48.698911 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.698841 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" Jun 14 03:23:48.699164 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.699143 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:23:48.701398 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.701377 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5gm2z\"" Jun 14 03:23:48.701398 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.701396 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 03:23:48.707340 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.707316 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-82d92"] Jun 14 03:23:48.745440 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.745404 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqpmq\" (UniqueName: \"kubernetes.io/projected/e75320d3-c952-4793-83db-c545a5a323d8-kube-api-access-tqpmq\") pod \"limitador-limitador-64c94fd64f-82d92\" (UID: \"e75320d3-c952-4793-83db-c545a5a323d8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" Jun 14 03:23:48.745699 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.745679 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e75320d3-c952-4793-83db-c545a5a323d8-config-file\") pod \"limitador-limitador-64c94fd64f-82d92\" (UID: \"e75320d3-c952-4793-83db-c545a5a323d8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" Jun 14 03:23:48.795253 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.795186 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-82d92"] Jun 14 03:23:48.846334 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.846306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqpmq\" (UniqueName: \"kubernetes.io/projected/e75320d3-c952-4793-83db-c545a5a323d8-kube-api-access-tqpmq\") pod \"limitador-limitador-64c94fd64f-82d92\" (UID: \"e75320d3-c952-4793-83db-c545a5a323d8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" Jun 14 03:23:48.846462 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.846368 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e75320d3-c952-4793-83db-c545a5a323d8-config-file\") pod \"limitador-limitador-64c94fd64f-82d92\" (UID: \"e75320d3-c952-4793-83db-c545a5a323d8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" Jun 14 03:23:48.846910 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.846892 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e75320d3-c952-4793-83db-c545a5a323d8-config-file\") pod \"limitador-limitador-64c94fd64f-82d92\" (UID: \"e75320d3-c952-4793-83db-c545a5a323d8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" Jun 14 03:23:48.853856 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:48.853825 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqpmq\" (UniqueName: \"kubernetes.io/projected/e75320d3-c952-4793-83db-c545a5a323d8-kube-api-access-tqpmq\") pod \"limitador-limitador-64c94fd64f-82d92\" (UID: \"e75320d3-c952-4793-83db-c545a5a323d8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" Jun 14 03:23:49.009984 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.009951 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" Jun 14 03:23:49.143011 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.142987 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-82d92"] Jun 14 03:23:49.145155 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:23:49.145116 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75320d3_c952_4793_83db_c545a5a323d8.slice/crio-cd27a7efa1380546f6c9b089c767606cd733c532badbd534f40522662a56ef1d WatchSource:0}: Error finding container cd27a7efa1380546f6c9b089c767606cd733c532badbd534f40522662a56ef1d: Status 404 returned error can't find the container with id cd27a7efa1380546f6c9b089c767606cd733c532badbd534f40522662a56ef1d Jun 14 03:23:49.521697 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.521664 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-x4fxl"] Jun 14 03:23:49.524303 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.524281 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-x4fxl" Jun 14 03:23:49.526814 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.526793 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pq98c\"" Jun 14 03:23:49.531824 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.531729 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-x4fxl"] Jun 14 03:23:49.552191 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.552163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8854\" (UniqueName: \"kubernetes.io/projected/c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06-kube-api-access-m8854\") pod \"authorino-58cd955675-x4fxl\" (UID: \"c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06\") " pod="kuadrant-system/authorino-58cd955675-x4fxl" Jun 14 03:23:49.653009 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.652975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8854\" (UniqueName: \"kubernetes.io/projected/c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06-kube-api-access-m8854\") pod \"authorino-58cd955675-x4fxl\" (UID: \"c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06\") " pod="kuadrant-system/authorino-58cd955675-x4fxl" Jun 14 03:23:49.663016 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.662986 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8854\" (UniqueName: \"kubernetes.io/projected/c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06-kube-api-access-m8854\") pod \"authorino-58cd955675-x4fxl\" (UID: \"c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06\") " pod="kuadrant-system/authorino-58cd955675-x4fxl" Jun 14 03:23:49.668786 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.668764 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-ht9wj"] Jun 14 03:23:49.671125 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.671109 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ht9wj" Jun 14 03:23:49.678418 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.678387 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ht9wj"] Jun 14 03:23:49.704044 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.704021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" event={"ID":"e75320d3-c952-4793-83db-c545a5a323d8","Type":"ContainerStarted","Data":"cd27a7efa1380546f6c9b089c767606cd733c532badbd534f40522662a56ef1d"} Jun 14 03:23:49.753395 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.753373 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k98d\" (UniqueName: \"kubernetes.io/projected/8b91238a-b5b5-45eb-b622-4bcdaa4a59cc-kube-api-access-4k98d\") pod \"authorino-75d556bd77-ht9wj\" (UID: \"8b91238a-b5b5-45eb-b622-4bcdaa4a59cc\") " pod="kuadrant-system/authorino-75d556bd77-ht9wj" Jun 14 03:23:49.834451 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.834400 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-x4fxl" Jun 14 03:23:49.854319 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.854294 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k98d\" (UniqueName: \"kubernetes.io/projected/8b91238a-b5b5-45eb-b622-4bcdaa4a59cc-kube-api-access-4k98d\") pod \"authorino-75d556bd77-ht9wj\" (UID: \"8b91238a-b5b5-45eb-b622-4bcdaa4a59cc\") " pod="kuadrant-system/authorino-75d556bd77-ht9wj" Jun 14 03:23:49.863611 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.863562 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k98d\" (UniqueName: \"kubernetes.io/projected/8b91238a-b5b5-45eb-b622-4bcdaa4a59cc-kube-api-access-4k98d\") pod \"authorino-75d556bd77-ht9wj\" (UID: \"8b91238a-b5b5-45eb-b622-4bcdaa4a59cc\") " pod="kuadrant-system/authorino-75d556bd77-ht9wj" Jun 14 03:23:49.980780 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:49.980742 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ht9wj" Jun 14 03:23:50.011525 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:50.011405 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-x4fxl"] Jun 14 03:23:50.012885 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:23:50.012805 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8e64de1_6b0e_4216_9ed3_d70f7ae6dd06.slice/crio-d549466a634028e37331f341b0bf39106973fda8c2cbb68aafaf931842d1cace WatchSource:0}: Error finding container d549466a634028e37331f341b0bf39106973fda8c2cbb68aafaf931842d1cace: Status 404 returned error can't find the container with id d549466a634028e37331f341b0bf39106973fda8c2cbb68aafaf931842d1cace Jun 14 03:23:50.181498 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:50.181467 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ht9wj"] Jun 14 03:23:50.184873 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:23:50.184841 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b91238a_b5b5_45eb_b622_4bcdaa4a59cc.slice/crio-3c612bb036151e1e0df17e583dfdf4ddd3de6c1e7841104c7c69deebed1ccd1a WatchSource:0}: Error finding container 3c612bb036151e1e0df17e583dfdf4ddd3de6c1e7841104c7c69deebed1ccd1a: Status 404 returned error can't find the container with id 3c612bb036151e1e0df17e583dfdf4ddd3de6c1e7841104c7c69deebed1ccd1a Jun 14 03:23:50.713534 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:50.713498 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ht9wj" event={"ID":"8b91238a-b5b5-45eb-b622-4bcdaa4a59cc","Type":"ContainerStarted","Data":"3c612bb036151e1e0df17e583dfdf4ddd3de6c1e7841104c7c69deebed1ccd1a"} Jun 14 03:23:50.715675 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:50.715648 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-x4fxl" event={"ID":"c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06","Type":"ContainerStarted","Data":"d549466a634028e37331f341b0bf39106973fda8c2cbb68aafaf931842d1cace"} Jun 14 03:23:54.742638 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:54.742553 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ht9wj" event={"ID":"8b91238a-b5b5-45eb-b622-4bcdaa4a59cc","Type":"ContainerStarted","Data":"071d2266ccbd84e88dfbfb974177ad0a30b128147e75a4cd15cdc2d3d9f60d3e"} Jun 14 03:23:54.744071 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:54.744045 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-x4fxl" event={"ID":"c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06","Type":"ContainerStarted","Data":"da6c3c4306b281f057b90e2193c500050c44682336e7767de3b3c033444e3db5"} Jun 14 03:23:54.745539 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:54.745518 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" event={"ID":"e75320d3-c952-4793-83db-c545a5a323d8","Type":"ContainerStarted","Data":"02d4e75f420925c1c7c69c7f3fbbd98616019ed3a2b96b3eba36b98a343aa028"} Jun 14 03:23:54.745638 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:54.745578 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" Jun 14 03:23:54.758181 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:54.758139 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-ht9wj" podStartSLOduration=1.522995227 podStartE2EDuration="5.758126515s" totalImagesPullingTime="4.235131288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:23:54.756527752 +0000 UTC m=+644.915670658" watchObservedRunningTime="2026-06-14 03:23:54.758126515 +0000 UTC m=+644.917269419" Jun 14 03:23:54.771692 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:54.771642 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-x4fxl" podStartSLOduration=1.3965330200000001 podStartE2EDuration="5.771626602s" totalImagesPullingTime="4.375093582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:23:54.769891512 +0000 UTC m=+644.929034418" watchObservedRunningTime="2026-06-14 03:23:54.771626602 +0000 UTC m=+644.930769506" Jun 14 03:23:54.786900 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:54.786853 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" podStartSLOduration=1.5031848349999999 podStartE2EDuration="6.786839394s" totalImagesPullingTime="5.283654559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:23:54.784273199 +0000 UTC m=+644.943416104" watchObservedRunningTime="2026-06-14 03:23:54.786839394 +0000 UTC m=+644.945982298" Jun 14 03:23:54.801732 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:54.801706 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-x4fxl"] Jun 14 03:23:56.754255 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:56.754212 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-x4fxl" podUID="c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06" containerName="authorino" containerID="cri-o://da6c3c4306b281f057b90e2193c500050c44682336e7767de3b3c033444e3db5" gracePeriod=30 Jun 14 03:23:56.999912 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:56.999887 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-x4fxl" Jun 14 03:23:57.123611 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:57.123585 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8854\" (UniqueName: \"kubernetes.io/projected/c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06-kube-api-access-m8854\") pod \"c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06\" (UID: \"c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06\") " Jun 14 03:23:57.125679 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:57.125648 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06-kube-api-access-m8854" (OuterVolumeSpecName: "kube-api-access-m8854") pod "c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06" (UID: "c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06"). InnerVolumeSpecName "kube-api-access-m8854". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:23:57.224738 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:57.224703 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8854\" (UniqueName: \"kubernetes.io/projected/c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06-kube-api-access-m8854\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:23:57.760105 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:57.760061 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06" containerID="da6c3c4306b281f057b90e2193c500050c44682336e7767de3b3c033444e3db5" exitCode=0 Jun 14 03:23:57.760105 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:57.760106 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-x4fxl" Jun 14 03:23:57.760543 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:57.760111 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-x4fxl" event={"ID":"c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06","Type":"ContainerDied","Data":"da6c3c4306b281f057b90e2193c500050c44682336e7767de3b3c033444e3db5"} Jun 14 03:23:57.760543 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:57.760223 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-x4fxl" event={"ID":"c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06","Type":"ContainerDied","Data":"d549466a634028e37331f341b0bf39106973fda8c2cbb68aafaf931842d1cace"} Jun 14 03:23:57.760543 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:57.760244 2581 scope.go:117] "RemoveContainer" containerID="da6c3c4306b281f057b90e2193c500050c44682336e7767de3b3c033444e3db5" Jun 14 03:23:57.768830 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:57.768812 2581 scope.go:117] "RemoveContainer" containerID="da6c3c4306b281f057b90e2193c500050c44682336e7767de3b3c033444e3db5" Jun 14 03:23:57.769092 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:23:57.769074 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da6c3c4306b281f057b90e2193c500050c44682336e7767de3b3c033444e3db5\": container with ID starting with da6c3c4306b281f057b90e2193c500050c44682336e7767de3b3c033444e3db5 not found: ID does not exist" containerID="da6c3c4306b281f057b90e2193c500050c44682336e7767de3b3c033444e3db5" Jun 14 03:23:57.769142 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:57.769101 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da6c3c4306b281f057b90e2193c500050c44682336e7767de3b3c033444e3db5"} err="failed to get container status \"da6c3c4306b281f057b90e2193c500050c44682336e7767de3b3c033444e3db5\": rpc error: code = NotFound desc = could not find container \"da6c3c4306b281f057b90e2193c500050c44682336e7767de3b3c033444e3db5\": container with ID starting with da6c3c4306b281f057b90e2193c500050c44682336e7767de3b3c033444e3db5 not found: ID does not exist" Jun 14 03:23:57.780578 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:57.780554 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-x4fxl"] Jun 14 03:23:57.785751 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:57.785732 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-x4fxl"] Jun 14 03:23:58.299364 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:23:58.299332 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06" path="/var/lib/kubelet/pods/c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06/volumes" Jun 14 03:24:04.213375 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.213340 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-82d92"] Jun 14 03:24:04.213759 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.213525 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" podUID="e75320d3-c952-4793-83db-c545a5a323d8" containerName="limitador" containerID="cri-o://02d4e75f420925c1c7c69c7f3fbbd98616019ed3a2b96b3eba36b98a343aa028" gracePeriod=30 Jun 14 03:24:04.214230 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.214211 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" Jun 14 03:24:04.753889 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.753865 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" Jun 14 03:24:04.798723 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.798647 2581 generic.go:356] "Generic (PLEG): container finished" podID="e75320d3-c952-4793-83db-c545a5a323d8" containerID="02d4e75f420925c1c7c69c7f3fbbd98616019ed3a2b96b3eba36b98a343aa028" exitCode=0 Jun 14 03:24:04.798723 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.798685 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" Jun 14 03:24:04.798872 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.798741 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" event={"ID":"e75320d3-c952-4793-83db-c545a5a323d8","Type":"ContainerDied","Data":"02d4e75f420925c1c7c69c7f3fbbd98616019ed3a2b96b3eba36b98a343aa028"} Jun 14 03:24:04.798872 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.798790 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-82d92" event={"ID":"e75320d3-c952-4793-83db-c545a5a323d8","Type":"ContainerDied","Data":"cd27a7efa1380546f6c9b089c767606cd733c532badbd534f40522662a56ef1d"} Jun 14 03:24:04.798872 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.798814 2581 scope.go:117] "RemoveContainer" containerID="02d4e75f420925c1c7c69c7f3fbbd98616019ed3a2b96b3eba36b98a343aa028" Jun 14 03:24:04.807282 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.807266 2581 scope.go:117] "RemoveContainer" containerID="02d4e75f420925c1c7c69c7f3fbbd98616019ed3a2b96b3eba36b98a343aa028" Jun 14 03:24:04.807539 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:24:04.807521 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02d4e75f420925c1c7c69c7f3fbbd98616019ed3a2b96b3eba36b98a343aa028\": container with ID starting with 02d4e75f420925c1c7c69c7f3fbbd98616019ed3a2b96b3eba36b98a343aa028 not found: ID does not exist" containerID="02d4e75f420925c1c7c69c7f3fbbd98616019ed3a2b96b3eba36b98a343aa028" Jun 14 03:24:04.807587 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.807549 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02d4e75f420925c1c7c69c7f3fbbd98616019ed3a2b96b3eba36b98a343aa028"} err="failed to get container status \"02d4e75f420925c1c7c69c7f3fbbd98616019ed3a2b96b3eba36b98a343aa028\": rpc error: code = NotFound desc = could not find container \"02d4e75f420925c1c7c69c7f3fbbd98616019ed3a2b96b3eba36b98a343aa028\": container with ID starting with 02d4e75f420925c1c7c69c7f3fbbd98616019ed3a2b96b3eba36b98a343aa028 not found: ID does not exist" Jun 14 03:24:04.887159 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.887139 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e75320d3-c952-4793-83db-c545a5a323d8-config-file\") pod \"e75320d3-c952-4793-83db-c545a5a323d8\" (UID: \"e75320d3-c952-4793-83db-c545a5a323d8\") " Jun 14 03:24:04.887280 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.887229 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqpmq\" (UniqueName: \"kubernetes.io/projected/e75320d3-c952-4793-83db-c545a5a323d8-kube-api-access-tqpmq\") pod \"e75320d3-c952-4793-83db-c545a5a323d8\" (UID: \"e75320d3-c952-4793-83db-c545a5a323d8\") " Jun 14 03:24:04.887502 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.887478 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e75320d3-c952-4793-83db-c545a5a323d8-config-file" (OuterVolumeSpecName: "config-file") pod "e75320d3-c952-4793-83db-c545a5a323d8" (UID: "e75320d3-c952-4793-83db-c545a5a323d8"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:24:04.889496 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.889469 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e75320d3-c952-4793-83db-c545a5a323d8-kube-api-access-tqpmq" (OuterVolumeSpecName: "kube-api-access-tqpmq") pod "e75320d3-c952-4793-83db-c545a5a323d8" (UID: "e75320d3-c952-4793-83db-c545a5a323d8"). InnerVolumeSpecName "kube-api-access-tqpmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:24:04.988167 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.988137 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqpmq\" (UniqueName: \"kubernetes.io/projected/e75320d3-c952-4793-83db-c545a5a323d8-kube-api-access-tqpmq\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:24:04.988167 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:04.988163 2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e75320d3-c952-4793-83db-c545a5a323d8-config-file\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:24:05.120561 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:05.120534 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-82d92"] Jun 14 03:24:05.123629 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:05.123608 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-82d92"] Jun 14 03:24:06.299497 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:06.299458 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e75320d3-c952-4793-83db-c545a5a323d8" path="/var/lib/kubelet/pods/e75320d3-c952-4793-83db-c545a5a323d8/volumes" Jun 14 03:24:10.241549 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.241514 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-gh8n8"] Jun 14 03:24:10.242022 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.241872 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e75320d3-c952-4793-83db-c545a5a323d8" containerName="limitador" Jun 14 03:24:10.242022 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.241885 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e75320d3-c952-4793-83db-c545a5a323d8" containerName="limitador" Jun 14 03:24:10.242022 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.241897 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06" containerName="authorino" Jun 14 03:24:10.242022 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.241903 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06" containerName="authorino" Jun 14 03:24:10.242022 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.241979 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e75320d3-c952-4793-83db-c545a5a323d8" containerName="limitador" Jun 14 03:24:10.242022 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.241988 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e64de1-6b0e-4216-9ed3-d70f7ae6dd06" containerName="authorino" Jun 14 03:24:10.246523 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.246498 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-gh8n8" Jun 14 03:24:10.249064 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.249041 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 14 03:24:10.253553 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.253525 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-gh8n8"] Jun 14 03:24:10.332593 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.332561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7h2v\" (UniqueName: \"kubernetes.io/projected/7521b465-499f-41cd-9f2a-6e9af60cce65-kube-api-access-x7h2v\") pod \"postgres-69fb4594cf-gh8n8\" (UID: \"7521b465-499f-41cd-9f2a-6e9af60cce65\") " pod="opendatahub/postgres-69fb4594cf-gh8n8" Jun 14 03:24:10.332722 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.332696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7521b465-499f-41cd-9f2a-6e9af60cce65-data\") pod \"postgres-69fb4594cf-gh8n8\" (UID: \"7521b465-499f-41cd-9f2a-6e9af60cce65\") " pod="opendatahub/postgres-69fb4594cf-gh8n8" Jun 14 03:24:10.433761 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.433731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7h2v\" (UniqueName: \"kubernetes.io/projected/7521b465-499f-41cd-9f2a-6e9af60cce65-kube-api-access-x7h2v\") pod \"postgres-69fb4594cf-gh8n8\" (UID: \"7521b465-499f-41cd-9f2a-6e9af60cce65\") " pod="opendatahub/postgres-69fb4594cf-gh8n8" Jun 14 03:24:10.433893 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.433800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7521b465-499f-41cd-9f2a-6e9af60cce65-data\") pod \"postgres-69fb4594cf-gh8n8\" (UID: \"7521b465-499f-41cd-9f2a-6e9af60cce65\") " pod="opendatahub/postgres-69fb4594cf-gh8n8" Jun 14 03:24:10.434137 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.434120 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7521b465-499f-41cd-9f2a-6e9af60cce65-data\") pod \"postgres-69fb4594cf-gh8n8\" (UID: \"7521b465-499f-41cd-9f2a-6e9af60cce65\") " pod="opendatahub/postgres-69fb4594cf-gh8n8" Jun 14 03:24:10.442109 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.442083 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7h2v\" (UniqueName: \"kubernetes.io/projected/7521b465-499f-41cd-9f2a-6e9af60cce65-kube-api-access-x7h2v\") pod \"postgres-69fb4594cf-gh8n8\" (UID: \"7521b465-499f-41cd-9f2a-6e9af60cce65\") " pod="opendatahub/postgres-69fb4594cf-gh8n8" Jun 14 03:24:10.561524 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.561451 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-gh8n8" Jun 14 03:24:10.696569 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.696542 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-gh8n8"] Jun 14 03:24:10.698262 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:24:10.698226 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7521b465_499f_41cd_9f2a_6e9af60cce65.slice/crio-47e0d8d25d8038eff63fa24ba81a7ece3919a0f3aac0c507d0a97f1ab79f7440 WatchSource:0}: Error finding container 47e0d8d25d8038eff63fa24ba81a7ece3919a0f3aac0c507d0a97f1ab79f7440: Status 404 returned error can't find the container with id 47e0d8d25d8038eff63fa24ba81a7ece3919a0f3aac0c507d0a97f1ab79f7440 Jun 14 03:24:10.829320 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:10.829231 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-gh8n8" event={"ID":"7521b465-499f-41cd-9f2a-6e9af60cce65","Type":"ContainerStarted","Data":"47e0d8d25d8038eff63fa24ba81a7ece3919a0f3aac0c507d0a97f1ab79f7440"} Jun 14 03:24:13.843804 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:13.843771 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-gh8n8" event={"ID":"7521b465-499f-41cd-9f2a-6e9af60cce65","Type":"ContainerStarted","Data":"8350d3a505f0c89f83cdeee01371b7e330c1ab05e811abcc4f4915622a5382d6"} Jun 14 03:24:13.844346 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:13.843859 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-gh8n8" Jun 14 03:24:13.860831 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:13.860787 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-gh8n8" podStartSLOduration=1.6956017920000002 podStartE2EDuration="3.860774051s" totalImagesPullingTime="2.165172259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:24:13.859422183 +0000 UTC m=+664.018565087" watchObservedRunningTime="2026-06-14 03:24:13.860774051 +0000 UTC m=+664.019916955" Jun 14 03:24:19.880977 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:19.880948 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-gh8n8" Jun 14 03:24:30.165057 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:30.165025 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-cf6zb"] Jun 14 03:24:30.167182 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:30.167166 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-cf6zb" Jun 14 03:24:30.170072 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:30.170048 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-rc4hc\"" Jun 14 03:24:30.170182 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:30.170069 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 03:24:30.170182 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:30.170071 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 03:24:30.175476 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:30.175446 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-cf6zb"] Jun 14 03:24:30.296673 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:30.296643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jh7p\" (UniqueName: \"kubernetes.io/projected/d77bfdbe-6447-4fb5-9a1c-d0c17f679d56-kube-api-access-5jh7p\") pod \"keycloak-operator-d67dbbb48-cf6zb\" (UID: \"d77bfdbe-6447-4fb5-9a1c-d0c17f679d56\") " pod="keycloak-system/keycloak-operator-d67dbbb48-cf6zb" Jun 14 03:24:30.397693 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:30.397662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jh7p\" (UniqueName: \"kubernetes.io/projected/d77bfdbe-6447-4fb5-9a1c-d0c17f679d56-kube-api-access-5jh7p\") pod \"keycloak-operator-d67dbbb48-cf6zb\" (UID: \"d77bfdbe-6447-4fb5-9a1c-d0c17f679d56\") " pod="keycloak-system/keycloak-operator-d67dbbb48-cf6zb" Jun 14 03:24:30.415432 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:30.415360 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jh7p\" (UniqueName: \"kubernetes.io/projected/d77bfdbe-6447-4fb5-9a1c-d0c17f679d56-kube-api-access-5jh7p\") pod \"keycloak-operator-d67dbbb48-cf6zb\" (UID: \"d77bfdbe-6447-4fb5-9a1c-d0c17f679d56\") " pod="keycloak-system/keycloak-operator-d67dbbb48-cf6zb" Jun 14 03:24:30.477501 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:30.477475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-cf6zb" Jun 14 03:24:30.621993 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:30.620195 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-cf6zb"] Jun 14 03:24:30.920237 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:30.920203 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-cf6zb" event={"ID":"d77bfdbe-6447-4fb5-9a1c-d0c17f679d56","Type":"ContainerStarted","Data":"d201d0c9ed11f808d01a09ec52fbcfb7c373301ca18643fb478962cbd1b1ec20"} Jun 14 03:24:36.959307 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:36.959272 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-cf6zb" event={"ID":"d77bfdbe-6447-4fb5-9a1c-d0c17f679d56","Type":"ContainerStarted","Data":"f3e4375ca4460a8052570a45afe510f88a10e94e57a708b56c203839352c5f48"} Jun 14 03:24:36.978064 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:24:36.978010 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-cf6zb" podStartSLOduration=0.814873903 podStartE2EDuration="6.977993877s" totalImagesPullingTime="6.163119974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:24:36.975657889 +0000 UTC m=+687.134800793" watchObservedRunningTime="2026-06-14 03:24:36.977993877 +0000 UTC m=+687.137136781" Jun 14 03:25:16.064145 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.064104 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5tbpr"] Jun 14 03:25:16.071296 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.071271 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5tbpr" Jun 14 03:25:16.073846 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.073821 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5tbpr"] Jun 14 03:25:16.099534 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.099507 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmpgf\" (UniqueName: \"kubernetes.io/projected/e10fbe03-5909-47fa-863d-093a76656862-kube-api-access-bmpgf\") pod \"authorino-5d4b67c446-5tbpr\" (UID: \"e10fbe03-5909-47fa-863d-093a76656862\") " pod="kuadrant-system/authorino-5d4b67c446-5tbpr" Jun 14 03:25:16.200249 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.200217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmpgf\" (UniqueName: \"kubernetes.io/projected/e10fbe03-5909-47fa-863d-093a76656862-kube-api-access-bmpgf\") pod \"authorino-5d4b67c446-5tbpr\" (UID: \"e10fbe03-5909-47fa-863d-093a76656862\") " pod="kuadrant-system/authorino-5d4b67c446-5tbpr" Jun 14 03:25:16.208796 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.208770 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmpgf\" (UniqueName: \"kubernetes.io/projected/e10fbe03-5909-47fa-863d-093a76656862-kube-api-access-bmpgf\") pod \"authorino-5d4b67c446-5tbpr\" (UID: \"e10fbe03-5909-47fa-863d-093a76656862\") " pod="kuadrant-system/authorino-5d4b67c446-5tbpr" Jun 14 03:25:16.325657 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.325576 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5tbpr"] Jun 14 03:25:16.325820 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.325809 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5tbpr" Jun 14 03:25:16.371717 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.371685 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f5c8bf5c-6n6r2"] Jun 14 03:25:16.374171 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.374151 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f5c8bf5c-6n6r2" Jun 14 03:25:16.395897 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.395853 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f5c8bf5c-6n6r2"] Jun 14 03:25:16.401995 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.401969 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9cw8\" (UniqueName: \"kubernetes.io/projected/7d3082b8-591c-4b30-8f75-2b333e9a69ce-kube-api-access-b9cw8\") pod \"authorino-5f5c8bf5c-6n6r2\" (UID: \"7d3082b8-591c-4b30-8f75-2b333e9a69ce\") " pod="kuadrant-system/authorino-5f5c8bf5c-6n6r2" Jun 14 03:25:16.464026 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.464005 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5tbpr"] Jun 14 03:25:16.466425 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:25:16.466397 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode10fbe03_5909_47fa_863d_093a76656862.slice/crio-ff1f2dfe62a0e57e5a09245806589a6b9c146eb237aff0fbec6130bb5f92753e WatchSource:0}: Error finding container ff1f2dfe62a0e57e5a09245806589a6b9c146eb237aff0fbec6130bb5f92753e: Status 404 returned error can't find the container with id ff1f2dfe62a0e57e5a09245806589a6b9c146eb237aff0fbec6130bb5f92753e Jun 14 03:25:16.502588 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.502562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9cw8\" (UniqueName: \"kubernetes.io/projected/7d3082b8-591c-4b30-8f75-2b333e9a69ce-kube-api-access-b9cw8\") pod \"authorino-5f5c8bf5c-6n6r2\" (UID: \"7d3082b8-591c-4b30-8f75-2b333e9a69ce\") " pod="kuadrant-system/authorino-5f5c8bf5c-6n6r2" Jun 14 03:25:16.510985 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.510957 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9cw8\" (UniqueName: \"kubernetes.io/projected/7d3082b8-591c-4b30-8f75-2b333e9a69ce-kube-api-access-b9cw8\") pod \"authorino-5f5c8bf5c-6n6r2\" (UID: \"7d3082b8-591c-4b30-8f75-2b333e9a69ce\") " pod="kuadrant-system/authorino-5f5c8bf5c-6n6r2" Jun 14 03:25:16.613575 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.613539 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f5c8bf5c-6n6r2"] Jun 14 03:25:16.613819 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.613804 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f5c8bf5c-6n6r2" Jun 14 03:25:16.637323 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.637291 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-785546848f-x8qgb"] Jun 14 03:25:16.639922 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.639900 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-785546848f-x8qgb" Jun 14 03:25:16.642376 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.642354 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 14 03:25:16.647643 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.647549 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-785546848f-x8qgb"] Jun 14 03:25:16.704689 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.704411 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfljx\" (UniqueName: \"kubernetes.io/projected/7a609cc3-6a7a-4e38-87b5-020c3d0ec24c-kube-api-access-vfljx\") pod \"authorino-785546848f-x8qgb\" (UID: \"7a609cc3-6a7a-4e38-87b5-020c3d0ec24c\") " pod="kuadrant-system/authorino-785546848f-x8qgb" Jun 14 03:25:16.704689 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.704491 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a609cc3-6a7a-4e38-87b5-020c3d0ec24c-tls-cert\") pod \"authorino-785546848f-x8qgb\" (UID: \"7a609cc3-6a7a-4e38-87b5-020c3d0ec24c\") " pod="kuadrant-system/authorino-785546848f-x8qgb" Jun 14 03:25:16.750762 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.750734 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f5c8bf5c-6n6r2"] Jun 14 03:25:16.752890 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:25:16.752859 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d3082b8_591c_4b30_8f75_2b333e9a69ce.slice/crio-0d46b10ec0424aecddc1848f2257e7f6c2d5926078f7e4422b9190caa3b8d5dc WatchSource:0}: Error finding container 0d46b10ec0424aecddc1848f2257e7f6c2d5926078f7e4422b9190caa3b8d5dc: Status 404 returned error can't find the container with id 0d46b10ec0424aecddc1848f2257e7f6c2d5926078f7e4422b9190caa3b8d5dc Jun 14 03:25:16.805080 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.805048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfljx\" (UniqueName: \"kubernetes.io/projected/7a609cc3-6a7a-4e38-87b5-020c3d0ec24c-kube-api-access-vfljx\") pod \"authorino-785546848f-x8qgb\" (UID: \"7a609cc3-6a7a-4e38-87b5-020c3d0ec24c\") " pod="kuadrant-system/authorino-785546848f-x8qgb" Jun 14 03:25:16.805222 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.805136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a609cc3-6a7a-4e38-87b5-020c3d0ec24c-tls-cert\") pod \"authorino-785546848f-x8qgb\" (UID: \"7a609cc3-6a7a-4e38-87b5-020c3d0ec24c\") " pod="kuadrant-system/authorino-785546848f-x8qgb" Jun 14 03:25:16.807638 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.807609 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a609cc3-6a7a-4e38-87b5-020c3d0ec24c-tls-cert\") pod \"authorino-785546848f-x8qgb\" (UID: \"7a609cc3-6a7a-4e38-87b5-020c3d0ec24c\") " pod="kuadrant-system/authorino-785546848f-x8qgb" Jun 14 03:25:16.813262 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.813240 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfljx\" (UniqueName: \"kubernetes.io/projected/7a609cc3-6a7a-4e38-87b5-020c3d0ec24c-kube-api-access-vfljx\") pod \"authorino-785546848f-x8qgb\" (UID: \"7a609cc3-6a7a-4e38-87b5-020c3d0ec24c\") " pod="kuadrant-system/authorino-785546848f-x8qgb" Jun 14 03:25:16.952460 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:16.952433 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-785546848f-x8qgb" Jun 14 03:25:17.093951 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:17.093906 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-785546848f-x8qgb"] Jun 14 03:25:17.096921 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:25:17.096893 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a609cc3_6a7a_4e38_87b5_020c3d0ec24c.slice/crio-f4ded77a6941c05f5bd5405435130286213c4645350396b0815925d75c3ab714 WatchSource:0}: Error finding container f4ded77a6941c05f5bd5405435130286213c4645350396b0815925d75c3ab714: Status 404 returned error can't find the container with id f4ded77a6941c05f5bd5405435130286213c4645350396b0815925d75c3ab714 Jun 14 03:25:17.148103 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:17.148034 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-785546848f-x8qgb" event={"ID":"7a609cc3-6a7a-4e38-87b5-020c3d0ec24c","Type":"ContainerStarted","Data":"f4ded77a6941c05f5bd5405435130286213c4645350396b0815925d75c3ab714"} Jun 14 03:25:17.149196 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:17.149171 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f5c8bf5c-6n6r2" event={"ID":"7d3082b8-591c-4b30-8f75-2b333e9a69ce","Type":"ContainerStarted","Data":"0d46b10ec0424aecddc1848f2257e7f6c2d5926078f7e4422b9190caa3b8d5dc"} Jun 14 03:25:17.150607 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:17.150581 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5tbpr" event={"ID":"e10fbe03-5909-47fa-863d-093a76656862","Type":"ContainerStarted","Data":"e5f6158690f11f8947433c90eba5187f1ef0462ab390246fd35e066d07178a20"} Jun 14 03:25:17.150699 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:17.150606 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-5tbpr" podUID="e10fbe03-5909-47fa-863d-093a76656862" containerName="authorino" containerID="cri-o://e5f6158690f11f8947433c90eba5187f1ef0462ab390246fd35e066d07178a20" gracePeriod=30 Jun 14 03:25:17.150699 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:17.150619 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5tbpr" event={"ID":"e10fbe03-5909-47fa-863d-093a76656862","Type":"ContainerStarted","Data":"ff1f2dfe62a0e57e5a09245806589a6b9c146eb237aff0fbec6130bb5f92753e"} Jun 14 03:25:17.166888 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:17.166829 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-5tbpr" podStartSLOduration=0.783603517 podStartE2EDuration="1.166815273s" totalImagesPullingTime="383.211756ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:25:17.165556981 +0000 UTC m=+727.324699887" watchObservedRunningTime="2026-06-14 03:25:17.166815273 +0000 UTC m=+727.325958176" Jun 14 03:25:17.408237 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:17.408209 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5tbpr" Jun 14 03:25:17.511049 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:17.511008 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmpgf\" (UniqueName: \"kubernetes.io/projected/e10fbe03-5909-47fa-863d-093a76656862-kube-api-access-bmpgf\") pod \"e10fbe03-5909-47fa-863d-093a76656862\" (UID: \"e10fbe03-5909-47fa-863d-093a76656862\") " Jun 14 03:25:17.513901 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:17.513871 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e10fbe03-5909-47fa-863d-093a76656862-kube-api-access-bmpgf" (OuterVolumeSpecName: "kube-api-access-bmpgf") pod "e10fbe03-5909-47fa-863d-093a76656862" (UID: "e10fbe03-5909-47fa-863d-093a76656862"). InnerVolumeSpecName "kube-api-access-bmpgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:25:17.612485 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:17.612449 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmpgf\" (UniqueName: \"kubernetes.io/projected/e10fbe03-5909-47fa-863d-093a76656862-kube-api-access-bmpgf\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:25:18.156359 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.156326 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-785546848f-x8qgb" event={"ID":"7a609cc3-6a7a-4e38-87b5-020c3d0ec24c","Type":"ContainerStarted","Data":"4dc2d9c189e24ef680e7cc23203ed47efc40db874a4aa666b014673b25710f9c"} Jun 14 03:25:18.157883 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.157857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f5c8bf5c-6n6r2" event={"ID":"7d3082b8-591c-4b30-8f75-2b333e9a69ce","Type":"ContainerStarted","Data":"abef45ecc004d85967bbff0124ca2571b8b375c49ae6f6c60b3bcc4ff6d6e6d9"} Jun 14 03:25:18.158028 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.157886 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5f5c8bf5c-6n6r2" podUID="7d3082b8-591c-4b30-8f75-2b333e9a69ce" containerName="authorino" containerID="cri-o://abef45ecc004d85967bbff0124ca2571b8b375c49ae6f6c60b3bcc4ff6d6e6d9" gracePeriod=30 Jun 14 03:25:18.159009 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.158984 2581 generic.go:356] "Generic (PLEG): container finished" podID="e10fbe03-5909-47fa-863d-093a76656862" containerID="e5f6158690f11f8947433c90eba5187f1ef0462ab390246fd35e066d07178a20" exitCode=0 Jun 14 03:25:18.159009 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.159010 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5tbpr" Jun 14 03:25:18.159190 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.159032 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5tbpr" event={"ID":"e10fbe03-5909-47fa-863d-093a76656862","Type":"ContainerDied","Data":"e5f6158690f11f8947433c90eba5187f1ef0462ab390246fd35e066d07178a20"} Jun 14 03:25:18.159190 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.159069 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5tbpr" event={"ID":"e10fbe03-5909-47fa-863d-093a76656862","Type":"ContainerDied","Data":"ff1f2dfe62a0e57e5a09245806589a6b9c146eb237aff0fbec6130bb5f92753e"} Jun 14 03:25:18.159190 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.159087 2581 scope.go:117] "RemoveContainer" containerID="e5f6158690f11f8947433c90eba5187f1ef0462ab390246fd35e066d07178a20" Jun 14 03:25:18.169382 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.169366 2581 scope.go:117] "RemoveContainer" containerID="e5f6158690f11f8947433c90eba5187f1ef0462ab390246fd35e066d07178a20" Jun 14 03:25:18.169645 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:25:18.169627 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5f6158690f11f8947433c90eba5187f1ef0462ab390246fd35e066d07178a20\": container with ID starting with e5f6158690f11f8947433c90eba5187f1ef0462ab390246fd35e066d07178a20 not found: ID does not exist" containerID="e5f6158690f11f8947433c90eba5187f1ef0462ab390246fd35e066d07178a20" Jun 14 03:25:18.169690 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.169655 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f6158690f11f8947433c90eba5187f1ef0462ab390246fd35e066d07178a20"} err="failed to get container status \"e5f6158690f11f8947433c90eba5187f1ef0462ab390246fd35e066d07178a20\": rpc error: code = NotFound desc = could not find container \"e5f6158690f11f8947433c90eba5187f1ef0462ab390246fd35e066d07178a20\": container with ID starting with e5f6158690f11f8947433c90eba5187f1ef0462ab390246fd35e066d07178a20 not found: ID does not exist" Jun 14 03:25:18.175437 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.175304 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-785546848f-x8qgb" podStartSLOduration=1.8714676670000001 podStartE2EDuration="2.175288182s" totalImagesPullingTime="303.820515ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:25:18.172131668 +0000 UTC m=+728.331274574" watchObservedRunningTime="2026-06-14 03:25:18.175288182 +0000 UTC m=+728.334431088" Jun 14 03:25:18.192642 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.192580 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f5c8bf5c-6n6r2" podStartSLOduration=1.791914447 podStartE2EDuration="2.192560864s" totalImagesPullingTime="400.646417ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:25:18.190157367 +0000 UTC m=+728.349300272" watchObservedRunningTime="2026-06-14 03:25:18.192560864 +0000 UTC m=+728.351703769" Jun 14 03:25:18.199075 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.199050 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ht9wj"] Jun 14 03:25:18.199270 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.199251 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-ht9wj" podUID="8b91238a-b5b5-45eb-b622-4bcdaa4a59cc" containerName="authorino" containerID="cri-o://071d2266ccbd84e88dfbfb974177ad0a30b128147e75a4cd15cdc2d3d9f60d3e" gracePeriod=30 Jun 14 03:25:18.204066 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.204040 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5tbpr"] Jun 14 03:25:18.212659 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.212630 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5tbpr"] Jun 14 03:25:18.298826 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.298801 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e10fbe03-5909-47fa-863d-093a76656862" path="/var/lib/kubelet/pods/e10fbe03-5909-47fa-863d-093a76656862/volumes" Jun 14 03:25:18.463018 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.462997 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f5c8bf5c-6n6r2" Jun 14 03:25:18.465970 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.465951 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ht9wj" Jun 14 03:25:18.519286 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.519257 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9cw8\" (UniqueName: \"kubernetes.io/projected/7d3082b8-591c-4b30-8f75-2b333e9a69ce-kube-api-access-b9cw8\") pod \"7d3082b8-591c-4b30-8f75-2b333e9a69ce\" (UID: \"7d3082b8-591c-4b30-8f75-2b333e9a69ce\") " Jun 14 03:25:18.519446 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.519346 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k98d\" (UniqueName: \"kubernetes.io/projected/8b91238a-b5b5-45eb-b622-4bcdaa4a59cc-kube-api-access-4k98d\") pod \"8b91238a-b5b5-45eb-b622-4bcdaa4a59cc\" (UID: \"8b91238a-b5b5-45eb-b622-4bcdaa4a59cc\") " Jun 14 03:25:18.521502 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.521476 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d3082b8-591c-4b30-8f75-2b333e9a69ce-kube-api-access-b9cw8" (OuterVolumeSpecName: "kube-api-access-b9cw8") pod "7d3082b8-591c-4b30-8f75-2b333e9a69ce" (UID: "7d3082b8-591c-4b30-8f75-2b333e9a69ce"). InnerVolumeSpecName "kube-api-access-b9cw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:25:18.521593 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.521473 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b91238a-b5b5-45eb-b622-4bcdaa4a59cc-kube-api-access-4k98d" (OuterVolumeSpecName: "kube-api-access-4k98d") pod "8b91238a-b5b5-45eb-b622-4bcdaa4a59cc" (UID: "8b91238a-b5b5-45eb-b622-4bcdaa4a59cc"). InnerVolumeSpecName "kube-api-access-4k98d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:25:18.620634 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.620605 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9cw8\" (UniqueName: \"kubernetes.io/projected/7d3082b8-591c-4b30-8f75-2b333e9a69ce-kube-api-access-b9cw8\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:25:18.620634 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:18.620630 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k98d\" (UniqueName: \"kubernetes.io/projected/8b91238a-b5b5-45eb-b622-4bcdaa4a59cc-kube-api-access-4k98d\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:25:19.165427 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.165389 2581 generic.go:356] "Generic (PLEG): container finished" podID="8b91238a-b5b5-45eb-b622-4bcdaa4a59cc" containerID="071d2266ccbd84e88dfbfb974177ad0a30b128147e75a4cd15cdc2d3d9f60d3e" exitCode=0 Jun 14 03:25:19.165860 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.165436 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ht9wj" Jun 14 03:25:19.165860 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.165478 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ht9wj" event={"ID":"8b91238a-b5b5-45eb-b622-4bcdaa4a59cc","Type":"ContainerDied","Data":"071d2266ccbd84e88dfbfb974177ad0a30b128147e75a4cd15cdc2d3d9f60d3e"} Jun 14 03:25:19.165860 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.165522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ht9wj" event={"ID":"8b91238a-b5b5-45eb-b622-4bcdaa4a59cc","Type":"ContainerDied","Data":"3c612bb036151e1e0df17e583dfdf4ddd3de6c1e7841104c7c69deebed1ccd1a"} Jun 14 03:25:19.165860 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.165540 2581 scope.go:117] "RemoveContainer" containerID="071d2266ccbd84e88dfbfb974177ad0a30b128147e75a4cd15cdc2d3d9f60d3e" Jun 14 03:25:19.167015 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.166988 2581 generic.go:356] "Generic (PLEG): container finished" podID="7d3082b8-591c-4b30-8f75-2b333e9a69ce" containerID="abef45ecc004d85967bbff0124ca2571b8b375c49ae6f6c60b3bcc4ff6d6e6d9" exitCode=0 Jun 14 03:25:19.167133 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.167027 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f5c8bf5c-6n6r2" Jun 14 03:25:19.167133 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.167056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f5c8bf5c-6n6r2" event={"ID":"7d3082b8-591c-4b30-8f75-2b333e9a69ce","Type":"ContainerDied","Data":"abef45ecc004d85967bbff0124ca2571b8b375c49ae6f6c60b3bcc4ff6d6e6d9"} Jun 14 03:25:19.167133 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.167086 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f5c8bf5c-6n6r2" event={"ID":"7d3082b8-591c-4b30-8f75-2b333e9a69ce","Type":"ContainerDied","Data":"0d46b10ec0424aecddc1848f2257e7f6c2d5926078f7e4422b9190caa3b8d5dc"} Jun 14 03:25:19.174790 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.174757 2581 scope.go:117] "RemoveContainer" containerID="071d2266ccbd84e88dfbfb974177ad0a30b128147e75a4cd15cdc2d3d9f60d3e" Jun 14 03:25:19.175207 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:25:19.175094 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"071d2266ccbd84e88dfbfb974177ad0a30b128147e75a4cd15cdc2d3d9f60d3e\": container with ID starting with 071d2266ccbd84e88dfbfb974177ad0a30b128147e75a4cd15cdc2d3d9f60d3e not found: ID does not exist" containerID="071d2266ccbd84e88dfbfb974177ad0a30b128147e75a4cd15cdc2d3d9f60d3e" Jun 14 03:25:19.175207 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.175127 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"071d2266ccbd84e88dfbfb974177ad0a30b128147e75a4cd15cdc2d3d9f60d3e"} err="failed to get container status \"071d2266ccbd84e88dfbfb974177ad0a30b128147e75a4cd15cdc2d3d9f60d3e\": rpc error: code = NotFound desc = could not find container \"071d2266ccbd84e88dfbfb974177ad0a30b128147e75a4cd15cdc2d3d9f60d3e\": container with ID starting with 071d2266ccbd84e88dfbfb974177ad0a30b128147e75a4cd15cdc2d3d9f60d3e not found: ID does not exist" Jun 14 03:25:19.175207 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.175150 2581 scope.go:117] "RemoveContainer" containerID="abef45ecc004d85967bbff0124ca2571b8b375c49ae6f6c60b3bcc4ff6d6e6d9" Jun 14 03:25:19.182876 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.182859 2581 scope.go:117] "RemoveContainer" containerID="abef45ecc004d85967bbff0124ca2571b8b375c49ae6f6c60b3bcc4ff6d6e6d9" Jun 14 03:25:19.183157 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:25:19.183135 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abef45ecc004d85967bbff0124ca2571b8b375c49ae6f6c60b3bcc4ff6d6e6d9\": container with ID starting with abef45ecc004d85967bbff0124ca2571b8b375c49ae6f6c60b3bcc4ff6d6e6d9 not found: ID does not exist" containerID="abef45ecc004d85967bbff0124ca2571b8b375c49ae6f6c60b3bcc4ff6d6e6d9" Jun 14 03:25:19.183238 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.183165 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abef45ecc004d85967bbff0124ca2571b8b375c49ae6f6c60b3bcc4ff6d6e6d9"} err="failed to get container status \"abef45ecc004d85967bbff0124ca2571b8b375c49ae6f6c60b3bcc4ff6d6e6d9\": rpc error: code = NotFound desc = could not find container \"abef45ecc004d85967bbff0124ca2571b8b375c49ae6f6c60b3bcc4ff6d6e6d9\": container with ID starting with abef45ecc004d85967bbff0124ca2571b8b375c49ae6f6c60b3bcc4ff6d6e6d9 not found: ID does not exist" Jun 14 03:25:19.189999 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.189977 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ht9wj"] Jun 14 03:25:19.193536 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.193518 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ht9wj"] Jun 14 03:25:19.203055 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.203032 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f5c8bf5c-6n6r2"] Jun 14 03:25:19.206523 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:19.206503 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f5c8bf5c-6n6r2"] Jun 14 03:25:20.298242 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:20.298201 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d3082b8-591c-4b30-8f75-2b333e9a69ce" path="/var/lib/kubelet/pods/7d3082b8-591c-4b30-8f75-2b333e9a69ce/volumes" Jun 14 03:25:20.298720 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:20.298642 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b91238a-b5b5-45eb-b622-4bcdaa4a59cc" path="/var/lib/kubelet/pods/8b91238a-b5b5-45eb-b622-4bcdaa4a59cc/volumes" Jun 14 03:25:56.414867 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.414826 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-8w7kc"] Jun 14 03:25:56.415458 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.415438 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b91238a-b5b5-45eb-b622-4bcdaa4a59cc" containerName="authorino" Jun 14 03:25:56.415524 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.415471 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b91238a-b5b5-45eb-b622-4bcdaa4a59cc" containerName="authorino" Jun 14 03:25:56.415524 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.415484 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d3082b8-591c-4b30-8f75-2b333e9a69ce" containerName="authorino" Jun 14 03:25:56.415524 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.415490 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d3082b8-591c-4b30-8f75-2b333e9a69ce" containerName="authorino" Jun 14 03:25:56.415524 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.415507 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e10fbe03-5909-47fa-863d-093a76656862" containerName="authorino" Jun 14 03:25:56.415524 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.415520 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e10fbe03-5909-47fa-863d-093a76656862" containerName="authorino" Jun 14 03:25:56.415760 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.415632 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d3082b8-591c-4b30-8f75-2b333e9a69ce" containerName="authorino" Jun 14 03:25:56.415760 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.415649 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b91238a-b5b5-45eb-b622-4bcdaa4a59cc" containerName="authorino" Jun 14 03:25:56.415760 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.415673 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e10fbe03-5909-47fa-863d-093a76656862" containerName="authorino" Jun 14 03:25:56.417945 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.417903 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-8w7kc" Jun 14 03:25:56.421030 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.421008 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wtxgw\"" Jun 14 03:25:56.421101 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.421014 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 14 03:25:56.431526 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.431505 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-8w7kc"] Jun 14 03:25:56.550894 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.550858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzkrh\" (UniqueName: \"kubernetes.io/projected/02b97dc8-d2fc-4763-9dc7-c941119df34e-kube-api-access-gzkrh\") pod \"payload-processing-699b6cd6c-8w7kc\" (UID: \"02b97dc8-d2fc-4763-9dc7-c941119df34e\") " pod="openshift-ingress/payload-processing-699b6cd6c-8w7kc" Jun 14 03:25:56.651385 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.651355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzkrh\" (UniqueName: \"kubernetes.io/projected/02b97dc8-d2fc-4763-9dc7-c941119df34e-kube-api-access-gzkrh\") pod \"payload-processing-699b6cd6c-8w7kc\" (UID: \"02b97dc8-d2fc-4763-9dc7-c941119df34e\") " pod="openshift-ingress/payload-processing-699b6cd6c-8w7kc" Jun 14 03:25:56.661188 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.661162 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzkrh\" (UniqueName: \"kubernetes.io/projected/02b97dc8-d2fc-4763-9dc7-c941119df34e-kube-api-access-gzkrh\") pod \"payload-processing-699b6cd6c-8w7kc\" (UID: \"02b97dc8-d2fc-4763-9dc7-c941119df34e\") " pod="openshift-ingress/payload-processing-699b6cd6c-8w7kc" Jun 14 03:25:56.728106 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.728015 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-8w7kc" Jun 14 03:25:56.858805 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.858780 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-8w7kc"] Jun 14 03:25:56.861326 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:25:56.861292 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b97dc8_d2fc_4763_9dc7_c941119df34e.slice/crio-2fc6b3151e061953f094af72cb51f9b1bb3e3697eaae5e356010a9cd66ecb4b6 WatchSource:0}: Error finding container 2fc6b3151e061953f094af72cb51f9b1bb3e3697eaae5e356010a9cd66ecb4b6: Status 404 returned error can't find the container with id 2fc6b3151e061953f094af72cb51f9b1bb3e3697eaae5e356010a9cd66ecb4b6 Jun 14 03:25:56.863131 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:56.863112 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 03:25:57.345912 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:25:57.345877 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-8w7kc" event={"ID":"02b97dc8-d2fc-4763-9dc7-c941119df34e","Type":"ContainerStarted","Data":"2fc6b3151e061953f094af72cb51f9b1bb3e3697eaae5e356010a9cd66ecb4b6"} Jun 14 03:26:00.363858 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:00.363820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-8w7kc" event={"ID":"02b97dc8-d2fc-4763-9dc7-c941119df34e","Type":"ContainerStarted","Data":"eb8e66d6f471e6f23ad6d55390a11f42ef377f28adaa53c6abec4b974c095b36"} Jun 14 03:26:00.364259 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:00.363939 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-8w7kc" Jun 14 03:26:00.382608 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:00.382535 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-8w7kc" podStartSLOduration=1.814174613 podStartE2EDuration="4.382512751s" totalImagesPullingTime="2.568338138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:26:00.378803091 +0000 UTC m=+770.537945998" watchObservedRunningTime="2026-06-14 03:26:00.382512751 +0000 UTC m=+770.541655656" Jun 14 03:26:04.022984 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:04.022940 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lwpgd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:53546->10.134.0.31:15021: read: connection reset by peer" start-of-body= Jun 14 03:26:04.023355 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:04.023008 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" podUID="490a1968-f136-43d8-877e-e72b8feaf0c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:53546->10.134.0.31:15021: read: connection reset by peer" Jun 14 03:26:04.385817 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:04.385782 2581 generic.go:356] "Generic (PLEG): container finished" podID="490a1968-f136-43d8-877e-e72b8feaf0c5" containerID="030b76801362d6431c0c5a5a42998388a1afa789778bf050375e0b89a9d0e933" exitCode=0 Jun 14 03:26:04.385998 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:04.385861 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" event={"ID":"490a1968-f136-43d8-877e-e72b8feaf0c5","Type":"ContainerDied","Data":"030b76801362d6431c0c5a5a42998388a1afa789778bf050375e0b89a9d0e933"} Jun 14 03:26:04.386283 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:04.386255 2581 scope.go:117] "RemoveContainer" containerID="030b76801362d6431c0c5a5a42998388a1afa789778bf050375e0b89a9d0e933" Jun 14 03:26:04.387263 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:04.387235 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:26:04.387330 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:04.387306 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:26:04.387368 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:04.387338 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:26:05.395329 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:05.395296 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" event={"ID":"490a1968-f136-43d8-877e-e72b8feaf0c5","Type":"ContainerStarted","Data":"0f29b964c1d4ed07ad4ebce433a3884e864c8fe33009b2ad7daf9ac7679a8b8c"} Jun 14 03:26:05.643439 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:05.643392 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:26:05.643763 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:05.643738 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lwpgd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jun 14 03:26:05.643814 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:05.643795 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" podUID="490a1968-f136-43d8-877e-e72b8feaf0c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jun 14 03:26:06.643684 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:06.643654 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lwpgd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jun 14 03:26:06.644094 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:06.643708 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" podUID="490a1968-f136-43d8-877e-e72b8feaf0c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jun 14 03:26:07.643531 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:07.643489 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lwpgd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jun 14 03:26:07.643744 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:07.643551 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" podUID="490a1968-f136-43d8-877e-e72b8feaf0c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jun 14 03:26:08.643802 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:08.643760 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lwpgd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jun 14 03:26:08.644261 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:08.643858 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" podUID="490a1968-f136-43d8-877e-e72b8feaf0c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jun 14 03:26:09.647018 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:09.646990 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:26:09.647465 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:09.647440 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:26:09.648121 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:09.648099 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lwpgd" Jun 14 03:26:11.370310 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:11.370275 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-8w7kc" Jun 14 03:26:46.168336 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.168250 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-668f557d57-xsskr"] Jun 14 03:26:46.171525 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.171507 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-668f557d57-xsskr" Jun 14 03:26:46.173921 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.173902 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 14 03:26:46.179591 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.179568 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-668f557d57-xsskr"] Jun 14 03:26:46.305731 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.305703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-oidc-ca\") pod \"authorino-668f557d57-xsskr\" (UID: \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\") " pod="kuadrant-system/authorino-668f557d57-xsskr" Jun 14 03:26:46.305731 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.305740 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8z78\" (UniqueName: \"kubernetes.io/projected/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-kube-api-access-r8z78\") pod \"authorino-668f557d57-xsskr\" (UID: \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\") " pod="kuadrant-system/authorino-668f557d57-xsskr" Jun 14 03:26:46.305951 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.305816 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-tls-cert\") pod \"authorino-668f557d57-xsskr\" (UID: \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\") " pod="kuadrant-system/authorino-668f557d57-xsskr" Jun 14 03:26:46.407037 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.407008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8z78\" (UniqueName: \"kubernetes.io/projected/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-kube-api-access-r8z78\") pod \"authorino-668f557d57-xsskr\" (UID: \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\") " pod="kuadrant-system/authorino-668f557d57-xsskr" Jun 14 03:26:46.407180 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.407079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-tls-cert\") pod \"authorino-668f557d57-xsskr\" (UID: \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\") " pod="kuadrant-system/authorino-668f557d57-xsskr" Jun 14 03:26:46.407180 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.407156 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-oidc-ca\") pod \"authorino-668f557d57-xsskr\" (UID: \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\") " pod="kuadrant-system/authorino-668f557d57-xsskr" Jun 14 03:26:46.407775 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.407752 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-oidc-ca\") pod \"authorino-668f557d57-xsskr\" (UID: \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\") " pod="kuadrant-system/authorino-668f557d57-xsskr" Jun 14 03:26:46.409667 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.409644 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-tls-cert\") pod \"authorino-668f557d57-xsskr\" (UID: \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\") " pod="kuadrant-system/authorino-668f557d57-xsskr" Jun 14 03:26:46.414756 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.414730 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8z78\" (UniqueName: \"kubernetes.io/projected/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-kube-api-access-r8z78\") pod \"authorino-668f557d57-xsskr\" (UID: \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\") " pod="kuadrant-system/authorino-668f557d57-xsskr" Jun 14 03:26:46.481528 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.481468 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-668f557d57-xsskr" Jun 14 03:26:46.616835 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:46.616805 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-668f557d57-xsskr"] Jun 14 03:26:46.618991 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:26:46.618960 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda018b7af_1d48_4d63_9d35_580ea0c0a0f9.slice/crio-60e63543d1328be1d70f82620bd5a19aadec5ae94317e6c2e2293e3f2538edc7 WatchSource:0}: Error finding container 60e63543d1328be1d70f82620bd5a19aadec5ae94317e6c2e2293e3f2538edc7: Status 404 returned error can't find the container with id 60e63543d1328be1d70f82620bd5a19aadec5ae94317e6c2e2293e3f2538edc7 Jun 14 03:26:47.587846 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:47.587807 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-668f557d57-xsskr" event={"ID":"a018b7af-1d48-4d63-9d35-580ea0c0a0f9","Type":"ContainerStarted","Data":"165e226016afdc2e0eb2ebde9e4b14545326abe7ecf50cad6b85771303351b43"} Jun 14 03:26:47.588245 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:47.587855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-668f557d57-xsskr" event={"ID":"a018b7af-1d48-4d63-9d35-580ea0c0a0f9","Type":"ContainerStarted","Data":"60e63543d1328be1d70f82620bd5a19aadec5ae94317e6c2e2293e3f2538edc7"} Jun 14 03:26:47.603550 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:47.603503 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-668f557d57-xsskr" podStartSLOduration=1.181200252 podStartE2EDuration="1.603489898s" totalImagesPullingTime="422.289646ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:26:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:26:47.602419702 +0000 UTC m=+817.761562619" watchObservedRunningTime="2026-06-14 03:26:47.603489898 +0000 UTC m=+817.762632802" Jun 14 03:26:47.629956 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:47.629905 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-785546848f-x8qgb"] Jun 14 03:26:47.630171 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:47.630140 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-785546848f-x8qgb" podUID="7a609cc3-6a7a-4e38-87b5-020c3d0ec24c" containerName="authorino" containerID="cri-o://4dc2d9c189e24ef680e7cc23203ed47efc40db874a4aa666b014673b25710f9c" gracePeriod=30 Jun 14 03:26:47.870978 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:47.870947 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-785546848f-x8qgb" Jun 14 03:26:48.023635 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.023601 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a609cc3-6a7a-4e38-87b5-020c3d0ec24c-tls-cert\") pod \"7a609cc3-6a7a-4e38-87b5-020c3d0ec24c\" (UID: \"7a609cc3-6a7a-4e38-87b5-020c3d0ec24c\") " Jun 14 03:26:48.023783 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.023647 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfljx\" (UniqueName: \"kubernetes.io/projected/7a609cc3-6a7a-4e38-87b5-020c3d0ec24c-kube-api-access-vfljx\") pod \"7a609cc3-6a7a-4e38-87b5-020c3d0ec24c\" (UID: \"7a609cc3-6a7a-4e38-87b5-020c3d0ec24c\") " Jun 14 03:26:48.025886 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.025849 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a609cc3-6a7a-4e38-87b5-020c3d0ec24c-kube-api-access-vfljx" (OuterVolumeSpecName: "kube-api-access-vfljx") pod "7a609cc3-6a7a-4e38-87b5-020c3d0ec24c" (UID: "7a609cc3-6a7a-4e38-87b5-020c3d0ec24c"). InnerVolumeSpecName "kube-api-access-vfljx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:26:48.034209 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.034186 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a609cc3-6a7a-4e38-87b5-020c3d0ec24c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7a609cc3-6a7a-4e38-87b5-020c3d0ec24c" (UID: "7a609cc3-6a7a-4e38-87b5-020c3d0ec24c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:26:48.124598 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.124572 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a609cc3-6a7a-4e38-87b5-020c3d0ec24c-tls-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:26:48.124709 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.124597 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfljx\" (UniqueName: \"kubernetes.io/projected/7a609cc3-6a7a-4e38-87b5-020c3d0ec24c-kube-api-access-vfljx\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:26:48.593259 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.593223 2581 generic.go:356] "Generic (PLEG): container finished" podID="7a609cc3-6a7a-4e38-87b5-020c3d0ec24c" containerID="4dc2d9c189e24ef680e7cc23203ed47efc40db874a4aa666b014673b25710f9c" exitCode=0 Jun 14 03:26:48.593689 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.593268 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-785546848f-x8qgb" Jun 14 03:26:48.593689 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.593307 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-785546848f-x8qgb" event={"ID":"7a609cc3-6a7a-4e38-87b5-020c3d0ec24c","Type":"ContainerDied","Data":"4dc2d9c189e24ef680e7cc23203ed47efc40db874a4aa666b014673b25710f9c"} Jun 14 03:26:48.593689 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.593347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-785546848f-x8qgb" event={"ID":"7a609cc3-6a7a-4e38-87b5-020c3d0ec24c","Type":"ContainerDied","Data":"f4ded77a6941c05f5bd5405435130286213c4645350396b0815925d75c3ab714"} Jun 14 03:26:48.593689 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.593363 2581 scope.go:117] "RemoveContainer" containerID="4dc2d9c189e24ef680e7cc23203ed47efc40db874a4aa666b014673b25710f9c" Jun 14 03:26:48.601835 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.601818 2581 scope.go:117] "RemoveContainer" containerID="4dc2d9c189e24ef680e7cc23203ed47efc40db874a4aa666b014673b25710f9c" Jun 14 03:26:48.602103 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:26:48.602084 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dc2d9c189e24ef680e7cc23203ed47efc40db874a4aa666b014673b25710f9c\": container with ID starting with 4dc2d9c189e24ef680e7cc23203ed47efc40db874a4aa666b014673b25710f9c not found: ID does not exist" containerID="4dc2d9c189e24ef680e7cc23203ed47efc40db874a4aa666b014673b25710f9c" Jun 14 03:26:48.602156 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.602112 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dc2d9c189e24ef680e7cc23203ed47efc40db874a4aa666b014673b25710f9c"} err="failed to get container status \"4dc2d9c189e24ef680e7cc23203ed47efc40db874a4aa666b014673b25710f9c\": rpc error: code = NotFound desc = could not find container \"4dc2d9c189e24ef680e7cc23203ed47efc40db874a4aa666b014673b25710f9c\": container with ID starting with 4dc2d9c189e24ef680e7cc23203ed47efc40db874a4aa666b014673b25710f9c not found: ID does not exist" Jun 14 03:26:48.608446 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.608426 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-785546848f-x8qgb"] Jun 14 03:26:48.611689 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:48.611667 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-785546848f-x8qgb"] Jun 14 03:26:50.300453 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:26:50.300415 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a609cc3-6a7a-4e38-87b5-020c3d0ec24c" path="/var/lib/kubelet/pods/7a609cc3-6a7a-4e38-87b5-020c3d0ec24c/volumes" Jun 14 03:28:10.326770 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:28:10.326744 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:28:10.327356 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:28:10.327339 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:30:00.143594 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:00.143559 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29690130-5z8zj"] Jun 14 03:30:00.144062 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:00.143917 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a609cc3-6a7a-4e38-87b5-020c3d0ec24c" containerName="authorino" Jun 14 03:30:00.144062 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:00.143946 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a609cc3-6a7a-4e38-87b5-020c3d0ec24c" containerName="authorino" Jun 14 03:30:00.144062 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:00.144048 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a609cc3-6a7a-4e38-87b5-020c3d0ec24c" containerName="authorino" Jun 14 03:30:00.146976 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:00.146960 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690130-5z8zj" Jun 14 03:30:00.149496 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:00.149477 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2mrj7\"" Jun 14 03:30:00.154734 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:00.154713 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29690130-5z8zj"] Jun 14 03:30:00.228572 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:00.228543 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpdzk\" (UniqueName: \"kubernetes.io/projected/ec88d297-0b1b-4d8d-8682-f7ffde4961e7-kube-api-access-kpdzk\") pod \"maas-api-key-cleanup-29690130-5z8zj\" (UID: \"ec88d297-0b1b-4d8d-8682-f7ffde4961e7\") " pod="opendatahub/maas-api-key-cleanup-29690130-5z8zj" Jun 14 03:30:00.329754 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:00.329726 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpdzk\" (UniqueName: \"kubernetes.io/projected/ec88d297-0b1b-4d8d-8682-f7ffde4961e7-kube-api-access-kpdzk\") pod \"maas-api-key-cleanup-29690130-5z8zj\" (UID: \"ec88d297-0b1b-4d8d-8682-f7ffde4961e7\") " pod="opendatahub/maas-api-key-cleanup-29690130-5z8zj" Jun 14 03:30:00.338086 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:00.338065 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpdzk\" (UniqueName: \"kubernetes.io/projected/ec88d297-0b1b-4d8d-8682-f7ffde4961e7-kube-api-access-kpdzk\") pod \"maas-api-key-cleanup-29690130-5z8zj\" (UID: \"ec88d297-0b1b-4d8d-8682-f7ffde4961e7\") " pod="opendatahub/maas-api-key-cleanup-29690130-5z8zj" Jun 14 03:30:00.458990 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:00.458902 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690130-5z8zj" Jun 14 03:30:00.597176 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:00.597099 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29690130-5z8zj"] Jun 14 03:30:00.599984 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:30:00.599908 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec88d297_0b1b_4d8d_8682_f7ffde4961e7.slice/crio-5d8357a05abd7f03ce14701c771da4bcb2511e614a801572f47ad45f8c39c359 WatchSource:0}: Error finding container 5d8357a05abd7f03ce14701c771da4bcb2511e614a801572f47ad45f8c39c359: Status 404 returned error can't find the container with id 5d8357a05abd7f03ce14701c771da4bcb2511e614a801572f47ad45f8c39c359 Jun 14 03:30:01.501088 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:01.501053 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690130-5z8zj" event={"ID":"ec88d297-0b1b-4d8d-8682-f7ffde4961e7","Type":"ContainerStarted","Data":"5d8357a05abd7f03ce14701c771da4bcb2511e614a801572f47ad45f8c39c359"} Jun 14 03:30:03.512167 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:03.512106 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690130-5z8zj" event={"ID":"ec88d297-0b1b-4d8d-8682-f7ffde4961e7","Type":"ContainerStarted","Data":"0758d860b24ebc91801933dced193f2433a7d0d30ab5dbe4202d8c99f0869ce9"} Jun 14 03:30:03.529366 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:03.529320 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29690130-5z8zj" podStartSLOduration=0.882986293 podStartE2EDuration="3.529305598s" totalImagesPullingTime="2.646319305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:30:03.527363332 +0000 UTC m=+1013.686506235" watchObservedRunningTime="2026-06-14 03:30:03.529305598 +0000 UTC m=+1013.688448539" Jun 14 03:30:04.518342 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:04.518305 2581 generic.go:356] "Generic (PLEG): container finished" podID="ec88d297-0b1b-4d8d-8682-f7ffde4961e7" containerID="0758d860b24ebc91801933dced193f2433a7d0d30ab5dbe4202d8c99f0869ce9" exitCode=0 Jun 14 03:30:04.518724 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:04.518380 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690130-5z8zj" event={"ID":"ec88d297-0b1b-4d8d-8682-f7ffde4961e7","Type":"ContainerDied","Data":"0758d860b24ebc91801933dced193f2433a7d0d30ab5dbe4202d8c99f0869ce9"} Jun 14 03:30:05.651290 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:05.651269 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690130-5z8zj" Jun 14 03:30:05.781189 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:05.781113 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpdzk\" (UniqueName: \"kubernetes.io/projected/ec88d297-0b1b-4d8d-8682-f7ffde4961e7-kube-api-access-kpdzk\") pod \"ec88d297-0b1b-4d8d-8682-f7ffde4961e7\" (UID: \"ec88d297-0b1b-4d8d-8682-f7ffde4961e7\") " Jun 14 03:30:05.783306 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:05.783286 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec88d297-0b1b-4d8d-8682-f7ffde4961e7-kube-api-access-kpdzk" (OuterVolumeSpecName: "kube-api-access-kpdzk") pod "ec88d297-0b1b-4d8d-8682-f7ffde4961e7" (UID: "ec88d297-0b1b-4d8d-8682-f7ffde4961e7"). InnerVolumeSpecName "kube-api-access-kpdzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:30:05.881836 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:05.881806 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpdzk\" (UniqueName: \"kubernetes.io/projected/ec88d297-0b1b-4d8d-8682-f7ffde4961e7-kube-api-access-kpdzk\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:30:06.529166 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:06.529136 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690130-5z8zj" Jun 14 03:30:06.529304 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:06.529162 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690130-5z8zj" event={"ID":"ec88d297-0b1b-4d8d-8682-f7ffde4961e7","Type":"ContainerDied","Data":"5d8357a05abd7f03ce14701c771da4bcb2511e614a801572f47ad45f8c39c359"} Jun 14 03:30:06.529304 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:30:06.529209 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d8357a05abd7f03ce14701c771da4bcb2511e614a801572f47ad45f8c39c359" Jun 14 03:31:42.407916 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.407876 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c8b7b845b-7vnmh"] Jun 14 03:31:42.410120 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.408223 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec88d297-0b1b-4d8d-8682-f7ffde4961e7" containerName="cleanup" Jun 14 03:31:42.410120 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.408236 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec88d297-0b1b-4d8d-8682-f7ffde4961e7" containerName="cleanup" Jun 14 03:31:42.410120 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.408301 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec88d297-0b1b-4d8d-8682-f7ffde4961e7" containerName="cleanup" Jun 14 03:31:42.410886 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.410871 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c8b7b845b-7vnmh" Jun 14 03:31:42.419154 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.419134 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c8b7b845b-7vnmh"] Jun 14 03:31:42.498464 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.498431 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d10e221f-fe8a-4a48-8596-3dd00e380bce-oidc-ca\") pod \"authorino-5c8b7b845b-7vnmh\" (UID: \"d10e221f-fe8a-4a48-8596-3dd00e380bce\") " pod="kuadrant-system/authorino-5c8b7b845b-7vnmh" Jun 14 03:31:42.498595 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.498478 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzhv4\" (UniqueName: \"kubernetes.io/projected/d10e221f-fe8a-4a48-8596-3dd00e380bce-kube-api-access-wzhv4\") pod \"authorino-5c8b7b845b-7vnmh\" (UID: \"d10e221f-fe8a-4a48-8596-3dd00e380bce\") " pod="kuadrant-system/authorino-5c8b7b845b-7vnmh" Jun 14 03:31:42.498595 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.498553 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d10e221f-fe8a-4a48-8596-3dd00e380bce-tls-cert\") pod \"authorino-5c8b7b845b-7vnmh\" (UID: \"d10e221f-fe8a-4a48-8596-3dd00e380bce\") " pod="kuadrant-system/authorino-5c8b7b845b-7vnmh" Jun 14 03:31:42.599977 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.599943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d10e221f-fe8a-4a48-8596-3dd00e380bce-oidc-ca\") pod \"authorino-5c8b7b845b-7vnmh\" (UID: \"d10e221f-fe8a-4a48-8596-3dd00e380bce\") " pod="kuadrant-system/authorino-5c8b7b845b-7vnmh" Jun 14 03:31:42.600153 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.599984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzhv4\" (UniqueName: \"kubernetes.io/projected/d10e221f-fe8a-4a48-8596-3dd00e380bce-kube-api-access-wzhv4\") pod \"authorino-5c8b7b845b-7vnmh\" (UID: \"d10e221f-fe8a-4a48-8596-3dd00e380bce\") " pod="kuadrant-system/authorino-5c8b7b845b-7vnmh" Jun 14 03:31:42.600153 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.600022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d10e221f-fe8a-4a48-8596-3dd00e380bce-tls-cert\") pod \"authorino-5c8b7b845b-7vnmh\" (UID: \"d10e221f-fe8a-4a48-8596-3dd00e380bce\") " pod="kuadrant-system/authorino-5c8b7b845b-7vnmh" Jun 14 03:31:42.600630 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.600604 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d10e221f-fe8a-4a48-8596-3dd00e380bce-oidc-ca\") pod \"authorino-5c8b7b845b-7vnmh\" (UID: \"d10e221f-fe8a-4a48-8596-3dd00e380bce\") " pod="kuadrant-system/authorino-5c8b7b845b-7vnmh" Jun 14 03:31:42.602599 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.602577 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d10e221f-fe8a-4a48-8596-3dd00e380bce-tls-cert\") pod \"authorino-5c8b7b845b-7vnmh\" (UID: \"d10e221f-fe8a-4a48-8596-3dd00e380bce\") " pod="kuadrant-system/authorino-5c8b7b845b-7vnmh" Jun 14 03:31:42.608122 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.608098 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzhv4\" (UniqueName: \"kubernetes.io/projected/d10e221f-fe8a-4a48-8596-3dd00e380bce-kube-api-access-wzhv4\") pod \"authorino-5c8b7b845b-7vnmh\" (UID: \"d10e221f-fe8a-4a48-8596-3dd00e380bce\") " pod="kuadrant-system/authorino-5c8b7b845b-7vnmh" Jun 14 03:31:42.720422 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.720349 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c8b7b845b-7vnmh" Jun 14 03:31:42.857311 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.857285 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c8b7b845b-7vnmh"] Jun 14 03:31:42.859303 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:31:42.859276 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd10e221f_fe8a_4a48_8596_3dd00e380bce.slice/crio-d046627e18e52ffa12206312fc66dd74be3e13b22cd4ea6d4bfe30394a8605a6 WatchSource:0}: Error finding container d046627e18e52ffa12206312fc66dd74be3e13b22cd4ea6d4bfe30394a8605a6: Status 404 returned error can't find the container with id d046627e18e52ffa12206312fc66dd74be3e13b22cd4ea6d4bfe30394a8605a6 Jun 14 03:31:42.860711 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.860693 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 03:31:42.975704 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:42.975625 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c8b7b845b-7vnmh" event={"ID":"d10e221f-fe8a-4a48-8596-3dd00e380bce","Type":"ContainerStarted","Data":"d046627e18e52ffa12206312fc66dd74be3e13b22cd4ea6d4bfe30394a8605a6"} Jun 14 03:31:43.984121 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:43.984083 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c8b7b845b-7vnmh" event={"ID":"d10e221f-fe8a-4a48-8596-3dd00e380bce","Type":"ContainerStarted","Data":"971277fb65e28c87c7a60672db0dbf7eddf62d75bc5e29850e2e14dcd5bbf1bf"} Jun 14 03:31:44.008602 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.008538 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c8b7b845b-7vnmh" podStartSLOduration=1.5698787520000002 podStartE2EDuration="2.008516661s" totalImagesPullingTime="438.637909ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:31:44.008055968 +0000 UTC m=+1114.167198872" watchObservedRunningTime="2026-06-14 03:31:44.008516661 +0000 UTC m=+1114.167659567" Jun 14 03:31:44.069955 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.069480 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-668f557d57-xsskr"] Jun 14 03:31:44.069955 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.069727 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-668f557d57-xsskr" podUID="a018b7af-1d48-4d63-9d35-580ea0c0a0f9" containerName="authorino" containerID="cri-o://165e226016afdc2e0eb2ebde9e4b14545326abe7ecf50cad6b85771303351b43" gracePeriod=30 Jun 14 03:31:44.338373 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.338347 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-668f557d57-xsskr" Jun 14 03:31:44.418338 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.418298 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-oidc-ca\") pod \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\" (UID: \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\") " Jun 14 03:31:44.418518 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.418418 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8z78\" (UniqueName: \"kubernetes.io/projected/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-kube-api-access-r8z78\") pod \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\" (UID: \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\") " Jun 14 03:31:44.418518 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.418453 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-tls-cert\") pod \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\" (UID: \"a018b7af-1d48-4d63-9d35-580ea0c0a0f9\") " Jun 14 03:31:44.420578 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.420540 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-kube-api-access-r8z78" (OuterVolumeSpecName: "kube-api-access-r8z78") pod "a018b7af-1d48-4d63-9d35-580ea0c0a0f9" (UID: "a018b7af-1d48-4d63-9d35-580ea0c0a0f9"). InnerVolumeSpecName "kube-api-access-r8z78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:31:44.424831 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.424801 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "a018b7af-1d48-4d63-9d35-580ea0c0a0f9" (UID: "a018b7af-1d48-4d63-9d35-580ea0c0a0f9"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:31:44.429678 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.429649 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a018b7af-1d48-4d63-9d35-580ea0c0a0f9" (UID: "a018b7af-1d48-4d63-9d35-580ea0c0a0f9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:31:44.519787 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.519702 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8z78\" (UniqueName: \"kubernetes.io/projected/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-kube-api-access-r8z78\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:31:44.519787 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.519733 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-tls-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:31:44.519787 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.519743 2581 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a018b7af-1d48-4d63-9d35-580ea0c0a0f9-oidc-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:31:44.990432 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.990395 2581 generic.go:356] "Generic (PLEG): container finished" podID="a018b7af-1d48-4d63-9d35-580ea0c0a0f9" containerID="165e226016afdc2e0eb2ebde9e4b14545326abe7ecf50cad6b85771303351b43" exitCode=0 Jun 14 03:31:44.990885 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.990447 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-668f557d57-xsskr" Jun 14 03:31:44.990885 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.990483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-668f557d57-xsskr" event={"ID":"a018b7af-1d48-4d63-9d35-580ea0c0a0f9","Type":"ContainerDied","Data":"165e226016afdc2e0eb2ebde9e4b14545326abe7ecf50cad6b85771303351b43"} Jun 14 03:31:44.990885 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.990527 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-668f557d57-xsskr" event={"ID":"a018b7af-1d48-4d63-9d35-580ea0c0a0f9","Type":"ContainerDied","Data":"60e63543d1328be1d70f82620bd5a19aadec5ae94317e6c2e2293e3f2538edc7"} Jun 14 03:31:44.990885 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:44.990558 2581 scope.go:117] "RemoveContainer" containerID="165e226016afdc2e0eb2ebde9e4b14545326abe7ecf50cad6b85771303351b43" Jun 14 03:31:45.000143 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:45.000127 2581 scope.go:117] "RemoveContainer" containerID="165e226016afdc2e0eb2ebde9e4b14545326abe7ecf50cad6b85771303351b43" Jun 14 03:31:45.000414 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:31:45.000395 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"165e226016afdc2e0eb2ebde9e4b14545326abe7ecf50cad6b85771303351b43\": container with ID starting with 165e226016afdc2e0eb2ebde9e4b14545326abe7ecf50cad6b85771303351b43 not found: ID does not exist" containerID="165e226016afdc2e0eb2ebde9e4b14545326abe7ecf50cad6b85771303351b43" Jun 14 03:31:45.000504 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:45.000421 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165e226016afdc2e0eb2ebde9e4b14545326abe7ecf50cad6b85771303351b43"} err="failed to get container status \"165e226016afdc2e0eb2ebde9e4b14545326abe7ecf50cad6b85771303351b43\": rpc error: code = NotFound desc = could not find container \"165e226016afdc2e0eb2ebde9e4b14545326abe7ecf50cad6b85771303351b43\": container with ID starting with 165e226016afdc2e0eb2ebde9e4b14545326abe7ecf50cad6b85771303351b43 not found: ID does not exist" Jun 14 03:31:45.010674 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:45.010645 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-668f557d57-xsskr"] Jun 14 03:31:45.013861 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:45.013836 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-668f557d57-xsskr"] Jun 14 03:31:46.299365 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:31:46.299337 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a018b7af-1d48-4d63-9d35-580ea0c0a0f9" path="/var/lib/kubelet/pods/a018b7af-1d48-4d63-9d35-580ea0c0a0f9/volumes" Jun 14 03:33:10.356649 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:33:10.356616 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:33:10.358054 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:33:10.358033 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:38:10.390846 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:38:10.390819 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:38:10.394437 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:38:10.394418 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:43:10.426847 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:10.426750 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:43:10.429972 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:10.429953 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:43:16.212977 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:16.212917 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb"] Jun 14 03:43:16.213455 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:16.213189 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" podUID="14e6219f-6f4f-4452-877f-139c60586a00" containerName="manager" containerID="cri-o://c9e8e1ee4f204dadc38187ff986c181eceb455ba113b68a08c385d0352950b47" gracePeriod=10 Jun 14 03:43:16.464363 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:16.464306 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" Jun 14 03:43:16.598636 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:16.598604 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w78d5\" (UniqueName: \"kubernetes.io/projected/14e6219f-6f4f-4452-877f-139c60586a00-kube-api-access-w78d5\") pod \"14e6219f-6f4f-4452-877f-139c60586a00\" (UID: \"14e6219f-6f4f-4452-877f-139c60586a00\") " Jun 14 03:43:16.598833 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:16.598656 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14e6219f-6f4f-4452-877f-139c60586a00-extensions-socket-volume\") pod \"14e6219f-6f4f-4452-877f-139c60586a00\" (UID: \"14e6219f-6f4f-4452-877f-139c60586a00\") " Jun 14 03:43:16.599053 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:16.599029 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14e6219f-6f4f-4452-877f-139c60586a00-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "14e6219f-6f4f-4452-877f-139c60586a00" (UID: "14e6219f-6f4f-4452-877f-139c60586a00"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:43:16.600825 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:16.600803 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14e6219f-6f4f-4452-877f-139c60586a00-kube-api-access-w78d5" (OuterVolumeSpecName: "kube-api-access-w78d5") pod "14e6219f-6f4f-4452-877f-139c60586a00" (UID: "14e6219f-6f4f-4452-877f-139c60586a00"). InnerVolumeSpecName "kube-api-access-w78d5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:43:16.699519 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:16.699486 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14e6219f-6f4f-4452-877f-139c60586a00-extensions-socket-volume\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:43:16.699519 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:16.699513 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w78d5\" (UniqueName: \"kubernetes.io/projected/14e6219f-6f4f-4452-877f-139c60586a00-kube-api-access-w78d5\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:43:17.245188 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:17.245150 2581 generic.go:356] "Generic (PLEG): container finished" podID="14e6219f-6f4f-4452-877f-139c60586a00" containerID="c9e8e1ee4f204dadc38187ff986c181eceb455ba113b68a08c385d0352950b47" exitCode=0 Jun 14 03:43:17.245695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:17.245193 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" Jun 14 03:43:17.245695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:17.245221 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" event={"ID":"14e6219f-6f4f-4452-877f-139c60586a00","Type":"ContainerDied","Data":"c9e8e1ee4f204dadc38187ff986c181eceb455ba113b68a08c385d0352950b47"} Jun 14 03:43:17.245695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:17.245268 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb" event={"ID":"14e6219f-6f4f-4452-877f-139c60586a00","Type":"ContainerDied","Data":"dcd83cd6f9d5d88f66daaa68a6ec69bafa8f7b44e1027e098330c0f851a7b4ec"} Jun 14 03:43:17.245695 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:17.245293 2581 scope.go:117] "RemoveContainer" containerID="c9e8e1ee4f204dadc38187ff986c181eceb455ba113b68a08c385d0352950b47" Jun 14 03:43:17.256627 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:17.256609 2581 scope.go:117] "RemoveContainer" containerID="c9e8e1ee4f204dadc38187ff986c181eceb455ba113b68a08c385d0352950b47" Jun 14 03:43:17.256885 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:43:17.256867 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9e8e1ee4f204dadc38187ff986c181eceb455ba113b68a08c385d0352950b47\": container with ID starting with c9e8e1ee4f204dadc38187ff986c181eceb455ba113b68a08c385d0352950b47 not found: ID does not exist" containerID="c9e8e1ee4f204dadc38187ff986c181eceb455ba113b68a08c385d0352950b47" Jun 14 03:43:17.256954 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:17.256893 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9e8e1ee4f204dadc38187ff986c181eceb455ba113b68a08c385d0352950b47"} err="failed to get container status \"c9e8e1ee4f204dadc38187ff986c181eceb455ba113b68a08c385d0352950b47\": rpc error: code = NotFound desc = could not find container \"c9e8e1ee4f204dadc38187ff986c181eceb455ba113b68a08c385d0352950b47\": container with ID starting with c9e8e1ee4f204dadc38187ff986c181eceb455ba113b68a08c385d0352950b47 not found: ID does not exist" Jun 14 03:43:17.269702 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:17.269674 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb"] Jun 14 03:43:17.273383 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:17.273362 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzlbb"] Jun 14 03:43:18.298623 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:43:18.298592 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14e6219f-6f4f-4452-877f-139c60586a00" path="/var/lib/kubelet/pods/14e6219f-6f4f-4452-877f-139c60586a00/volumes" Jun 14 03:44:17.341432 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.341401 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9"] Jun 14 03:44:17.341817 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.341735 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14e6219f-6f4f-4452-877f-139c60586a00" containerName="manager" Jun 14 03:44:17.341817 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.341746 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="14e6219f-6f4f-4452-877f-139c60586a00" containerName="manager" Jun 14 03:44:17.341817 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.341763 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a018b7af-1d48-4d63-9d35-580ea0c0a0f9" containerName="authorino" Jun 14 03:44:17.341817 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.341769 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a018b7af-1d48-4d63-9d35-580ea0c0a0f9" containerName="authorino" Jun 14 03:44:17.341817 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.341819 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="14e6219f-6f4f-4452-877f-139c60586a00" containerName="manager" Jun 14 03:44:17.342019 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.341830 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a018b7af-1d48-4d63-9d35-580ea0c0a0f9" containerName="authorino" Jun 14 03:44:17.344712 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.344690 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9" Jun 14 03:44:17.347760 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.347738 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6nm8r\"" Jun 14 03:44:17.358498 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.358477 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9"] Jun 14 03:44:17.415637 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.415610 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/031b4180-8e38-4019-bc94-f13622eef926-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mr9x9\" (UID: \"031b4180-8e38-4019-bc94-f13622eef926\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9" Jun 14 03:44:17.415800 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.415644 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsxgz\" (UniqueName: \"kubernetes.io/projected/031b4180-8e38-4019-bc94-f13622eef926-kube-api-access-gsxgz\") pod \"kuadrant-operator-controller-manager-86878c769f-mr9x9\" (UID: \"031b4180-8e38-4019-bc94-f13622eef926\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9" Jun 14 03:44:17.517025 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.516991 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/031b4180-8e38-4019-bc94-f13622eef926-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mr9x9\" (UID: \"031b4180-8e38-4019-bc94-f13622eef926\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9" Jun 14 03:44:17.517192 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.517033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsxgz\" (UniqueName: \"kubernetes.io/projected/031b4180-8e38-4019-bc94-f13622eef926-kube-api-access-gsxgz\") pod \"kuadrant-operator-controller-manager-86878c769f-mr9x9\" (UID: \"031b4180-8e38-4019-bc94-f13622eef926\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9" Jun 14 03:44:17.517362 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.517345 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/031b4180-8e38-4019-bc94-f13622eef926-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mr9x9\" (UID: \"031b4180-8e38-4019-bc94-f13622eef926\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9" Jun 14 03:44:17.525644 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.525618 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsxgz\" (UniqueName: \"kubernetes.io/projected/031b4180-8e38-4019-bc94-f13622eef926-kube-api-access-gsxgz\") pod \"kuadrant-operator-controller-manager-86878c769f-mr9x9\" (UID: \"031b4180-8e38-4019-bc94-f13622eef926\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9" Jun 14 03:44:17.655095 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.655057 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9" Jun 14 03:44:17.811548 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:17.811516 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9"] Jun 14 03:44:17.815352 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:44:17.815310 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031b4180_8e38_4019_bc94_f13622eef926.slice/crio-a3ffc7f2c33bb293dd3cbadda7b77c75dc319bcce049effd3334b3da6bc5ae71 WatchSource:0}: Error finding container a3ffc7f2c33bb293dd3cbadda7b77c75dc319bcce049effd3334b3da6bc5ae71: Status 404 returned error can't find the container with id a3ffc7f2c33bb293dd3cbadda7b77c75dc319bcce049effd3334b3da6bc5ae71 Jun 14 03:44:18.528532 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:18.528490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9" event={"ID":"031b4180-8e38-4019-bc94-f13622eef926","Type":"ContainerStarted","Data":"fb518dc142d67b2ebf293d5b06c002eeff8258bc9c5c1e889f7235f59035c555"} Jun 14 03:44:18.528920 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:18.528557 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9" Jun 14 03:44:18.528920 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:18.528581 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9" event={"ID":"031b4180-8e38-4019-bc94-f13622eef926","Type":"ContainerStarted","Data":"a3ffc7f2c33bb293dd3cbadda7b77c75dc319bcce049effd3334b3da6bc5ae71"} Jun 14 03:44:18.549721 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:18.549659 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9" podStartSLOduration=1.5496414280000002 podStartE2EDuration="1.549641428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:44:18.547900812 +0000 UTC m=+1868.707043715" watchObservedRunningTime="2026-06-14 03:44:18.549641428 +0000 UTC m=+1868.708784332" Jun 14 03:44:29.535700 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:44:29.535667 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr9x9" Jun 14 03:45:00.134595 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:00.134557 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29690145-zrhct"] Jun 14 03:45:00.138087 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:00.138070 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690145-zrhct" Jun 14 03:45:00.140445 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:00.140424 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2mrj7\"" Jun 14 03:45:00.143804 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:00.143769 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29690145-zrhct"] Jun 14 03:45:00.197647 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:00.197620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87zf8\" (UniqueName: \"kubernetes.io/projected/f032b108-27b7-4454-a265-6310acb48fe8-kube-api-access-87zf8\") pod \"maas-api-key-cleanup-29690145-zrhct\" (UID: \"f032b108-27b7-4454-a265-6310acb48fe8\") " pod="opendatahub/maas-api-key-cleanup-29690145-zrhct" Jun 14 03:45:00.298616 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:00.298584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87zf8\" (UniqueName: \"kubernetes.io/projected/f032b108-27b7-4454-a265-6310acb48fe8-kube-api-access-87zf8\") pod \"maas-api-key-cleanup-29690145-zrhct\" (UID: \"f032b108-27b7-4454-a265-6310acb48fe8\") " pod="opendatahub/maas-api-key-cleanup-29690145-zrhct" Jun 14 03:45:00.307025 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:00.306998 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87zf8\" (UniqueName: \"kubernetes.io/projected/f032b108-27b7-4454-a265-6310acb48fe8-kube-api-access-87zf8\") pod \"maas-api-key-cleanup-29690145-zrhct\" (UID: \"f032b108-27b7-4454-a265-6310acb48fe8\") " pod="opendatahub/maas-api-key-cleanup-29690145-zrhct" Jun 14 03:45:00.449714 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:00.449631 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690145-zrhct" Jun 14 03:45:00.580097 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:00.580075 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29690145-zrhct"] Jun 14 03:45:00.582325 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:45:00.582299 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf032b108_27b7_4454_a265_6310acb48fe8.slice/crio-d07c01902f66a2fb98a3436adf371a194f386f85093fefe6e4730d07b0905a05 WatchSource:0}: Error finding container d07c01902f66a2fb98a3436adf371a194f386f85093fefe6e4730d07b0905a05: Status 404 returned error can't find the container with id d07c01902f66a2fb98a3436adf371a194f386f85093fefe6e4730d07b0905a05 Jun 14 03:45:00.725305 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:00.725212 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690145-zrhct" event={"ID":"f032b108-27b7-4454-a265-6310acb48fe8","Type":"ContainerStarted","Data":"d07c01902f66a2fb98a3436adf371a194f386f85093fefe6e4730d07b0905a05"} Jun 14 03:45:01.731672 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:01.731580 2581 generic.go:356] "Generic (PLEG): container finished" podID="f032b108-27b7-4454-a265-6310acb48fe8" containerID="baed25b2487887d89bd4d841e011a49de46453b9b3154bdb1b28ccc72c8200b7" exitCode=0 Jun 14 03:45:01.731672 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:01.731629 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690145-zrhct" event={"ID":"f032b108-27b7-4454-a265-6310acb48fe8","Type":"ContainerDied","Data":"baed25b2487887d89bd4d841e011a49de46453b9b3154bdb1b28ccc72c8200b7"} Jun 14 03:45:02.865393 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:02.865371 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690145-zrhct" Jun 14 03:45:02.921178 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:02.921143 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87zf8\" (UniqueName: \"kubernetes.io/projected/f032b108-27b7-4454-a265-6310acb48fe8-kube-api-access-87zf8\") pod \"f032b108-27b7-4454-a265-6310acb48fe8\" (UID: \"f032b108-27b7-4454-a265-6310acb48fe8\") " Jun 14 03:45:02.923363 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:02.923331 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f032b108-27b7-4454-a265-6310acb48fe8-kube-api-access-87zf8" (OuterVolumeSpecName: "kube-api-access-87zf8") pod "f032b108-27b7-4454-a265-6310acb48fe8" (UID: "f032b108-27b7-4454-a265-6310acb48fe8"). InnerVolumeSpecName "kube-api-access-87zf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:45:03.022523 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:03.022442 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87zf8\" (UniqueName: \"kubernetes.io/projected/f032b108-27b7-4454-a265-6310acb48fe8-kube-api-access-87zf8\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:45:03.742262 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:03.742233 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690145-zrhct" Jun 14 03:45:03.742262 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:03.742252 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690145-zrhct" event={"ID":"f032b108-27b7-4454-a265-6310acb48fe8","Type":"ContainerDied","Data":"d07c01902f66a2fb98a3436adf371a194f386f85093fefe6e4730d07b0905a05"} Jun 14 03:45:03.742463 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:45:03.742294 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d07c01902f66a2fb98a3436adf371a194f386f85093fefe6e4730d07b0905a05" Jun 14 03:48:10.461802 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:48:10.461698 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:48:10.465725 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:48:10.464871 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:53:10.491157 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:10.491045 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:53:10.496110 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:10.496091 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tg2sg_e5573ea3-92ae-4032-9333-300f5fae54df/ovn-acl-logging/0.log" Jun 14 03:53:45.994457 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:45.994370 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf"] Jun 14 03:53:45.994961 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:45.994819 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f032b108-27b7-4454-a265-6310acb48fe8" containerName="cleanup" Jun 14 03:53:45.994961 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:45.994832 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f032b108-27b7-4454-a265-6310acb48fe8" containerName="cleanup" Jun 14 03:53:45.994961 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:45.994888 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f032b108-27b7-4454-a265-6310acb48fe8" containerName="cleanup" Jun 14 03:53:45.997876 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:45.997854 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.000356 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.000325 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1366af1e-openshift-default-dockercfg-8jl6f\"" Jun 14 03:53:46.019392 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.019367 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf"] Jun 14 03:53:46.101809 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.101763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-istio-data\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.101809 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.101808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-istio-envoy\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.102051 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.101838 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-workload-socket\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.102051 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.101863 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/138020cf-27e3-4f93-af76-ee15f511a00e-istiod-ca-cert\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.102051 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.101887 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf8zw\" (UniqueName: \"kubernetes.io/projected/138020cf-27e3-4f93-af76-ee15f511a00e-kube-api-access-bf8zw\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.102051 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.102010 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/138020cf-27e3-4f93-af76-ee15f511a00e-istio-podinfo\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.102275 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.102059 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/138020cf-27e3-4f93-af76-ee15f511a00e-istio-token\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.102275 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.102112 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-credential-socket\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.102275 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.102136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-workload-certs\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.203297 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.203260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/138020cf-27e3-4f93-af76-ee15f511a00e-istio-podinfo\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.203297 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.203300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/138020cf-27e3-4f93-af76-ee15f511a00e-istio-token\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.203539 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.203325 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-credential-socket\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.203539 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.203348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-workload-certs\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.203539 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.203440 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-istio-data\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.203539 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.203471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-istio-envoy\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.203539 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.203496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-workload-socket\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.203539 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.203522 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/138020cf-27e3-4f93-af76-ee15f511a00e-istiod-ca-cert\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.203850 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.203547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf8zw\" (UniqueName: \"kubernetes.io/projected/138020cf-27e3-4f93-af76-ee15f511a00e-kube-api-access-bf8zw\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.203850 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.203750 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-credential-socket\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.203850 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.203785 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-workload-certs\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.203850 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.203809 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-istio-data\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.204102 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.204073 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-workload-socket\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.204505 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.204475 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/138020cf-27e3-4f93-af76-ee15f511a00e-istiod-ca-cert\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.206153 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.206127 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-istio-envoy\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.206266 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.206183 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/138020cf-27e3-4f93-af76-ee15f511a00e-istio-podinfo\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.212257 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.212229 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/138020cf-27e3-4f93-af76-ee15f511a00e-istio-token\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.213309 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.213289 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf8zw\" (UniqueName: \"kubernetes.io/projected/138020cf-27e3-4f93-af76-ee15f511a00e-kube-api-access-bf8zw\") pod \"e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.309920 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.309835 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:46.449868 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.449834 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf"] Jun 14 03:53:46.452019 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:53:46.451976 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138020cf_27e3_4f93_af76_ee15f511a00e.slice/crio-7c82cc9c6ff632b6379ce4d551ade7eec078638712662c0b63491b9197353ad1 WatchSource:0}: Error finding container 7c82cc9c6ff632b6379ce4d551ade7eec078638712662c0b63491b9197353ad1: Status 404 returned error can't find the container with id 7c82cc9c6ff632b6379ce4d551ade7eec078638712662c0b63491b9197353ad1 Jun 14 03:53:46.454506 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.454475 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:53:46.454571 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.454540 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:53:46.454571 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:46.454567 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:53:47.226884 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:47.226848 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" event={"ID":"138020cf-27e3-4f93-af76-ee15f511a00e","Type":"ContainerStarted","Data":"63997b5a5fb41fa0efed4237d2dda0964bacfbab368f0fe5898a324627f82879"} Jun 14 03:53:47.227264 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:47.226971 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" event={"ID":"138020cf-27e3-4f93-af76-ee15f511a00e","Type":"ContainerStarted","Data":"7c82cc9c6ff632b6379ce4d551ade7eec078638712662c0b63491b9197353ad1"} Jun 14 03:53:47.248069 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:47.248025 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" podStartSLOduration=2.248010444 podStartE2EDuration="2.248010444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:53:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:53:47.245864766 +0000 UTC m=+2437.405007684" watchObservedRunningTime="2026-06-14 03:53:47.248010444 +0000 UTC m=+2437.407153347" Jun 14 03:53:47.310712 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:47.310681 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:47.315713 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:47.315690 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:48.231547 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:48.231511 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:48.232414 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:48.232395 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:52.446310 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:52.446270 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf"] Jun 14 03:53:52.446827 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:52.446592 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" podUID="138020cf-27e3-4f93-af76-ee15f511a00e" containerName="istio-proxy" containerID="cri-o://63997b5a5fb41fa0efed4237d2dda0964bacfbab368f0fe5898a324627f82879" gracePeriod=30 Jun 14 03:53:57.697248 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.697217 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:57.805503 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.805420 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-workload-socket\") pod \"138020cf-27e3-4f93-af76-ee15f511a00e\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " Jun 14 03:53:57.805503 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.805457 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/138020cf-27e3-4f93-af76-ee15f511a00e-istiod-ca-cert\") pod \"138020cf-27e3-4f93-af76-ee15f511a00e\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " Jun 14 03:53:57.805503 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.805482 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/138020cf-27e3-4f93-af76-ee15f511a00e-istio-token\") pod \"138020cf-27e3-4f93-af76-ee15f511a00e\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " Jun 14 03:53:57.805503 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.805506 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/138020cf-27e3-4f93-af76-ee15f511a00e-istio-podinfo\") pod \"138020cf-27e3-4f93-af76-ee15f511a00e\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " Jun 14 03:53:57.805806 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.805537 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-istio-envoy\") pod \"138020cf-27e3-4f93-af76-ee15f511a00e\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " Jun 14 03:53:57.805806 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.805570 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-credential-socket\") pod \"138020cf-27e3-4f93-af76-ee15f511a00e\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " Jun 14 03:53:57.805806 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.805631 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-workload-certs\") pod \"138020cf-27e3-4f93-af76-ee15f511a00e\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " Jun 14 03:53:57.805806 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.805672 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-istio-data\") pod \"138020cf-27e3-4f93-af76-ee15f511a00e\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " Jun 14 03:53:57.805806 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.805692 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf8zw\" (UniqueName: \"kubernetes.io/projected/138020cf-27e3-4f93-af76-ee15f511a00e-kube-api-access-bf8zw\") pod \"138020cf-27e3-4f93-af76-ee15f511a00e\" (UID: \"138020cf-27e3-4f93-af76-ee15f511a00e\") " Jun 14 03:53:57.805806 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.805765 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "138020cf-27e3-4f93-af76-ee15f511a00e" (UID: "138020cf-27e3-4f93-af76-ee15f511a00e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:53:57.806182 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.805982 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "138020cf-27e3-4f93-af76-ee15f511a00e" (UID: "138020cf-27e3-4f93-af76-ee15f511a00e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:53:57.806182 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.805892 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/138020cf-27e3-4f93-af76-ee15f511a00e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "138020cf-27e3-4f93-af76-ee15f511a00e" (UID: "138020cf-27e3-4f93-af76-ee15f511a00e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:53:57.806182 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.806021 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "138020cf-27e3-4f93-af76-ee15f511a00e" (UID: "138020cf-27e3-4f93-af76-ee15f511a00e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:53:57.806182 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.806032 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-istio-data" (OuterVolumeSpecName: "istio-data") pod "138020cf-27e3-4f93-af76-ee15f511a00e" (UID: "138020cf-27e3-4f93-af76-ee15f511a00e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:53:57.806447 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.806362 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:53:57.806537 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.806512 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:53:57.806537 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.806526 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/138020cf-27e3-4f93-af76-ee15f511a00e-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:53:57.806638 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.806539 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:53:57.806638 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.806553 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:53:57.808115 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.808085 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/138020cf-27e3-4f93-af76-ee15f511a00e-istio-token" (OuterVolumeSpecName: "istio-token") pod "138020cf-27e3-4f93-af76-ee15f511a00e" (UID: "138020cf-27e3-4f93-af76-ee15f511a00e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:53:57.808213 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.808136 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "138020cf-27e3-4f93-af76-ee15f511a00e" (UID: "138020cf-27e3-4f93-af76-ee15f511a00e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:53:57.808213 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.808196 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/138020cf-27e3-4f93-af76-ee15f511a00e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "138020cf-27e3-4f93-af76-ee15f511a00e" (UID: "138020cf-27e3-4f93-af76-ee15f511a00e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 14 03:53:57.808284 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.808264 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/138020cf-27e3-4f93-af76-ee15f511a00e-kube-api-access-bf8zw" (OuterVolumeSpecName: "kube-api-access-bf8zw") pod "138020cf-27e3-4f93-af76-ee15f511a00e" (UID: "138020cf-27e3-4f93-af76-ee15f511a00e"). InnerVolumeSpecName "kube-api-access-bf8zw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:53:57.907701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.907661 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf8zw\" (UniqueName: \"kubernetes.io/projected/138020cf-27e3-4f93-af76-ee15f511a00e-kube-api-access-bf8zw\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:53:57.907701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.907693 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/138020cf-27e3-4f93-af76-ee15f511a00e-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:53:57.907701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.907703 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/138020cf-27e3-4f93-af76-ee15f511a00e-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:53:57.907701 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:57.907711 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/138020cf-27e3-4f93-af76-ee15f511a00e-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:53:58.280625 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.280594 2581 generic.go:356] "Generic (PLEG): container finished" podID="138020cf-27e3-4f93-af76-ee15f511a00e" containerID="63997b5a5fb41fa0efed4237d2dda0964bacfbab368f0fe5898a324627f82879" exitCode=0 Jun 14 03:53:58.280835 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.280644 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" Jun 14 03:53:58.280835 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.280682 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" event={"ID":"138020cf-27e3-4f93-af76-ee15f511a00e","Type":"ContainerDied","Data":"63997b5a5fb41fa0efed4237d2dda0964bacfbab368f0fe5898a324627f82879"} Jun 14 03:53:58.280835 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.280772 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf" event={"ID":"138020cf-27e3-4f93-af76-ee15f511a00e","Type":"ContainerDied","Data":"7c82cc9c6ff632b6379ce4d551ade7eec078638712662c0b63491b9197353ad1"} Jun 14 03:53:58.280835 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.280803 2581 scope.go:117] "RemoveContainer" containerID="63997b5a5fb41fa0efed4237d2dda0964bacfbab368f0fe5898a324627f82879" Jun 14 03:53:58.290819 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.290803 2581 scope.go:117] "RemoveContainer" containerID="63997b5a5fb41fa0efed4237d2dda0964bacfbab368f0fe5898a324627f82879" Jun 14 03:53:58.291113 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:53:58.291091 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63997b5a5fb41fa0efed4237d2dda0964bacfbab368f0fe5898a324627f82879\": container with ID starting with 63997b5a5fb41fa0efed4237d2dda0964bacfbab368f0fe5898a324627f82879 not found: ID does not exist" containerID="63997b5a5fb41fa0efed4237d2dda0964bacfbab368f0fe5898a324627f82879" Jun 14 03:53:58.291174 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.291132 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63997b5a5fb41fa0efed4237d2dda0964bacfbab368f0fe5898a324627f82879"} err="failed to get container status \"63997b5a5fb41fa0efed4237d2dda0964bacfbab368f0fe5898a324627f82879\": rpc error: code = NotFound desc = could not find container \"63997b5a5fb41fa0efed4237d2dda0964bacfbab368f0fe5898a324627f82879\": container with ID starting with 63997b5a5fb41fa0efed4237d2dda0964bacfbab368f0fe5898a324627f82879 not found: ID does not exist" Jun 14 03:53:58.306266 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.306241 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf"] Jun 14 03:53:58.312373 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.312350 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1366af1e-openshift-default-6d769df5fb-fd4sf"] Jun 14 03:53:58.348514 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.348488 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68"] Jun 14 03:53:58.349000 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.348980 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="138020cf-27e3-4f93-af76-ee15f511a00e" containerName="istio-proxy" Jun 14 03:53:58.349000 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.348998 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="138020cf-27e3-4f93-af76-ee15f511a00e" containerName="istio-proxy" Jun 14 03:53:58.349194 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.349075 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="138020cf-27e3-4f93-af76-ee15f511a00e" containerName="istio-proxy" Jun 14 03:53:58.353656 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.353634 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.356140 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.356121 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-397736e7-openshift-default-dockercfg-bt2wm\"" Jun 14 03:53:58.362743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.362720 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68"] Jun 14 03:53:58.411920 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.411888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-data\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.412092 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.411923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-workload-socket\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.412092 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.412010 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istiod-ca-cert\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.412166 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.412099 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-envoy\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.412166 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.412123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-workload-certs\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.412166 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.412139 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-podinfo\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.412166 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.412157 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj858\" (UniqueName: \"kubernetes.io/projected/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-kube-api-access-rj858\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.412357 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.412176 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-credential-socket\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.412357 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.412267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-token\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.512906 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.512869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-envoy\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.512906 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.512910 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-workload-certs\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.513169 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.512982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-podinfo\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.513169 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.513002 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj858\" (UniqueName: \"kubernetes.io/projected/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-kube-api-access-rj858\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.513169 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.513029 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-credential-socket\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.513351 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.513285 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-token\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.513476 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.513438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-data\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.513476 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.513471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-workload-socket\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.513666 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.513496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istiod-ca-cert\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.513666 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.513565 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-workload-certs\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.513666 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.513602 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-credential-socket\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.513850 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.513825 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-workload-socket\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.513892 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.513778 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-data\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.514212 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.514191 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istiod-ca-cert\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.515667 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.515649 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-podinfo\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.515957 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.515903 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-envoy\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.521841 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.521817 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-token\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.522101 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.522083 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj858\" (UniqueName: \"kubernetes.io/projected/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-kube-api-access-rj858\") pod \"e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.665838 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.665810 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:58.801772 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.801733 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68"] Jun 14 03:53:58.803895 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:53:58.803871 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28da8eaf_d5ea_46e8_94db_074d02f8e0f3.slice/crio-24e18b1336feac77897b5164bbc52c0f7669f951dc950452e21e2672ea546dfe WatchSource:0}: Error finding container 24e18b1336feac77897b5164bbc52c0f7669f951dc950452e21e2672ea546dfe: Status 404 returned error can't find the container with id 24e18b1336feac77897b5164bbc52c0f7669f951dc950452e21e2672ea546dfe Jun 14 03:53:58.806264 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.806225 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:53:58.806331 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.806313 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:53:58.806399 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:58.806384 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 03:53:59.289249 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:59.289144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" event={"ID":"28da8eaf-d5ea-46e8-94db-074d02f8e0f3","Type":"ContainerStarted","Data":"fcf6318177af8a63721d79d212c193a439c9c366d32b2e2dec714bf12b3302a0"} Jun 14 03:53:59.289249 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:59.289200 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" event={"ID":"28da8eaf-d5ea-46e8-94db-074d02f8e0f3","Type":"ContainerStarted","Data":"24e18b1336feac77897b5164bbc52c0f7669f951dc950452e21e2672ea546dfe"} Jun 14 03:53:59.308693 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:59.308650 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" podStartSLOduration=1.3086337430000001 podStartE2EDuration="1.308633743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:53:59.307135276 +0000 UTC m=+2449.466278205" watchObservedRunningTime="2026-06-14 03:53:59.308633743 +0000 UTC m=+2449.467776647" Jun 14 03:53:59.666145 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:59.666114 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:53:59.670962 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:53:59.670921 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:54:00.299116 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:00.299087 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="138020cf-27e3-4f93-af76-ee15f511a00e" path="/var/lib/kubelet/pods/138020cf-27e3-4f93-af76-ee15f511a00e/volumes" Jun 14 03:54:00.299483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:00.299337 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:54:00.299483 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:00.299390 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:54:05.788010 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:05.787966 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68"] Jun 14 03:54:05.788392 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:05.788149 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" podUID="28da8eaf-d5ea-46e8-94db-074d02f8e0f3" containerName="istio-proxy" containerID="cri-o://fcf6318177af8a63721d79d212c193a439c9c366d32b2e2dec714bf12b3302a0" gracePeriod=30 Jun 14 03:54:11.037384 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.037359 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:54:11.127169 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.127137 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-podinfo\") pod \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " Jun 14 03:54:11.127343 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.127198 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-data\") pod \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " Jun 14 03:54:11.127343 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.127218 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-workload-certs\") pod \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " Jun 14 03:54:11.127343 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.127239 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istiod-ca-cert\") pod \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " Jun 14 03:54:11.127343 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.127255 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-token\") pod \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " Jun 14 03:54:11.127343 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.127274 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-envoy\") pod \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " Jun 14 03:54:11.127343 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.127310 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-workload-socket\") pod \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " Jun 14 03:54:11.127768 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.127383 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-credential-socket\") pod \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " Jun 14 03:54:11.127768 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.127420 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj858\" (UniqueName: \"kubernetes.io/projected/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-kube-api-access-rj858\") pod \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\" (UID: \"28da8eaf-d5ea-46e8-94db-074d02f8e0f3\") " Jun 14 03:54:11.127959 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.127910 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "28da8eaf-d5ea-46e8-94db-074d02f8e0f3" (UID: "28da8eaf-d5ea-46e8-94db-074d02f8e0f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:54:11.128046 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.127921 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "28da8eaf-d5ea-46e8-94db-074d02f8e0f3" (UID: "28da8eaf-d5ea-46e8-94db-074d02f8e0f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:54:11.128046 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.127963 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "28da8eaf-d5ea-46e8-94db-074d02f8e0f3" (UID: "28da8eaf-d5ea-46e8-94db-074d02f8e0f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:54:11.128275 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.128072 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "28da8eaf-d5ea-46e8-94db-074d02f8e0f3" (UID: "28da8eaf-d5ea-46e8-94db-074d02f8e0f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:54:11.128275 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.128112 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "28da8eaf-d5ea-46e8-94db-074d02f8e0f3" (UID: "28da8eaf-d5ea-46e8-94db-074d02f8e0f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:54:11.129662 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.129633 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "28da8eaf-d5ea-46e8-94db-074d02f8e0f3" (UID: "28da8eaf-d5ea-46e8-94db-074d02f8e0f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:54:11.129750 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.129680 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "28da8eaf-d5ea-46e8-94db-074d02f8e0f3" (UID: "28da8eaf-d5ea-46e8-94db-074d02f8e0f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:54:11.129921 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.129904 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "28da8eaf-d5ea-46e8-94db-074d02f8e0f3" (UID: "28da8eaf-d5ea-46e8-94db-074d02f8e0f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 14 03:54:11.130199 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.130179 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-kube-api-access-rj858" (OuterVolumeSpecName: "kube-api-access-rj858") pod "28da8eaf-d5ea-46e8-94db-074d02f8e0f3" (UID: "28da8eaf-d5ea-46e8-94db-074d02f8e0f3"). InnerVolumeSpecName "kube-api-access-rj858". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:54:11.229025 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.228999 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:54:11.229025 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.229022 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj858\" (UniqueName: \"kubernetes.io/projected/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-kube-api-access-rj858\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:54:11.229179 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.229032 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:54:11.229179 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.229041 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:54:11.229179 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.229049 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:54:11.229179 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.229058 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:54:11.229179 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.229069 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:54:11.229179 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.229080 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:54:11.229179 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.229089 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28da8eaf-d5ea-46e8-94db-074d02f8e0f3-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jun 14 03:54:11.344565 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.344525 2581 generic.go:356] "Generic (PLEG): container finished" podID="28da8eaf-d5ea-46e8-94db-074d02f8e0f3" containerID="fcf6318177af8a63721d79d212c193a439c9c366d32b2e2dec714bf12b3302a0" exitCode=0 Jun 14 03:54:11.344730 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.344578 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" Jun 14 03:54:11.344730 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.344593 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" event={"ID":"28da8eaf-d5ea-46e8-94db-074d02f8e0f3","Type":"ContainerDied","Data":"fcf6318177af8a63721d79d212c193a439c9c366d32b2e2dec714bf12b3302a0"} Jun 14 03:54:11.344730 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.344643 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68" event={"ID":"28da8eaf-d5ea-46e8-94db-074d02f8e0f3","Type":"ContainerDied","Data":"24e18b1336feac77897b5164bbc52c0f7669f951dc950452e21e2672ea546dfe"} Jun 14 03:54:11.344730 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.344673 2581 scope.go:117] "RemoveContainer" containerID="fcf6318177af8a63721d79d212c193a439c9c366d32b2e2dec714bf12b3302a0" Jun 14 03:54:11.354663 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.354645 2581 scope.go:117] "RemoveContainer" containerID="fcf6318177af8a63721d79d212c193a439c9c366d32b2e2dec714bf12b3302a0" Jun 14 03:54:11.354910 ip-10-0-138-133 kubenswrapper[2581]: E0614 03:54:11.354887 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcf6318177af8a63721d79d212c193a439c9c366d32b2e2dec714bf12b3302a0\": container with ID starting with fcf6318177af8a63721d79d212c193a439c9c366d32b2e2dec714bf12b3302a0 not found: ID does not exist" containerID="fcf6318177af8a63721d79d212c193a439c9c366d32b2e2dec714bf12b3302a0" Jun 14 03:54:11.355025 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.354913 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcf6318177af8a63721d79d212c193a439c9c366d32b2e2dec714bf12b3302a0"} err="failed to get container status \"fcf6318177af8a63721d79d212c193a439c9c366d32b2e2dec714bf12b3302a0\": rpc error: code = NotFound desc = could not find container \"fcf6318177af8a63721d79d212c193a439c9c366d32b2e2dec714bf12b3302a0\": container with ID starting with fcf6318177af8a63721d79d212c193a439c9c366d32b2e2dec714bf12b3302a0 not found: ID does not exist" Jun 14 03:54:11.368039 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.368017 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68"] Jun 14 03:54:11.371683 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:11.371660 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-397736e7-openshift-default-6f7dbf6d7b-4pb68"] Jun 14 03:54:12.303962 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:12.303914 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28da8eaf-d5ea-46e8-94db-074d02f8e0f3" path="/var/lib/kubelet/pods/28da8eaf-d5ea-46e8-94db-074d02f8e0f3/volumes" Jun 14 03:54:18.060104 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:18.060072 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c8b7b845b-7vnmh_d10e221f-fe8a-4a48-8596-3dd00e380bce/authorino/0.log" Jun 14 03:54:22.620867 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:22.620839 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d54cc8554-zx4vm_6ec91a46-5222-4fdf-8608-7bb43486bcb4/nginx/0.log" Jun 14 03:54:23.105412 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:23.105333 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29690130-5z8zj_ec88d297-0b1b-4d8d-8682-f7ffde4961e7/cleanup/0.log" Jun 14 03:54:23.213244 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:23.213218 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29690145-zrhct_f032b108-27b7-4454-a265-6310acb48fe8/cleanup/0.log" Jun 14 03:54:23.924747 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:23.924720 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb65bb8c8-svqzw_c86a5358-899b-4970-9035-f16b1258280e/copy-manifests/0.log" Jun 14 03:54:23.938700 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:23.938676 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb65bb8c8-svqzw_c86a5358-899b-4970-9035-f16b1258280e/manager/0.log" Jun 14 03:54:24.054418 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:24.054386 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-gh8n8_7521b465-499f-41cd-9f2a-6e9af60cce65/postgres/0.log" Jun 14 03:54:25.304321 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:25.304292 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c8b7b845b-7vnmh_d10e221f-fe8a-4a48-8596-3dd00e380bce/authorino/0.log" Jun 14 03:54:25.550525 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:25.550501 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qzqfg_3f6af334-d711-4c51-8e15-a445de51258c/manager/0.log" Jun 14 03:54:25.780348 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:25.780313 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6bbjg_81ee4d61-d499-436e-b8b7-2cc5662e461f/registry-server/0.log" Jun 14 03:54:25.899941 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:25.899897 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mr9x9_031b4180-8e38-4019-bc94-f13622eef926/manager/0.log" Jun 14 03:54:26.488868 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:26.488834 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sd8pc_fb40c3e7-5b08-4277-ac47-3f471eba334c/istio-proxy/0.log" Jun 14 03:54:26.943805 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:26.943775 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lwpgd_490a1968-f136-43d8-877e-e72b8feaf0c5/istio-proxy/1.log" Jun 14 03:54:27.172586 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:27.172550 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8w7kc_02b97dc8-d2fc-4763-9dc7-c941119df34e/payload-processing/0.log" Jun 14 03:54:31.861692 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:31.861660 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hm758/must-gather-qmxm5"] Jun 14 03:54:31.862115 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:31.862019 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28da8eaf-d5ea-46e8-94db-074d02f8e0f3" containerName="istio-proxy" Jun 14 03:54:31.862115 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:31.862031 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="28da8eaf-d5ea-46e8-94db-074d02f8e0f3" containerName="istio-proxy" Jun 14 03:54:31.862115 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:31.862093 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="28da8eaf-d5ea-46e8-94db-074d02f8e0f3" containerName="istio-proxy" Jun 14 03:54:31.865266 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:31.865246 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm758/must-gather-qmxm5" Jun 14 03:54:31.870257 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:31.870217 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hm758\"/\"openshift-service-ca.crt\"" Jun 14 03:54:31.870257 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:31.870247 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hm758\"/\"kube-root-ca.crt\"" Jun 14 03:54:31.870491 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:31.870248 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hm758\"/\"default-dockercfg-xdkrk\"" Jun 14 03:54:31.873658 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:31.873632 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm758/must-gather-qmxm5"] Jun 14 03:54:31.906988 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:31.906943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ln2m\" (UniqueName: \"kubernetes.io/projected/0ce31a1d-f293-489b-abe4-3956f693cd4a-kube-api-access-8ln2m\") pod \"must-gather-qmxm5\" (UID: \"0ce31a1d-f293-489b-abe4-3956f693cd4a\") " pod="openshift-must-gather-hm758/must-gather-qmxm5" Jun 14 03:54:31.907164 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:31.907034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0ce31a1d-f293-489b-abe4-3956f693cd4a-must-gather-output\") pod \"must-gather-qmxm5\" (UID: \"0ce31a1d-f293-489b-abe4-3956f693cd4a\") " pod="openshift-must-gather-hm758/must-gather-qmxm5" Jun 14 03:54:32.008029 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:32.007983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ln2m\" (UniqueName: \"kubernetes.io/projected/0ce31a1d-f293-489b-abe4-3956f693cd4a-kube-api-access-8ln2m\") pod \"must-gather-qmxm5\" (UID: \"0ce31a1d-f293-489b-abe4-3956f693cd4a\") " pod="openshift-must-gather-hm758/must-gather-qmxm5" Jun 14 03:54:32.008218 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:32.008076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0ce31a1d-f293-489b-abe4-3956f693cd4a-must-gather-output\") pod \"must-gather-qmxm5\" (UID: \"0ce31a1d-f293-489b-abe4-3956f693cd4a\") " pod="openshift-must-gather-hm758/must-gather-qmxm5" Jun 14 03:54:32.008448 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:32.008428 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0ce31a1d-f293-489b-abe4-3956f693cd4a-must-gather-output\") pod \"must-gather-qmxm5\" (UID: \"0ce31a1d-f293-489b-abe4-3956f693cd4a\") " pod="openshift-must-gather-hm758/must-gather-qmxm5" Jun 14 03:54:32.015748 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:32.015725 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ln2m\" (UniqueName: \"kubernetes.io/projected/0ce31a1d-f293-489b-abe4-3956f693cd4a-kube-api-access-8ln2m\") pod \"must-gather-qmxm5\" (UID: \"0ce31a1d-f293-489b-abe4-3956f693cd4a\") " pod="openshift-must-gather-hm758/must-gather-qmxm5" Jun 14 03:54:32.175709 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:32.175685 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm758/must-gather-qmxm5" Jun 14 03:54:32.317707 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:32.317676 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm758/must-gather-qmxm5"] Jun 14 03:54:32.318942 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:54:32.318902 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ce31a1d_f293_489b_abe4_3956f693cd4a.slice/crio-e60e0c9347651fdeca901fbcb056b1bf4d87aabc304a3d15c3c504e87bb5da06 WatchSource:0}: Error finding container e60e0c9347651fdeca901fbcb056b1bf4d87aabc304a3d15c3c504e87bb5da06: Status 404 returned error can't find the container with id e60e0c9347651fdeca901fbcb056b1bf4d87aabc304a3d15c3c504e87bb5da06 Jun 14 03:54:32.320820 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:32.320805 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 03:54:32.442118 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:32.442053 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm758/must-gather-qmxm5" event={"ID":"0ce31a1d-f293-489b-abe4-3956f693cd4a","Type":"ContainerStarted","Data":"e60e0c9347651fdeca901fbcb056b1bf4d87aabc304a3d15c3c504e87bb5da06"} Jun 14 03:54:33.452347 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:33.452302 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm758/must-gather-qmxm5" event={"ID":"0ce31a1d-f293-489b-abe4-3956f693cd4a","Type":"ContainerStarted","Data":"e63fe94323233ae5100dfebd191d0bd995cc5b0b31f1f71330c587d686f73ec0"} Jun 14 03:54:33.452825 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:33.452363 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm758/must-gather-qmxm5" event={"ID":"0ce31a1d-f293-489b-abe4-3956f693cd4a","Type":"ContainerStarted","Data":"d9970a12380cb1bede0962997822624b39657fef607f271bfb199166ffdb6256"} Jun 14 03:54:33.469634 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:33.469365 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hm758/must-gather-qmxm5" podStartSLOduration=1.7360024680000001 podStartE2EDuration="2.469342865s" totalImagesPullingTime="733.340397ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:54:33.467286474 +0000 UTC m=+2483.626429379" watchObservedRunningTime="2026-06-14 03:54:33.469342865 +0000 UTC m=+2483.628485769" Jun 14 03:54:34.784498 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:34.784460 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vlbgl_f8fda1d3-bf38-4112-9d1c-89cb07a96a5e/global-pull-secret-syncer/0.log" Jun 14 03:54:34.961104 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:34.961076 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qlsqz_01806094-2ac6-494a-8e17-2d782d2b4dbf/konnectivity-agent/0.log" Jun 14 03:54:35.008517 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:35.008486 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-133.ec2.internal_4eba8bc83e04f869575af54c451335cc/haproxy/0.log" Jun 14 03:54:40.260433 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:40.258008 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c8b7b845b-7vnmh_d10e221f-fe8a-4a48-8596-3dd00e380bce/authorino/0.log" Jun 14 03:54:40.316674 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:40.316636 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qzqfg_3f6af334-d711-4c51-8e15-a445de51258c/manager/0.log" Jun 14 03:54:40.384710 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:40.384673 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6bbjg_81ee4d61-d499-436e-b8b7-2cc5662e461f/registry-server/0.log" Jun 14 03:54:40.478228 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:40.478035 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mr9x9_031b4180-8e38-4019-bc94-f13622eef926/manager/0.log" Jun 14 03:54:42.140428 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:42.140381 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e809a410-a9c0-45be-b061-8d39d670ae4f/alertmanager/0.log" Jun 14 03:54:42.164546 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:42.164521 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e809a410-a9c0-45be-b061-8d39d670ae4f/config-reloader/0.log" Jun 14 03:54:42.186103 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:42.186078 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e809a410-a9c0-45be-b061-8d39d670ae4f/kube-rbac-proxy-web/0.log" Jun 14 03:54:42.210740 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:42.210716 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e809a410-a9c0-45be-b061-8d39d670ae4f/kube-rbac-proxy/0.log" Jun 14 03:54:42.240478 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:42.240436 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e809a410-a9c0-45be-b061-8d39d670ae4f/kube-rbac-proxy-metric/0.log" Jun 14 03:54:42.261375 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:42.261347 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e809a410-a9c0-45be-b061-8d39d670ae4f/prom-label-proxy/0.log" Jun 14 03:54:42.283068 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:42.283036 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e809a410-a9c0-45be-b061-8d39d670ae4f/init-config-reloader/0.log" Jun 14 03:54:42.327021 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:42.326983 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-hshdf_e62edaa5-d92e-4400-b1bf-16fab4998321/cluster-monitoring-operator/0.log" Jun 14 03:54:42.461086 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:42.460997 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-cdkf2_2841f9a8-f60e-49b4-a365-4b341eeb072b/monitoring-plugin/0.log" Jun 14 03:54:42.615785 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:42.615750 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ttr6d_0e37088a-d74f-4509-b481-0aa915bc9145/node-exporter/0.log" Jun 14 03:54:42.641086 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:42.641056 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ttr6d_0e37088a-d74f-4509-b481-0aa915bc9145/kube-rbac-proxy/0.log" Jun 14 03:54:42.666825 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:42.666798 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ttr6d_0e37088a-d74f-4509-b481-0aa915bc9145/init-textfile/0.log" Jun 14 03:54:43.135005 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:43.134895 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-568677f997-9swjq_a2ec6dec-7aa7-42dc-94b0-1c6798183753/telemeter-client/0.log" Jun 14 03:54:43.161724 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:43.161695 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-568677f997-9swjq_a2ec6dec-7aa7-42dc-94b0-1c6798183753/reload/0.log" Jun 14 03:54:43.179047 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:43.179022 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-568677f997-9swjq_a2ec6dec-7aa7-42dc-94b0-1c6798183753/kube-rbac-proxy/0.log" Jun 14 03:54:45.979154 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:45.979114 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56dbd6b9b7-7jdkq_67a84267-3915-401e-8cfb-224aa0e2c2d7/console/0.log" Jun 14 03:54:46.646110 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.646071 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hm758/perf-node-gather-daemonset-g7927"] Jun 14 03:54:46.654256 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.654223 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.659661 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.659599 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm758/perf-node-gather-daemonset-g7927"] Jun 14 03:54:46.773837 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.773790 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/88e10b7c-74e7-4d75-a734-922af48fd086-proc\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.774053 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.773853 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/88e10b7c-74e7-4d75-a734-922af48fd086-podres\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.774053 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.773888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88e10b7c-74e7-4d75-a734-922af48fd086-lib-modules\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.774053 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.773915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88e10b7c-74e7-4d75-a734-922af48fd086-sys\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.774053 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.773966 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh442\" (UniqueName: \"kubernetes.io/projected/88e10b7c-74e7-4d75-a734-922af48fd086-kube-api-access-hh442\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.875476 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.875435 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh442\" (UniqueName: \"kubernetes.io/projected/88e10b7c-74e7-4d75-a734-922af48fd086-kube-api-access-hh442\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.875887 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.875861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/88e10b7c-74e7-4d75-a734-922af48fd086-proc\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.876054 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.876032 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/88e10b7c-74e7-4d75-a734-922af48fd086-proc\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.876161 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.876067 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/88e10b7c-74e7-4d75-a734-922af48fd086-podres\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.876271 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.876257 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88e10b7c-74e7-4d75-a734-922af48fd086-lib-modules\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.876384 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.876354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88e10b7c-74e7-4d75-a734-922af48fd086-sys\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.876479 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.876173 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/88e10b7c-74e7-4d75-a734-922af48fd086-podres\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.876652 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.876619 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88e10b7c-74e7-4d75-a734-922af48fd086-lib-modules\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.876652 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.876634 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88e10b7c-74e7-4d75-a734-922af48fd086-sys\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.883588 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.883557 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh442\" (UniqueName: \"kubernetes.io/projected/88e10b7c-74e7-4d75-a734-922af48fd086-kube-api-access-hh442\") pod \"perf-node-gather-daemonset-g7927\" (UID: \"88e10b7c-74e7-4d75-a734-922af48fd086\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:46.974382 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:46.974292 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:47.155969 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:47.154872 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm758/perf-node-gather-daemonset-g7927"] Jun 14 03:54:47.161245 ip-10-0-138-133 kubenswrapper[2581]: W0614 03:54:47.161209 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod88e10b7c_74e7_4d75_a734_922af48fd086.slice/crio-38969827dd710fb07d909108f7b88249194023e04e5a0ca89a1e5f9082e0baba WatchSource:0}: Error finding container 38969827dd710fb07d909108f7b88249194023e04e5a0ca89a1e5f9082e0baba: Status 404 returned error can't find the container with id 38969827dd710fb07d909108f7b88249194023e04e5a0ca89a1e5f9082e0baba Jun 14 03:54:47.572628 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:47.572522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" event={"ID":"88e10b7c-74e7-4d75-a734-922af48fd086","Type":"ContainerStarted","Data":"e17c5bcfff8a0d7958c0e53456eb8729c525f90be15ac334422b3298d79f2611"} Jun 14 03:54:47.572628 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:47.572615 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" event={"ID":"88e10b7c-74e7-4d75-a734-922af48fd086","Type":"ContainerStarted","Data":"38969827dd710fb07d909108f7b88249194023e04e5a0ca89a1e5f9082e0baba"} Jun 14 03:54:47.572859 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:47.572696 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:47.587888 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:47.587837 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" podStartSLOduration=1.5878219740000001 podStartE2EDuration="1.587821974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:54:47.586438508 +0000 UTC m=+2497.745581414" watchObservedRunningTime="2026-06-14 03:54:47.587821974 +0000 UTC m=+2497.746964877" Jun 14 03:54:47.945629 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:47.945601 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rggv2_f4fa9ace-4554-47df-9837-f3654d47b791/dns/0.log" Jun 14 03:54:47.964874 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:47.964845 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rggv2_f4fa9ace-4554-47df-9837-f3654d47b791/kube-rbac-proxy/0.log" Jun 14 03:54:47.986585 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:47.986561 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6cqlb_ab17fc73-f1d8-47d4-8d65-26cf473dbd8c/dns-node-resolver/0.log" Jun 14 03:54:48.620642 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:48.620615 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s6rwj_7aed657b-71d4-4eee-bea2-c86f8183cf31/node-ca/0.log" Jun 14 03:54:49.548565 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:49.548531 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sd8pc_fb40c3e7-5b08-4277-ac47-3f471eba334c/istio-proxy/0.log" Jun 14 03:54:49.686272 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:49.686236 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lwpgd_490a1968-f136-43d8-877e-e72b8feaf0c5/istio-proxy/0.log" Jun 14 03:54:49.730441 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:49.730405 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lwpgd_490a1968-f136-43d8-877e-e72b8feaf0c5/istio-proxy/1.log" Jun 14 03:54:49.828267 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:49.828193 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8w7kc_02b97dc8-d2fc-4763-9dc7-c941119df34e/payload-processing/0.log" Jun 14 03:54:50.496645 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:50.496613 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gfm2z_19be7501-2da6-48b0-945c-6d519237edcb/serve-healthcheck-canary/0.log" Jun 14 03:54:51.042520 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:51.042491 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jz99q_aab25c71-9578-4a64-9b09-021821ca1e63/kube-rbac-proxy/0.log" Jun 14 03:54:51.061866 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:51.061839 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jz99q_aab25c71-9578-4a64-9b09-021821ca1e63/exporter/0.log" Jun 14 03:54:51.083576 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:51.083541 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jz99q_aab25c71-9578-4a64-9b09-021821ca1e63/extractor/0.log" Jun 14 03:54:53.524182 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:53.524142 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d54cc8554-zx4vm_6ec91a46-5222-4fdf-8608-7bb43486bcb4/nginx/0.log" Jun 14 03:54:53.594076 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:53.594036 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-g7927" Jun 14 03:54:53.676713 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:53.676688 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29690130-5z8zj_ec88d297-0b1b-4d8d-8682-f7ffde4961e7/cleanup/0.log" Jun 14 03:54:53.699787 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:53.699763 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29690145-zrhct_f032b108-27b7-4454-a265-6310acb48fe8/cleanup/0.log" Jun 14 03:54:54.045533 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:54.045500 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb65bb8c8-svqzw_c86a5358-899b-4970-9035-f16b1258280e/manager/0.log" Jun 14 03:54:54.061522 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:54.061497 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb65bb8c8-svqzw_c86a5358-899b-4970-9035-f16b1258280e/copy-manifests/0.log" Jun 14 03:54:54.087160 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:54.087135 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-gh8n8_7521b465-499f-41cd-9f2a-6e9af60cce65/postgres/0.log" Jun 14 03:54:55.712405 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:54:55.712358 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bfc4d86bf-r676f_9177afb9-c7dc-4760-9154-8dc6456d2d47/manager/0.log" Jun 14 03:55:00.096572 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:00.096535 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sd8pc_fb40c3e7-5b08-4277-ac47-3f471eba334c/istio-proxy/0.log" Jun 14 03:55:00.202195 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:00.202154 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lwpgd_490a1968-f136-43d8-877e-e72b8feaf0c5/istio-proxy/0.log" Jun 14 03:55:00.248462 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:00.248394 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lwpgd_490a1968-f136-43d8-877e-e72b8feaf0c5/istio-proxy/1.log" Jun 14 03:55:00.341114 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:00.341089 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8w7kc_02b97dc8-d2fc-4763-9dc7-c941119df34e/payload-processing/0.log" Jun 14 03:55:01.586073 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:01.586039 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sd8pc_fb40c3e7-5b08-4277-ac47-3f471eba334c/istio-proxy/0.log" Jun 14 03:55:01.694708 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:01.694664 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lwpgd_490a1968-f136-43d8-877e-e72b8feaf0c5/istio-proxy/0.log" Jun 14 03:55:01.737461 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:01.737434 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lwpgd_490a1968-f136-43d8-877e-e72b8feaf0c5/istio-proxy/1.log" Jun 14 03:55:01.826961 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:01.825998 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8w7kc_02b97dc8-d2fc-4763-9dc7-c941119df34e/payload-processing/0.log" Jun 14 03:55:02.702536 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:02.702507 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcnf6_fd57bf24-0839-4aa8-be56-63233ae1bce5/kube-multus-additional-cni-plugins/0.log" Jun 14 03:55:02.723472 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:02.723446 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcnf6_fd57bf24-0839-4aa8-be56-63233ae1bce5/egress-router-binary-copy/0.log" Jun 14 03:55:02.744379 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:02.744327 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcnf6_fd57bf24-0839-4aa8-be56-63233ae1bce5/cni-plugins/0.log" Jun 14 03:55:02.764905 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:02.764872 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcnf6_fd57bf24-0839-4aa8-be56-63233ae1bce5/bond-cni-plugin/0.log" Jun 14 03:55:02.784837 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:02.784774 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcnf6_fd57bf24-0839-4aa8-be56-63233ae1bce5/routeoverride-cni/0.log" Jun 14 03:55:02.805651 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:02.805600 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcnf6_fd57bf24-0839-4aa8-be56-63233ae1bce5/whereabouts-cni-bincopy/0.log" Jun 14 03:55:02.827461 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:02.827437 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcnf6_fd57bf24-0839-4aa8-be56-63233ae1bce5/whereabouts-cni/0.log" Jun 14 03:55:03.181084 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:03.181055 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cmhxd_d33e80b6-3b15-4ac9-be4a-48e8e4ec1bba/kube-multus/0.log" Jun 14 03:55:03.316743 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:03.316706 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lwmb5_6aef466d-2db1-4d24-9c58-bf3c6859587f/network-metrics-daemon/0.log" Jun 14 03:55:03.335446 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:03.335416 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lwmb5_6aef466d-2db1-4d24-9c58-bf3c6859587f/kube-rbac-proxy/0.log" Jun 14 03:55:03.596088 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:03.596021 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sd8pc_fb40c3e7-5b08-4277-ac47-3f471eba334c/istio-proxy/0.log" Jun 14 03:55:03.695656 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:03.695626 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lwpgd_490a1968-f136-43d8-877e-e72b8feaf0c5/istio-proxy/0.log" Jun 14 03:55:03.737481 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:03.737446 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lwpgd_490a1968-f136-43d8-877e-e72b8feaf0c5/istio-proxy/1.log" Jun 14 03:55:03.819965 ip-10-0-138-133 kubenswrapper[2581]: I0614 03:55:03.819913 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8w7kc_02b97dc8-d2fc-4763-9dc7-c941119df34e/payload-processing/0.log"