Jun 11 13:10:29.739700 ip-10-0-140-41 systemd[1]: Starting Kubernetes Kubelet... Jun 11 13:10:30.123832 ip-10-0-140-41 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 13:10:30.123832 ip-10-0-140-41 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 13:10:30.123832 ip-10-0-140-41 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 13:10:30.123832 ip-10-0-140-41 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 13:10:30.123832 ip-10-0-140-41 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 13:10:30.125018 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.124928 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 13:10:30.131701 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131673 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:10:30.131701 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131698 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:10:30.131701 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131702 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:10:30.131701 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131705 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:10:30.131701 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131709 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131713 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131716 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131719 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131722 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131725 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131728 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131733 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131737 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131741 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131745 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131749 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131753 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131756 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131759 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131765 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131768 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131770 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131773 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:10:30.131892 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131775 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131778 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131783 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131786 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131789 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131792 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131795 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131797 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131800 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131803 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131806 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131808 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131812 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131814 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131817 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131820 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131823 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131825 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131828 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:10:30.132366 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131831 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131834 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131837 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131839 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131842 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131845 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131847 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131850 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131859 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131862 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131865 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131867 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131870 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131872 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131875 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131877 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131879 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131882 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131885 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131887 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:10:30.132840 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131890 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131893 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131896 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131898 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131901 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131905 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131908 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131910 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131914 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131916 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131919 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131921 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131924 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131927 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131929 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131932 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131935 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131938 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131941 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:10:30.133324 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131943 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131946 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131949 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131952 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131954 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131957 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131960 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131962 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131965 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131967 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131970 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131973 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131975 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131977 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131980 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131983 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131985 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.131988 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132721 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:10:30.133924 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132728 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132731 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132735 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132737 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132740 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132743 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132746 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132749 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132751 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132754 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132756 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132759 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132762 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132764 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132767 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132769 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132773 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132776 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132779 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132781 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:10:30.134387 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132784 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132786 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132789 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132792 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132796 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132800 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132803 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132806 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132809 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132812 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132816 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132819 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132822 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132825 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132829 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132831 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132834 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132839 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132842 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:10:30.134900 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132845 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132848 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132851 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132854 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132857 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132860 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132862 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132865 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132868 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132871 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132874 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132877 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132879 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132882 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132885 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132887 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132890 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132892 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132895 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132898 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:10:30.135361 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132901 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132903 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132906 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132908 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132911 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132914 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132916 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132919 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132922 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132924 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132927 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132929 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132932 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132935 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132938 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132940 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132943 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132945 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132948 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132950 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:10:30.135872 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132953 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132955 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132958 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132961 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132963 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132965 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132968 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132970 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132973 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132975 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132980 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132983 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132985 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132988 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132990 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132993 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132996 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.132999 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133007 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133460 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:10:30.136364 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133466 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133470 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133473 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133477 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133480 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133483 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133486 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133490 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133493 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133497 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133500 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133502 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133506 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133508 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133511 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133514 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133517 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133525 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133527 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:10:30.136866 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133530 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133532 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133535 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133541 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133544 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133547 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133549 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133552 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133554 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133557 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133560 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133564 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133567 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133569 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133572 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133575 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133577 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133580 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133583 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133585 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:10:30.137325 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133588 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133599 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133601 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133604 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133607 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133610 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133613 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133615 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133618 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133621 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133624 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133627 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133629 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133632 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133634 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133638 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133641 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133643 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133646 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:10:30.137828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133649 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133652 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133656 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133659 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133664 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133666 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133669 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133672 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133675 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133677 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133680 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133682 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133685 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133687 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133693 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133696 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133699 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133701 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133704 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133706 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:10:30.138294 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133709 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133712 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133714 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133717 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133720 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133722 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133725 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133729 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133733 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133736 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133738 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133741 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133743 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133746 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133749 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133753 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133757 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133764 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133767 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.133770 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:10:30.138836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133842 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133850 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133856 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133860 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133865 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133868 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133872 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133877 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133880 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133883 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133887 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133890 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133893 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133897 2576 flags.go:64] FLAG: --cgroup-root="" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133899 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133902 2576 flags.go:64] FLAG: --client-ca-file="" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133906 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133909 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133913 2576 flags.go:64] FLAG: --cluster-domain="" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133916 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133920 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133924 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133927 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133931 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 13:10:30.139322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133935 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133938 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133941 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133944 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133948 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133952 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133955 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133957 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133961 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133964 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133967 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133970 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133973 2576 flags.go:64] FLAG: --enable-server="true" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133976 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133980 2576 flags.go:64] FLAG: --event-burst="100" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133984 2576 flags.go:64] FLAG: --event-qps="50" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133987 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133990 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133993 2576 flags.go:64] FLAG: --eviction-hard="" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133996 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.133999 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134002 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134006 2576 flags.go:64] FLAG: --eviction-soft="" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134008 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134011 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 13:10:30.139914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134015 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134018 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134020 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134024 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134027 2576 flags.go:64] FLAG: --feature-gates="" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134031 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134034 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134037 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134040 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134043 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134046 2576 flags.go:64] FLAG: --help="false" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134050 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134053 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134056 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134059 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134062 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134065 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134068 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134071 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134074 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134077 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134079 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134083 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134085 2576 flags.go:64] FLAG: --kube-reserved="" Jun 11 13:10:30.140577 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134088 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134091 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134094 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134096 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134100 2576 flags.go:64] FLAG: --lock-file="" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134102 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134105 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134108 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134113 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134117 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134120 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134125 2576 flags.go:64] FLAG: --logging-format="text" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134128 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134131 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134134 2576 flags.go:64] FLAG: --manifest-url="" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134137 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134141 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134144 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134148 2576 flags.go:64] FLAG: --max-pods="110" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134153 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134156 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134159 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134162 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134164 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134167 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 13:10:30.141208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134170 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134178 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134181 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134184 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134187 2576 flags.go:64] FLAG: --pod-cidr="" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134190 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134195 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134198 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134201 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134204 2576 flags.go:64] FLAG: --port="10250" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134207 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134210 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-029771e528982dc86" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134213 2576 flags.go:64] FLAG: --qos-reserved="" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134216 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134219 2576 flags.go:64] FLAG: --register-node="true" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134222 2576 flags.go:64] FLAG: --register-with-taints="" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134226 2576 flags.go:64] FLAG: --registry-burst="10" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134229 2576 flags.go:64] FLAG: --registry-qps="5" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134233 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134237 2576 flags.go:64] FLAG: --reserved-memory="" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134241 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134244 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134247 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134250 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134253 2576 flags.go:64] FLAG: --runonce="false" Jun 11 13:10:30.141836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134255 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134260 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134263 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134266 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134269 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134273 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134276 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134279 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134282 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134285 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134288 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134290 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134294 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134296 2576 flags.go:64] FLAG: --system-cgroups="" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134300 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134305 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134307 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134310 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134314 2576 flags.go:64] FLAG: --tls-min-version="" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134317 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134320 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134323 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134326 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134329 2576 flags.go:64] FLAG: --v="2" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134333 2576 flags.go:64] FLAG: --version="false" Jun 11 13:10:30.142470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134337 2576 flags.go:64] FLAG: --vmodule="" Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134342 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.134345 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134483 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134487 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134491 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134496 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134500 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134504 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134507 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134510 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134513 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134515 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134518 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134520 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134523 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134526 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134528 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134531 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:10:30.143089 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134534 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134536 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134539 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134542 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134544 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134547 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134549 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134553 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134557 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134560 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134563 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134565 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134568 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134571 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134575 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134578 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134581 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134583 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134586 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:10:30.143587 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134589 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134591 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134594 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134597 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134600 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134603 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134606 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134608 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134611 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134613 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134616 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134618 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134621 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134624 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134626 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134629 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134632 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134634 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134637 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134639 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:10:30.144047 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134642 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134644 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134647 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134649 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134652 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134654 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134657 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134661 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134664 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134667 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134669 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134672 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134674 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134676 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134679 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134682 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134684 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134687 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134690 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134693 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:10:30.144563 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134695 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134698 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134700 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134703 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134705 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134708 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134711 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134713 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134716 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134718 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134721 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134723 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134726 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134728 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134731 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134733 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134736 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134738 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134741 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134744 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:10:30.145054 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134747 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134752 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134755 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.134758 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.135338 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.142608 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.142624 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.142644 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.142649 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142704 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142708 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142712 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142714 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142717 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142720 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:10:30.145569 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142723 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142725 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142728 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142730 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142734 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142736 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142738 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142741 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142744 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142746 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142749 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142751 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142754 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142757 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142760 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142762 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142765 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142767 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142770 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142773 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:10:30.145987 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142776 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142778 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142781 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142785 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142788 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142790 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142793 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142795 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142798 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142800 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142803 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142805 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142808 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142810 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142813 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142815 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142818 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142820 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142823 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142825 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:10:30.146487 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142828 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142830 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142833 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142836 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142839 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142841 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142844 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142846 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142849 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142851 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142855 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142859 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142864 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142867 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142870 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142874 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142878 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142880 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142883 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:10:30.146981 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142886 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142888 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142892 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142894 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142897 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142899 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142902 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142904 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142908 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142911 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142914 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142917 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142920 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142923 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142926 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142928 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142931 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142934 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142936 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:10:30.147512 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142939 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:10:30.147975 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142941 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:10:30.147975 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142944 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:10:30.147975 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142946 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:10:30.147975 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142949 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:10:30.147975 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142951 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:10:30.147975 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142954 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:10:30.147975 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142956 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:10:30.147975 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142959 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:10:30.147975 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142962 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:10:30.147975 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142965 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:10:30.147975 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142968 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:10:30.147975 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142970 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:10:30.147975 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142973 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:10:30.147975 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.142976 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:10:30.148328 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.142981 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 13:10:30.148328 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143106 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:10:30.148328 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143112 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:10:30.148328 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143117 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:10:30.148328 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143120 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:10:30.148328 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143123 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:10:30.148328 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143126 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:10:30.148328 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143129 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:10:30.148328 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143131 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:10:30.148328 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143134 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:10:30.148328 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143136 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:10:30.148328 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143139 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:10:30.148328 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143141 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:10:30.148328 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143144 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143146 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143149 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143151 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143154 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143156 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143159 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143161 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143164 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143167 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143169 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143171 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143174 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143176 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143180 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143182 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143186 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143188 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143191 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143193 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:10:30.148735 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143196 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143199 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143201 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143204 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143206 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143209 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143211 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143214 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143216 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143219 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143221 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143224 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143226 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143228 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143231 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143233 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143236 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143238 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143241 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143243 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:10:30.149217 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143246 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143249 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143251 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143254 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143257 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143259 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143262 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143264 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143267 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143270 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143272 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143274 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143277 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143280 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143282 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143285 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143287 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143290 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143293 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143296 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:10:30.149727 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143298 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143301 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143303 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143307 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143310 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143313 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143316 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143319 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143321 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143325 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143329 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143331 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143334 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143337 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143340 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143343 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143346 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143348 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:10:30.150202 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143351 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:10:30.150661 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143353 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:10:30.150661 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143356 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:10:30.150661 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143358 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:10:30.150661 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143361 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:10:30.150661 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143363 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:10:30.150661 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143366 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:10:30.150661 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143368 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:10:30.150661 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:30.143371 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:10:30.150661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.143375 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 13:10:30.150661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.143497 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 13:10:30.150661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.145526 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 13:10:30.150661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.146900 2576 server.go:1019] "Starting client certificate rotation" Jun 11 13:10:30.150661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.147005 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 13:10:30.150661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.147078 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 13:10:30.151014 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.149466 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 13:10:30.152194 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.152181 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 13:10:30.163424 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.163386 2576 log.go:25] "Validated CRI v1 runtime API" Jun 11 13:10:30.166946 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.166397 2576 log.go:25] "Validated CRI v1 image API" Jun 11 13:10:30.167526 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.167508 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 13:10:30.169931 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.169907 2576 fs.go:135] Filesystem UUIDs: map[01a90bc7-5dbc-4feb-be6e-2bbce41282eb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8a271bcb-dca8-4507-8b97-f0981c50329c:/dev/nvme0n1p4] Jun 11 13:10:30.170005 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.169929 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 13:10:30.175185 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.174954 2576 manager.go:216] Machine: {Timestamp:2026-06-11 13:10:30.173616039 +0000 UTC m=+0.319246084 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102372 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28b0409d3a5516d60fc4956cb349c7 SystemUUID:ec28b040-9d3a-5516-d60f-c4956cb349c7 BootID:f583dd32-9bb5-45df-b3e2-65d412a26a18 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fe:f2:52:5a:bb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fe:f2:52:5a:bb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:20:94:78:11:19 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 13:10:30.175185 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.175171 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 13:10:30.175355 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.175277 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 13:10:30.177306 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.177290 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 13:10:30.178381 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.178356 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 13:10:30.178529 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.178384 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-41.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 13:10:30.179075 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.179065 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 13:10:30.179114 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.179077 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 13:10:30.179114 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.179085 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 13:10:30.179919 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.179907 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 13:10:30.180673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.180663 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 13:10:30.183100 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.183088 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 11 13:10:30.183208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.183199 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 13:10:30.183251 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.183229 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 11 13:10:30.183251 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.183239 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 13:10:30.183316 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.183253 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 13:10:30.183316 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.183262 2576 kubelet.go:398] "Adding apiserver pod source" Jun 11 13:10:30.183316 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.183272 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 13:10:30.183639 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.183627 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 13:10:30.183673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.183646 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 13:10:30.186527 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.186512 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 13:10:30.188287 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.188274 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 13:10:30.188334 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.188304 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 13:10:30.189620 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.189608 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 13:10:30.189673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.189624 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 13:10:30.189673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.189630 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 13:10:30.189673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.189635 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 13:10:30.189673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.189647 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 13:10:30.189673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.189656 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 13:10:30.189673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.189665 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 13:10:30.189673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.189670 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 13:10:30.189673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.189676 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 13:10:30.189889 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.189681 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 13:10:30.189889 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.189691 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 13:10:30.189889 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.189697 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 13:10:30.191762 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.191748 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 13:10:30.191762 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.191760 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 13:10:30.194674 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.194655 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-41.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 13:10:30.194742 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.194684 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 13:10:30.194742 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.194694 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 13:10:30.194883 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.194873 2576 server.go:1268] "Started kubelet" Jun 11 13:10:30.195019 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.194970 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 13:10:30.195068 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.195046 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 13:10:30.195110 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.195053 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 13:10:30.195899 ip-10-0-140-41 systemd[1]: Started Kubernetes Kubelet. Jun 11 13:10:30.196904 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.196887 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 13:10:30.197200 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.197186 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 11 13:10:30.201603 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.201579 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 13:10:30.201603 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.201584 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 13:10:30.202366 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.202005 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found" Jun 11 13:10:30.202366 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.202238 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 13:10:30.202366 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.202263 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 13:10:30.202366 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.202282 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 13:10:30.202366 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.202371 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 11 13:10:30.202366 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.202379 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 11 13:10:30.202727 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.202594 2576 factory.go:55] Registering systemd factory Jun 11 13:10:30.202727 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.202608 2576 factory.go:223] Registration of the systemd container factory successfully Jun 11 13:10:30.202856 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.202836 2576 factory.go:153] Registering CRI-O factory Jun 11 13:10:30.202856 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.202854 2576 factory.go:223] Registration of the crio container factory successfully Jun 11 13:10:30.203014 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.202850 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 13:10:30.203014 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.202902 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 13:10:30.203014 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.202940 2576 factory.go:103] Registering Raw factory Jun 11 13:10:30.203014 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.202959 2576 manager.go:1196] Started watching for new ooms in manager Jun 11 13:10:30.203264 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.203252 2576 manager.go:349] Starting recovery of all containers Jun 11 13:10:30.206973 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.206939 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 13:10:30.207056 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.206964 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 13:10:30.207181 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.203727 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-41.ec2.internal.18b808e484935ddf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-41.ec2.internal,UID:ip-10-0-140-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-41.ec2.internal,},FirstTimestamp:2026-06-11 13:10:30.194847199 +0000 UTC m=+0.340477242,LastTimestamp:2026-06-11 13:10:30.194847199 +0000 UTC m=+0.340477242,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-41.ec2.internal,}" Jun 11 13:10:30.217389 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.217371 2576 manager.go:354] Recovery completed Jun 11 13:10:30.221563 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.221550 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:10:30.223208 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.223192 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:10:30.223267 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.223220 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:10:30.223267 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.223230 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:10:30.223764 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.223745 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 13:10:30.223841 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.223767 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 13:10:30.223841 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.223784 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 11 13:10:30.223841 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.223749 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:10:30.224621 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.224520 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:10:30.224621 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.224552 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:10:30.224621 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.224566 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:10:30.224836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.224823 2576 policy_none.go:49] "None policy: Start" Jun 11 13:10:30.224872 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.224840 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 13:10:30.224872 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.224851 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 13:10:30.225196 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.225134 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-41.ec2.internal.18b808e48644192b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-41.ec2.internal,UID:ip-10-0-140-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-41.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-41.ec2.internal,},FirstTimestamp:2026-06-11 13:10:30.223206699 +0000 UTC m=+0.368836746,LastTimestamp:2026-06-11 13:10:30.223206699 +0000 UTC m=+0.368836746,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-41.ec2.internal,}" Jun 11 13:10:30.225818 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.225804 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2m6qc" Jun 11 13:10:30.225909 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.225899 2576 policy_none.go:47] "Start" Jun 11 13:10:30.231639 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.231622 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2m6qc" Jun 11 13:10:30.264067 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.264050 2576 manager.go:337] "Starting Device Plugin manager" Jun 11 13:10:30.273719 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.264090 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 13:10:30.273719 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.264101 2576 server.go:87] "Starting device plugin registration server" Jun 11 13:10:30.273719 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.264391 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 13:10:30.273719 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.264405 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 13:10:30.273719 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.264537 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 13:10:30.273719 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.264632 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 13:10:30.273719 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.264642 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 13:10:30.273719 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.265198 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 13:10:30.273719 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.265240 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-41.ec2.internal\" not found" Jun 11 13:10:30.273719 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.270248 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 13:10:30.273719 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.271483 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 13:10:30.273719 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.271516 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 13:10:30.273719 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.271534 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 13:10:30.273719 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.271564 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 13:10:30.276124 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.276104 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:10:30.364787 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.364741 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:10:30.365905 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.365888 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:10:30.365968 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.365924 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:10:30.365968 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.365940 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:10:30.365968 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.365964 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.371631 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.371613 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal"] Jun 11 13:10:30.371684 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.371675 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:10:30.373105 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.373088 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:10:30.373158 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.373119 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:10:30.373158 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.373129 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:10:30.374050 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.374012 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.374050 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.374034 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-41.ec2.internal\": node \"ip-10-0-140-41.ec2.internal\" not found" Jun 11 13:10:30.374291 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.374279 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:10:30.374392 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.374379 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.374446 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.374422 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:10:30.375008 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.374994 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:10:30.375073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.375016 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:10:30.375073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.375025 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:10:30.375073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.375055 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:10:30.375073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.375074 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:10:30.375213 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.375084 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:10:30.376099 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.376085 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.376173 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.376108 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:10:30.376741 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.376720 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:10:30.376862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.376749 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:10:30.376862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.376763 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:10:30.397776 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.397754 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found" Jun 11 13:10:30.402797 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.402779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afabb4c16b9e8795399ed37bfbea3188-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal\" (UID: \"afabb4c16b9e8795399ed37bfbea3188\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.402909 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.402802 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5277c1df015f74c1121f1ce824c96ba2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-41.ec2.internal\" (UID: \"5277c1df015f74c1121f1ce824c96ba2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.402909 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.402820 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/afabb4c16b9e8795399ed37bfbea3188-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal\" (UID: \"afabb4c16b9e8795399ed37bfbea3188\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.406162 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.406139 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-41.ec2.internal\" not found" node="ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.410544 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.410528 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-41.ec2.internal\" not found" node="ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.498562 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.498533 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found" Jun 11 13:10:30.503848 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.503822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/afabb4c16b9e8795399ed37bfbea3188-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal\" (UID: \"afabb4c16b9e8795399ed37bfbea3188\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.503996 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.503852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afabb4c16b9e8795399ed37bfbea3188-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal\" (UID: \"afabb4c16b9e8795399ed37bfbea3188\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.503996 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.503871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5277c1df015f74c1121f1ce824c96ba2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-41.ec2.internal\" (UID: \"5277c1df015f74c1121f1ce824c96ba2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.503996 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.503904 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5277c1df015f74c1121f1ce824c96ba2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-41.ec2.internal\" (UID: \"5277c1df015f74c1121f1ce824c96ba2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.503996 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.503933 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/afabb4c16b9e8795399ed37bfbea3188-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal\" (UID: \"afabb4c16b9e8795399ed37bfbea3188\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.503996 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.503964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afabb4c16b9e8795399ed37bfbea3188-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal\" (UID: \"afabb4c16b9e8795399ed37bfbea3188\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.598855 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.598820 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found" Jun 11 13:10:30.699544 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.699471 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found" Jun 11 13:10:30.710911 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.710893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.714787 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:30.714739 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal" Jun 11 13:10:30.800176 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.800143 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found" Jun 11 13:10:30.900763 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:30.900729 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found" Jun 11 13:10:31.001306 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:31.001222 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found" Jun 11 13:10:31.101708 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:31.101680 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found" Jun 11 13:10:31.146091 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:31.146064 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 13:10:31.146919 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:31.146242 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 13:10:31.191653 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:31.191624 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5277c1df015f74c1121f1ce824c96ba2.slice/crio-02b65801612661f091ed05ab098617f25761a51b9a2a4d8fabae0ce1b7a6aeb8 WatchSource:0}: Error finding container 02b65801612661f091ed05ab098617f25761a51b9a2a4d8fabae0ce1b7a6aeb8: Status 404 returned error can't find the container with id 02b65801612661f091ed05ab098617f25761a51b9a2a4d8fabae0ce1b7a6aeb8 Jun 11 13:10:31.196340 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:31.196319 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 13:10:31.201814 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:31.201798 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found" Jun 11 13:10:31.233752 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:31.233710 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 13:05:30 +0000 UTC" deadline="2028-01-02 14:23:50.802431834 +0000 UTC" Jun 11 13:10:31.233752 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:31.233749 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13681h13m19.568686251s" Jun 11 13:10:31.275246 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:31.275160 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal" event={"ID":"5277c1df015f74c1121f1ce824c96ba2","Type":"ContainerStarted","Data":"02b65801612661f091ed05ab098617f25761a51b9a2a4d8fabae0ce1b7a6aeb8"} Jun 11 13:10:31.302329 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:31.302304 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found" Jun 11 13:10:31.319588 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:31.319565 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafabb4c16b9e8795399ed37bfbea3188.slice/crio-9aba837ffce17d854c9abc06130691ba9b469544459ad3f2c1935a82bdce6cca WatchSource:0}: Error finding container 9aba837ffce17d854c9abc06130691ba9b469544459ad3f2c1935a82bdce6cca: Status 404 returned error can't find the container with id 9aba837ffce17d854c9abc06130691ba9b469544459ad3f2c1935a82bdce6cca Jun 11 13:10:31.339008 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:31.338991 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:10:31.358616 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:31.358589 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:10:31.402402 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:31.402371 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" Jun 11 13:10:31.414967 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:31.414946 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 13:10:31.416667 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:31.416649 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal" Jun 11 13:10:31.424496 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:31.424480 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 13:10:31.586290 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:31.586216 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:10:32.184916 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.184695 2576 apiserver.go:52] "Watching apiserver" Jun 11 13:10:32.191862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.191834 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 13:10:32.192238 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.192214 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vtjvx","kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl","openshift-cluster-node-tuning-operator/tuned-2v47j","openshift-dns/node-resolver-pxl6s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal","openshift-multus/multus-additional-cni-plugins-h9txx","openshift-multus/network-metrics-daemon-dxrv4","kube-system/konnectivity-agent-vd4rj","openshift-image-registry/node-ca-g8rr2","openshift-multus/multus-27s94","openshift-network-diagnostics/network-check-target-6jbm2","openshift-network-operator/iptables-alerter-4wkxp","openshift-ovn-kubernetes/ovnkube-node-l8cz6"] Jun 11 13:10:32.193684 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.193663 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.194761 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.194742 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4wkxp" Jun 11 13:10:32.195908 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.195888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.196606 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.196042 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 13:10:32.196606 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.196277 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 13:10:32.196606 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.196364 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 13:10:32.196606 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.196490 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l468q\"" Jun 11 13:10:32.196861 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.196683 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 13:10:32.196861 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.196849 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:10:32.196967 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.196871 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 13:10:32.196967 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.196902 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.196967 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.196915 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 13:10:32.197255 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.197235 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-skttm\"" Jun 11 13:10:32.197365 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.197324 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 13:10:32.197962 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.197941 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 13:10:32.198238 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.198219 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxl6s" Jun 11 13:10:32.198424 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.198229 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 13:10:32.199261 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.199240 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 13:10:32.203070 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.200335 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:10:32.203070 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.200499 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 13:10:32.203070 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.200517 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ljl7g\"" Jun 11 13:10:32.203070 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.201161 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 13:10:32.203070 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.201341 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 13:10:32.203070 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.201655 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4xfcn\"" Jun 11 13:10:32.203070 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.201729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.203070 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.201887 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9xdts\"" Jun 11 13:10:32.203070 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.202123 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 13:10:32.204150 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.203965 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vd4rj" Jun 11 13:10:32.205057 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.205037 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 13:10:32.205137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.205070 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 13:10:32.205794 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.205773 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:32.205896 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.205853 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:10:32.206812 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.206795 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 13:10:32.206917 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.206826 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 13:10:32.206917 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.206797 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nvw2k\"" Jun 11 13:10:32.207021 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.206967 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 13:10:32.207209 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.207193 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:32.207306 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.207284 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:10:32.207470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.207450 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cn5wl\"" Jun 11 13:10:32.207828 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.207807 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 13:10:32.207828 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.207818 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 13:10:32.208024 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.208011 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 13:10:32.208477 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.208456 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g8rr2" Jun 11 13:10:32.209910 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.209887 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-27s94" Jun 11 13:10:32.211108 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.211084 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 13:10:32.211308 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.211274 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:32.211404 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.211334 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:32.211494 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.211461 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 13:10:32.211552 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.211509 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 13:10:32.211899 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.211878 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vxgjs\"" Jun 11 13:10:32.212013 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.211995 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jzgml\"" Jun 11 13:10:32.212074 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.212015 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 13:10:32.213740 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.213715 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:32.213867 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.213759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-cni-bin\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.213867 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.213787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-var-lib-kubelet\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.213985 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.213869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d4968e5-3b3f-4f22-81b7-5d584801260d-hosts-file\") pod \"node-resolver-pxl6s\" (UID: \"0d4968e5-3b3f-4f22-81b7-5d584801260d\") " pod="openshift-dns/node-resolver-pxl6s" Jun 11 13:10:32.213985 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.213922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/407ba999-1602-4425-80cf-49c8cab17aed-host-slash\") pod \"iptables-alerter-4wkxp\" (UID: \"407ba999-1602-4425-80cf-49c8cab17aed\") " pod="openshift-network-operator/iptables-alerter-4wkxp" Jun 11 13:10:32.213985 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.213953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-tuned\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.214134 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.213979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-device-dir\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.214134 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.214134 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214057 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-systemd\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.214134 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/55cd422e-237b-45ad-8b5d-102dc265673d-agent-certs\") pod \"konnectivity-agent-vd4rj\" (UID: \"55cd422e-237b-45ad-8b5d-102dc265673d\") " pod="kube-system/konnectivity-agent-vd4rj" Jun 11 13:10:32.214134 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-kubelet-config\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:32.214422 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-system-cni-dir\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.214422 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214192 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.214422 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-registration-dir\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.214422 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214238 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-sys-fs\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.214422 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214264 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-sysctl-conf\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.214422 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47zl6\" (UniqueName: \"kubernetes.io/projected/0d4968e5-3b3f-4f22-81b7-5d584801260d-kube-api-access-47zl6\") pod \"node-resolver-pxl6s\" (UID: \"0d4968e5-3b3f-4f22-81b7-5d584801260d\") " pod="openshift-dns/node-resolver-pxl6s" Jun 11 13:10:32.214422 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-dbus\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:32.214746 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-socket-dir\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.214746 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-run-systemd\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.214746 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-log-socket\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.214746 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.214746 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b8hq\" (UniqueName: \"kubernetes.io/projected/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-kube-api-access-6b8hq\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.214746 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-systemd-units\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.214746 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214580 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-etc-openvswitch\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.214746 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-cnibin\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.214746 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.214746 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214675 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdc5b\" (UniqueName: \"kubernetes.io/projected/407ba999-1602-4425-80cf-49c8cab17aed-kube-api-access-rdc5b\") pod \"iptables-alerter-4wkxp\" (UID: \"407ba999-1602-4425-80cf-49c8cab17aed\") " pod="openshift-network-operator/iptables-alerter-4wkxp" Jun 11 13:10:32.214746 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214706 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-lib-modules\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.214746 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-var-lib-openvswitch\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b29e98c3-90cb-42ea-86a3-91849e998e5b-ovnkube-script-lib\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-modprobe-d\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-run\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-slash\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b29e98c3-90cb-42ea-86a3-91849e998e5b-ovnkube-config\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b29e98c3-90cb-42ea-86a3-91849e998e5b-ovn-node-metrics-cert\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5fb4\" (UniqueName: \"kubernetes.io/projected/b29e98c3-90cb-42ea-86a3-91849e998e5b-kube-api-access-b5fb4\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-tmp\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.214993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmvk5\" (UniqueName: \"kubernetes.io/projected/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-kube-api-access-pmvk5\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b29e98c3-90cb-42ea-86a3-91849e998e5b-env-overrides\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-run-netns\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-run-ovn\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-kubernetes\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215114 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-sysctl-d\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.215283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrvxb\" (UniqueName: \"kubernetes.io/projected/9b63e392-e212-4ece-98f2-caebb2a978d0-kube-api-access-zrvxb\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-kubelet\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215187 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-host\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/55cd422e-237b-45ad-8b5d-102dc265673d-konnectivity-ca\") pod \"konnectivity-agent-vd4rj\" (UID: \"55cd422e-237b-45ad-8b5d-102dc265673d\") " pod="kube-system/konnectivity-agent-vd4rj" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-sys\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-run-openvswitch\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215400 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/407ba999-1602-4425-80cf-49c8cab17aed-iptables-alerter-script\") pod \"iptables-alerter-4wkxp\" (UID: \"407ba999-1602-4425-80cf-49c8cab17aed\") " pod="openshift-network-operator/iptables-alerter-4wkxp" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215456 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4968e5-3b3f-4f22-81b7-5d584801260d-tmp-dir\") pod \"node-resolver-pxl6s\" (UID: \"0d4968e5-3b3f-4f22-81b7-5d584801260d\") " pod="openshift-dns/node-resolver-pxl6s" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-node-log\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215499 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-cni-netd\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-sysconfig\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-os-release\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.216073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.215682 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 13:10:32.232880 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.232858 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mcslp" Jun 11 13:10:32.239126 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.239103 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mcslp" Jun 11 13:10:32.278061 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.278027 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" event={"ID":"afabb4c16b9e8795399ed37bfbea3188","Type":"ContainerStarted","Data":"9aba837ffce17d854c9abc06130691ba9b469544459ad3f2c1935a82bdce6cca"} Jun 11 13:10:32.304145 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.304114 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 13:10:32.316142 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrvxb\" (UniqueName: \"kubernetes.io/projected/9b63e392-e212-4ece-98f2-caebb2a978d0-kube-api-access-zrvxb\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.316311 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-kubelet\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.316311 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-host\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.316311 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/55cd422e-237b-45ad-8b5d-102dc265673d-konnectivity-ca\") pod \"konnectivity-agent-vd4rj\" (UID: \"55cd422e-237b-45ad-8b5d-102dc265673d\") " pod="kube-system/konnectivity-agent-vd4rj" Jun 11 13:10:32.316311 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.316311 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.316311 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316244 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-kubelet\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.316311 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.316311 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316262 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-host\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.316311 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-sys\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.316311 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nr77\" (UniqueName: \"kubernetes.io/projected/a521071a-24e5-4c21-9121-d72a6e4fcdb8-kube-api-access-7nr77\") pod \"network-metrics-daemon-dxrv4\" (UID: \"a521071a-24e5-4c21-9121-d72a6e4fcdb8\") " pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-cnibin\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-run-openvswitch\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/407ba999-1602-4425-80cf-49c8cab17aed-iptables-alerter-script\") pod \"iptables-alerter-4wkxp\" (UID: \"407ba999-1602-4425-80cf-49c8cab17aed\") " pod="openshift-network-operator/iptables-alerter-4wkxp" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316403 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-sys\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4968e5-3b3f-4f22-81b7-5d584801260d-tmp-dir\") pod \"node-resolver-pxl6s\" (UID: \"0d4968e5-3b3f-4f22-81b7-5d584801260d\") " pod="openshift-dns/node-resolver-pxl6s" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-node-log\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-cni-netd\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-var-lib-cni-multus\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-hostroot\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316476 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316675 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-run-multus-certs\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-sysconfig\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316737 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-node-log\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-var-lib-cni-bin\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316780 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-var-lib-kubelet\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.316886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-cni-netd\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-os-release\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f4f82d6-9818-4618-ab71-902e0f62f5fc-serviceca\") pod \"node-ca-g8rr2\" (UID: \"9f4f82d6-9818-4618-ab71-902e0f62f5fc\") " pod="openshift-image-registry/node-ca-g8rr2" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-sysconfig\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316678 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-run-openvswitch\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs\") pod \"network-metrics-daemon-dxrv4\" (UID: \"a521071a-24e5-4c21-9121-d72a6e4fcdb8\") " pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316916 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-multus-conf-dir\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316928 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-os-release\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316931 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/55cd422e-237b-45ad-8b5d-102dc265673d-konnectivity-ca\") pod \"konnectivity-agent-vd4rj\" (UID: \"55cd422e-237b-45ad-8b5d-102dc265673d\") " pod="kube-system/konnectivity-agent-vd4rj" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-etc-kubernetes\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316955 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4968e5-3b3f-4f22-81b7-5d584801260d-tmp-dir\") pod \"node-resolver-pxl6s\" (UID: \"0d4968e5-3b3f-4f22-81b7-5d584801260d\") " pod="openshift-dns/node-resolver-pxl6s" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316986 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-cni-bin\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.316986 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/407ba999-1602-4425-80cf-49c8cab17aed-iptables-alerter-script\") pod \"iptables-alerter-4wkxp\" (UID: \"407ba999-1602-4425-80cf-49c8cab17aed\") " pod="openshift-network-operator/iptables-alerter-4wkxp" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-var-lib-kubelet\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-cni-bin\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d4968e5-3b3f-4f22-81b7-5d584801260d-hosts-file\") pod \"node-resolver-pxl6s\" (UID: \"0d4968e5-3b3f-4f22-81b7-5d584801260d\") " pod="openshift-dns/node-resolver-pxl6s" Jun 11 13:10:32.317673 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.317136 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317158 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-var-lib-kubelet\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-system-cni-dir\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/407ba999-1602-4425-80cf-49c8cab17aed-host-slash\") pod \"iptables-alerter-4wkxp\" (UID: \"407ba999-1602-4425-80cf-49c8cab17aed\") " pod="openshift-network-operator/iptables-alerter-4wkxp" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317247 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d4968e5-3b3f-4f22-81b7-5d584801260d-hosts-file\") pod \"node-resolver-pxl6s\" (UID: \"0d4968e5-3b3f-4f22-81b7-5d584801260d\") " pod="openshift-dns/node-resolver-pxl6s" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-tuned\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.317313 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret podName:b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b nodeName:}" failed. No retries permitted until 2026-06-11 13:10:32.817292473 +0000 UTC m=+2.962922521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret") pod "global-pull-secret-syncer-vtjvx" (UID: "b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317315 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/407ba999-1602-4425-80cf-49c8cab17aed-host-slash\") pod \"iptables-alerter-4wkxp\" (UID: \"407ba999-1602-4425-80cf-49c8cab17aed\") " pod="openshift-network-operator/iptables-alerter-4wkxp" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-device-dir\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317405 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-systemd\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/55cd422e-237b-45ad-8b5d-102dc265673d-agent-certs\") pod \"konnectivity-agent-vd4rj\" (UID: \"55cd422e-237b-45ad-8b5d-102dc265673d\") " pod="kube-system/konnectivity-agent-vd4rj" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317540 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-systemd\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-kubelet-config\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317601 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317623 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317630 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-run-netns\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.318500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8txkc\" (UniqueName: \"kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc\") pod \"network-check-target-6jbm2\" (UID: \"68893489-b0ff-4a91-afc4-f2465ed780c8\") " pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317667 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-device-dir\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317694 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-kubelet-config\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-system-cni-dir\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-registration-dir\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-system-cni-dir\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317788 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-sys-fs\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-registration-dir\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-sysctl-conf\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-sys-fs\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47zl6\" (UniqueName: \"kubernetes.io/projected/0d4968e5-3b3f-4f22-81b7-5d584801260d-kube-api-access-47zl6\") pod \"node-resolver-pxl6s\" (UID: \"0d4968e5-3b3f-4f22-81b7-5d584801260d\") " pod="openshift-dns/node-resolver-pxl6s" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-dbus\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-socket-dir\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.317984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-sysctl-conf\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318014 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-run-systemd\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.319256 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-log-socket\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b63e392-e212-4ece-98f2-caebb2a978d0-socket-dir\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b8hq\" (UniqueName: \"kubernetes.io/projected/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-kube-api-access-6b8hq\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318098 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-dbus\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0845cbb7-4753-461f-9d5f-1f165b89237d-cni-binary-copy\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8d7z\" (UniqueName: \"kubernetes.io/projected/0845cbb7-4753-461f-9d5f-1f165b89237d-kube-api-access-c8d7z\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318147 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-log-socket\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-run-systemd\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318207 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-systemd-units\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-etc-openvswitch\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-cnibin\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdfrn\" (UniqueName: \"kubernetes.io/projected/9f4f82d6-9818-4618-ab71-902e0f62f5fc-kube-api-access-zdfrn\") pod \"node-ca-g8rr2\" (UID: \"9f4f82d6-9818-4618-ab71-902e0f62f5fc\") " pod="openshift-image-registry/node-ca-g8rr2" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-multus-socket-dir-parent\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318339 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-etc-openvswitch\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdc5b\" (UniqueName: \"kubernetes.io/projected/407ba999-1602-4425-80cf-49c8cab17aed-kube-api-access-rdc5b\") pod \"iptables-alerter-4wkxp\" (UID: \"407ba999-1602-4425-80cf-49c8cab17aed\") " pod="openshift-network-operator/iptables-alerter-4wkxp" Jun 11 13:10:32.319862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318385 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-lib-modules\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318431 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-systemd-units\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318451 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f4f82d6-9818-4618-ab71-902e0f62f5fc-host\") pod \"node-ca-g8rr2\" (UID: \"9f4f82d6-9818-4618-ab71-902e0f62f5fc\") " pod="openshift-image-registry/node-ca-g8rr2" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-multus-cni-dir\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318499 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-os-release\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318504 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-cnibin\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-run-k8s-cni-cncf-io\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-var-lib-openvswitch\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b29e98c3-90cb-42ea-86a3-91849e998e5b-ovnkube-script-lib\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-modprobe-d\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-run\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-slash\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b29e98c3-90cb-42ea-86a3-91849e998e5b-ovnkube-config\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b29e98c3-90cb-42ea-86a3-91849e998e5b-ovn-node-metrics-cert\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.320569 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318766 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-lib-modules\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5fb4\" (UniqueName: \"kubernetes.io/projected/b29e98c3-90cb-42ea-86a3-91849e998e5b-kube-api-access-b5fb4\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318799 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-tmp\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmvk5\" (UniqueName: \"kubernetes.io/projected/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-kube-api-access-pmvk5\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0845cbb7-4753-461f-9d5f-1f165b89237d-multus-daemon-config\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b29e98c3-90cb-42ea-86a3-91849e998e5b-env-overrides\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-run-netns\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-run-ovn\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-kubernetes\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.318973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-sysctl-d\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.319125 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.319132 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-sysctl-d\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.319234 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b29e98c3-90cb-42ea-86a3-91849e998e5b-ovnkube-config\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.319506 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b29e98c3-90cb-42ea-86a3-91849e998e5b-env-overrides\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.319551 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-run\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.319570 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-run-netns\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.319596 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-host-slash\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.319619 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-run-ovn\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.321394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.319672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-kubernetes\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.322258 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.320088 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b29e98c3-90cb-42ea-86a3-91849e998e5b-ovnkube-script-lib\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.322258 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.320089 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b29e98c3-90cb-42ea-86a3-91849e998e5b-var-lib-openvswitch\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.322258 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.320250 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-modprobe-d\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.322258 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.320987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-etc-tuned\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.322258 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.321172 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-tmp\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.322258 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.321260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/55cd422e-237b-45ad-8b5d-102dc265673d-agent-certs\") pod \"konnectivity-agent-vd4rj\" (UID: \"55cd422e-237b-45ad-8b5d-102dc265673d\") " pod="kube-system/konnectivity-agent-vd4rj" Jun 11 13:10:32.322671 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.322638 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b29e98c3-90cb-42ea-86a3-91849e998e5b-ovn-node-metrics-cert\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.326199 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.326168 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrvxb\" (UniqueName: \"kubernetes.io/projected/9b63e392-e212-4ece-98f2-caebb2a978d0-kube-api-access-zrvxb\") pod \"aws-ebs-csi-driver-node-t2tbl\" (UID: \"9b63e392-e212-4ece-98f2-caebb2a978d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.327317 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.327273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47zl6\" (UniqueName: \"kubernetes.io/projected/0d4968e5-3b3f-4f22-81b7-5d584801260d-kube-api-access-47zl6\") pod \"node-resolver-pxl6s\" (UID: \"0d4968e5-3b3f-4f22-81b7-5d584801260d\") " pod="openshift-dns/node-resolver-pxl6s" Jun 11 13:10:32.327822 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.327799 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b8hq\" (UniqueName: \"kubernetes.io/projected/9bd5ecac-bf25-4ba9-a147-cfa1a3bed078-kube-api-access-6b8hq\") pod \"multus-additional-cni-plugins-h9txx\" (UID: \"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078\") " pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.328568 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.328523 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmvk5\" (UniqueName: \"kubernetes.io/projected/b47d5232-ff49-4d97-b935-b0ac8be9a3ec-kube-api-access-pmvk5\") pod \"tuned-2v47j\" (UID: \"b47d5232-ff49-4d97-b935-b0ac8be9a3ec\") " pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.328718 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.328626 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdc5b\" (UniqueName: \"kubernetes.io/projected/407ba999-1602-4425-80cf-49c8cab17aed-kube-api-access-rdc5b\") pod \"iptables-alerter-4wkxp\" (UID: \"407ba999-1602-4425-80cf-49c8cab17aed\") " pod="openshift-network-operator/iptables-alerter-4wkxp" Jun 11 13:10:32.329191 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.329149 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5fb4\" (UniqueName: \"kubernetes.io/projected/b29e98c3-90cb-42ea-86a3-91849e998e5b-kube-api-access-b5fb4\") pod \"ovnkube-node-l8cz6\" (UID: \"b29e98c3-90cb-42ea-86a3-91849e998e5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.420086 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-run-netns\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420086 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txkc\" (UniqueName: \"kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc\") pod \"network-check-target-6jbm2\" (UID: \"68893489-b0ff-4a91-afc4-f2465ed780c8\") " pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:32.420329 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420171 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-run-netns\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420329 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0845cbb7-4753-461f-9d5f-1f165b89237d-cni-binary-copy\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420329 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8d7z\" (UniqueName: \"kubernetes.io/projected/0845cbb7-4753-461f-9d5f-1f165b89237d-kube-api-access-c8d7z\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420329 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420297 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdfrn\" (UniqueName: \"kubernetes.io/projected/9f4f82d6-9818-4618-ab71-902e0f62f5fc-kube-api-access-zdfrn\") pod \"node-ca-g8rr2\" (UID: \"9f4f82d6-9818-4618-ab71-902e0f62f5fc\") " pod="openshift-image-registry/node-ca-g8rr2" Jun 11 13:10:32.420329 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-multus-socket-dir-parent\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420616 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420389 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-multus-socket-dir-parent\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420616 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f4f82d6-9818-4618-ab71-902e0f62f5fc-host\") pod \"node-ca-g8rr2\" (UID: \"9f4f82d6-9818-4618-ab71-902e0f62f5fc\") " pod="openshift-image-registry/node-ca-g8rr2" Jun 11 13:10:32.420616 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-multus-cni-dir\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420616 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-os-release\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420616 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-run-k8s-cni-cncf-io\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420616 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420600 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f4f82d6-9818-4618-ab71-902e0f62f5fc-host\") pod \"node-ca-g8rr2\" (UID: \"9f4f82d6-9818-4618-ab71-902e0f62f5fc\") " pod="openshift-image-registry/node-ca-g8rr2" Jun 11 13:10:32.420616 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0845cbb7-4753-461f-9d5f-1f165b89237d-multus-daemon-config\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420621 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-multus-cni-dir\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420646 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-os-release\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420664 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-run-k8s-cni-cncf-io\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nr77\" (UniqueName: \"kubernetes.io/projected/a521071a-24e5-4c21-9121-d72a6e4fcdb8-kube-api-access-7nr77\") pod \"network-metrics-daemon-dxrv4\" (UID: \"a521071a-24e5-4c21-9121-d72a6e4fcdb8\") " pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-cnibin\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-var-lib-cni-multus\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-hostroot\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420785 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-cnibin\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-run-multus-certs\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420811 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-var-lib-cni-multus\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-var-lib-cni-bin\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-var-lib-kubelet\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420866 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-hostroot\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f4f82d6-9818-4618-ab71-902e0f62f5fc-serviceca\") pod \"node-ca-g8rr2\" (UID: \"9f4f82d6-9818-4618-ab71-902e0f62f5fc\") " pod="openshift-image-registry/node-ca-g8rr2" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-run-multus-certs\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs\") pod \"network-metrics-daemon-dxrv4\" (UID: \"a521071a-24e5-4c21-9121-d72a6e4fcdb8\") " pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:32.420957 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-multus-conf-dir\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.421646 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-etc-kubernetes\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.421646 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.420994 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-var-lib-kubelet\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.421646 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.420998 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:10:32.421646 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.421034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-multus-conf-dir\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.421646 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.421032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-system-cni-dir\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.421646 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.421063 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs podName:a521071a-24e5-4c21-9121-d72a6e4fcdb8 nodeName:}" failed. No retries permitted until 2026-06-11 13:10:32.921041257 +0000 UTC m=+3.066671303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs") pod "network-metrics-daemon-dxrv4" (UID: "a521071a-24e5-4c21-9121-d72a6e4fcdb8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:10:32.421646 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.421068 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-host-var-lib-cni-bin\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.421646 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.421068 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0845cbb7-4753-461f-9d5f-1f165b89237d-multus-daemon-config\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.421646 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.421085 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-etc-kubernetes\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.421646 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.421094 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0845cbb7-4753-461f-9d5f-1f165b89237d-system-cni-dir\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.421646 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.421391 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f4f82d6-9818-4618-ab71-902e0f62f5fc-serviceca\") pod \"node-ca-g8rr2\" (UID: \"9f4f82d6-9818-4618-ab71-902e0f62f5fc\") " pod="openshift-image-registry/node-ca-g8rr2" Jun 11 13:10:32.421646 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.421441 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0845cbb7-4753-461f-9d5f-1f165b89237d-cni-binary-copy\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.426926 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.426893 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:10:32.426926 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.426919 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:10:32.427105 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.426933 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8txkc for pod openshift-network-diagnostics/network-check-target-6jbm2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:10:32.427105 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.427003 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc podName:68893489-b0ff-4a91-afc4-f2465ed780c8 nodeName:}" failed. No retries permitted until 2026-06-11 13:10:32.926978266 +0000 UTC m=+3.072608313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8txkc" (UniqueName: "kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc") pod "network-check-target-6jbm2" (UID: "68893489-b0ff-4a91-afc4-f2465ed780c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:10:32.429854 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.429809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdfrn\" (UniqueName: \"kubernetes.io/projected/9f4f82d6-9818-4618-ab71-902e0f62f5fc-kube-api-access-zdfrn\") pod \"node-ca-g8rr2\" (UID: \"9f4f82d6-9818-4618-ab71-902e0f62f5fc\") " pod="openshift-image-registry/node-ca-g8rr2" Jun 11 13:10:32.433201 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.430702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8d7z\" (UniqueName: \"kubernetes.io/projected/0845cbb7-4753-461f-9d5f-1f165b89237d-kube-api-access-c8d7z\") pod \"multus-27s94\" (UID: \"0845cbb7-4753-461f-9d5f-1f165b89237d\") " pod="openshift-multus/multus-27s94" Jun 11 13:10:32.433965 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.433945 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nr77\" (UniqueName: \"kubernetes.io/projected/a521071a-24e5-4c21-9121-d72a6e4fcdb8-kube-api-access-7nr77\") pod \"network-metrics-daemon-dxrv4\" (UID: \"a521071a-24e5-4c21-9121-d72a6e4fcdb8\") " pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:32.509085 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.508991 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h9txx" Jun 11 13:10:32.515125 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.515095 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4wkxp" Jun 11 13:10:32.523336 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.523313 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" Jun 11 13:10:32.528607 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.528589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2v47j" Jun 11 13:10:32.534936 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.534905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxl6s" Jun 11 13:10:32.537142 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.537121 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:10:32.541029 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.541011 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:10:32.549254 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.549235 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vd4rj" Jun 11 13:10:32.554735 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.554719 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g8rr2" Jun 11 13:10:32.560088 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.560058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-27s94" Jun 11 13:10:32.823690 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.823596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:32.823845 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.823712 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:10:32.823845 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.823777 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret podName:b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b nodeName:}" failed. No retries permitted until 2026-06-11 13:10:33.82375726 +0000 UTC m=+3.969387299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret") pod "global-pull-secret-syncer-vtjvx" (UID: "b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:10:32.924896 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:32.924858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs\") pod \"network-metrics-daemon-dxrv4\" (UID: \"a521071a-24e5-4c21-9121-d72a6e4fcdb8\") " pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:32.925073 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.925026 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:10:32.925128 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:32.925095 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs podName:a521071a-24e5-4c21-9121-d72a6e4fcdb8 nodeName:}" failed. No retries permitted until 2026-06-11 13:10:33.925073536 +0000 UTC m=+4.070703572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs") pod "network-metrics-daemon-dxrv4" (UID: "a521071a-24e5-4c21-9121-d72a6e4fcdb8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:10:33.025780 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.025733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txkc\" (UniqueName: \"kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc\") pod \"network-check-target-6jbm2\" (UID: \"68893489-b0ff-4a91-afc4-f2465ed780c8\") " pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:33.025963 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:33.025926 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:10:33.025963 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:33.025950 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:10:33.025963 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:33.025961 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8txkc for pod openshift-network-diagnostics/network-check-target-6jbm2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:10:33.026117 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:33.026027 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc podName:68893489-b0ff-4a91-afc4-f2465ed780c8 nodeName:}" failed. No retries permitted until 2026-06-11 13:10:34.026008213 +0000 UTC m=+4.171638264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8txkc" (UniqueName: "kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc") pod "network-check-target-6jbm2" (UID: "68893489-b0ff-4a91-afc4-f2465ed780c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:10:33.119689 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:33.119658 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0845cbb7_4753_461f_9d5f_1f165b89237d.slice/crio-94bcf61eb8f9b15722991fb08847d9fc09c096b21f56949746359ff8aa82d381 WatchSource:0}: Error finding container 94bcf61eb8f9b15722991fb08847d9fc09c096b21f56949746359ff8aa82d381: Status 404 returned error can't find the container with id 94bcf61eb8f9b15722991fb08847d9fc09c096b21f56949746359ff8aa82d381 Jun 11 13:10:33.121483 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:33.121456 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29e98c3_90cb_42ea_86a3_91849e998e5b.slice/crio-976527a2406faccd5c9a437a3683784e6aa3355522ef6893491bd092bce6170f WatchSource:0}: Error finding container 976527a2406faccd5c9a437a3683784e6aa3355522ef6893491bd092bce6170f: Status 404 returned error can't find the container with id 976527a2406faccd5c9a437a3683784e6aa3355522ef6893491bd092bce6170f Jun 11 13:10:33.122223 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:33.122118 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47d5232_ff49_4d97_b935_b0ac8be9a3ec.slice/crio-3f7345ded077cff040c5b040b894f33e44382662f502ff2f3b725028b233dc9d WatchSource:0}: Error finding container 3f7345ded077cff040c5b040b894f33e44382662f502ff2f3b725028b233dc9d: Status 404 returned error can't find the container with id 3f7345ded077cff040c5b040b894f33e44382662f502ff2f3b725028b233dc9d Jun 11 13:10:33.123670 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:33.123645 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55cd422e_237b_45ad_8b5d_102dc265673d.slice/crio-bb0a0016217ef5ecba05bc61a8032a93242b961a2ba76312f5fa755019defd64 WatchSource:0}: Error finding container bb0a0016217ef5ecba05bc61a8032a93242b961a2ba76312f5fa755019defd64: Status 404 returned error can't find the container with id bb0a0016217ef5ecba05bc61a8032a93242b961a2ba76312f5fa755019defd64 Jun 11 13:10:33.125712 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:33.125587 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd5ecac_bf25_4ba9_a147_cfa1a3bed078.slice/crio-fe56ae037d5e507bac51cb58c34ccbafbe24cfe8d6fb07799587db1d4cccf03e WatchSource:0}: Error finding container fe56ae037d5e507bac51cb58c34ccbafbe24cfe8d6fb07799587db1d4cccf03e: Status 404 returned error can't find the container with id fe56ae037d5e507bac51cb58c34ccbafbe24cfe8d6fb07799587db1d4cccf03e Jun 11 13:10:33.128140 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:33.128121 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f4f82d6_9818_4618_ab71_902e0f62f5fc.slice/crio-2f2e7f40ecb4a609a8461b689ed5a17425ecb2ba50ea231faa145bf688f2b11d WatchSource:0}: Error finding container 2f2e7f40ecb4a609a8461b689ed5a17425ecb2ba50ea231faa145bf688f2b11d: Status 404 returned error can't find the container with id 2f2e7f40ecb4a609a8461b689ed5a17425ecb2ba50ea231faa145bf688f2b11d Jun 11 13:10:33.129508 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:33.129488 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod407ba999_1602_4425_80cf_49c8cab17aed.slice/crio-a8012fd10ecaa5f09e89451a8fc7a17bc5b5a32e6e003f7ec2b6f4ffd6c7ee24 WatchSource:0}: Error finding container a8012fd10ecaa5f09e89451a8fc7a17bc5b5a32e6e003f7ec2b6f4ffd6c7ee24: Status 404 returned error can't find the container with id a8012fd10ecaa5f09e89451a8fc7a17bc5b5a32e6e003f7ec2b6f4ffd6c7ee24 Jun 11 13:10:33.130307 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:33.130225 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b63e392_e212_4ece_98f2_caebb2a978d0.slice/crio-b071f80c9f68d32217637274891f2d804858cdc260ed0e8e02ce05711823328a WatchSource:0}: Error finding container b071f80c9f68d32217637274891f2d804858cdc260ed0e8e02ce05711823328a: Status 404 returned error can't find the container with id b071f80c9f68d32217637274891f2d804858cdc260ed0e8e02ce05711823328a Jun 11 13:10:33.131270 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:10:33.131248 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4968e5_3b3f_4f22_81b7_5d584801260d.slice/crio-40129d8fcda01151c57b5a7efd0bc7e9d7540adafca8b4a954e2ae0aee625c2f WatchSource:0}: Error finding container 40129d8fcda01151c57b5a7efd0bc7e9d7540adafca8b4a954e2ae0aee625c2f: Status 404 returned error can't find the container with id 40129d8fcda01151c57b5a7efd0bc7e9d7540adafca8b4a954e2ae0aee625c2f Jun 11 13:10:33.241810 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.241762 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 13:05:32 +0000 UTC" deadline="2028-02-26 23:28:50.49931094 +0000 UTC" Jun 11 13:10:33.241810 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.241807 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15010h18m17.257507682s" Jun 11 13:10:33.272215 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.272187 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:33.272348 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:33.272288 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:33.282611 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.282568 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal" event={"ID":"5277c1df015f74c1121f1ce824c96ba2","Type":"ContainerStarted","Data":"4def6410a25c98a4ba84c5a3382e4865b2abdb032cb972cdf95ae86ec2a9b548"} Jun 11 13:10:33.283770 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.283744 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxl6s" event={"ID":"0d4968e5-3b3f-4f22-81b7-5d584801260d","Type":"ContainerStarted","Data":"40129d8fcda01151c57b5a7efd0bc7e9d7540adafca8b4a954e2ae0aee625c2f"} Jun 11 13:10:33.284834 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.284811 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" event={"ID":"9b63e392-e212-4ece-98f2-caebb2a978d0","Type":"ContainerStarted","Data":"b071f80c9f68d32217637274891f2d804858cdc260ed0e8e02ce05711823328a"} Jun 11 13:10:33.286032 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.286006 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4wkxp" event={"ID":"407ba999-1602-4425-80cf-49c8cab17aed","Type":"ContainerStarted","Data":"a8012fd10ecaa5f09e89451a8fc7a17bc5b5a32e6e003f7ec2b6f4ffd6c7ee24"} Jun 11 13:10:33.287006 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.286986 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2v47j" event={"ID":"b47d5232-ff49-4d97-b935-b0ac8be9a3ec","Type":"ContainerStarted","Data":"3f7345ded077cff040c5b040b894f33e44382662f502ff2f3b725028b233dc9d"} Jun 11 13:10:33.288046 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.288020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9txx" event={"ID":"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078","Type":"ContainerStarted","Data":"fe56ae037d5e507bac51cb58c34ccbafbe24cfe8d6fb07799587db1d4cccf03e"} Jun 11 13:10:33.289172 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.289147 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" event={"ID":"b29e98c3-90cb-42ea-86a3-91849e998e5b","Type":"ContainerStarted","Data":"976527a2406faccd5c9a437a3683784e6aa3355522ef6893491bd092bce6170f"} Jun 11 13:10:33.290152 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.290127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g8rr2" event={"ID":"9f4f82d6-9818-4618-ab71-902e0f62f5fc","Type":"ContainerStarted","Data":"2f2e7f40ecb4a609a8461b689ed5a17425ecb2ba50ea231faa145bf688f2b11d"} Jun 11 13:10:33.291215 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.291194 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vd4rj" event={"ID":"55cd422e-237b-45ad-8b5d-102dc265673d","Type":"ContainerStarted","Data":"bb0a0016217ef5ecba05bc61a8032a93242b961a2ba76312f5fa755019defd64"} Jun 11 13:10:33.292306 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.292286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-27s94" event={"ID":"0845cbb7-4753-461f-9d5f-1f165b89237d","Type":"ContainerStarted","Data":"94bcf61eb8f9b15722991fb08847d9fc09c096b21f56949746359ff8aa82d381"} Jun 11 13:10:33.296134 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.296096 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal" podStartSLOduration=2.296076023 podStartE2EDuration="2.296076023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:10:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:10:33.2954814 +0000 UTC m=+3.441111449" watchObservedRunningTime="2026-06-11 13:10:33.296076023 +0000 UTC m=+3.441706075" Jun 11 13:10:33.833432 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.832734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:33.833432 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:33.832964 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:10:33.833432 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:33.833027 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret podName:b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b nodeName:}" failed. No retries permitted until 2026-06-11 13:10:35.833009323 +0000 UTC m=+5.978639369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret") pod "global-pull-secret-syncer-vtjvx" (UID: "b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:10:33.933454 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:33.933392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs\") pod \"network-metrics-daemon-dxrv4\" (UID: \"a521071a-24e5-4c21-9121-d72a6e4fcdb8\") " pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:33.933631 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:33.933592 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:10:33.933693 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:33.933652 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs podName:a521071a-24e5-4c21-9121-d72a6e4fcdb8 nodeName:}" failed. No retries permitted until 2026-06-11 13:10:35.933634519 +0000 UTC m=+6.079264569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs") pod "network-metrics-daemon-dxrv4" (UID: "a521071a-24e5-4c21-9121-d72a6e4fcdb8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:10:34.034795 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:34.034756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txkc\" (UniqueName: \"kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc\") pod \"network-check-target-6jbm2\" (UID: \"68893489-b0ff-4a91-afc4-f2465ed780c8\") " pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:34.034979 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:34.034955 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:10:34.034979 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:34.034975 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:10:34.035089 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:34.034988 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8txkc for pod openshift-network-diagnostics/network-check-target-6jbm2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:10:34.035089 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:34.035078 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc podName:68893489-b0ff-4a91-afc4-f2465ed780c8 nodeName:}" failed. No retries permitted until 2026-06-11 13:10:36.03506052 +0000 UTC m=+6.180690556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8txkc" (UniqueName: "kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc") pod "network-check-target-6jbm2" (UID: "68893489-b0ff-4a91-afc4-f2465ed780c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:10:34.242196 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:34.242103 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 13:05:32 +0000 UTC" deadline="2028-03-08 10:09:30.524873982 +0000 UTC" Jun 11 13:10:34.242196 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:34.242145 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15260h58m56.28273299s" Jun 11 13:10:34.272070 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:34.272017 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:34.272257 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:34.272165 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:10:34.273675 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:34.273650 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:34.273838 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:34.273810 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:10:34.299327 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:34.299292 2576 generic.go:356] "Generic (PLEG): container finished" podID="afabb4c16b9e8795399ed37bfbea3188" containerID="c70790aa96de8bcd3d846253ca7c37b5eb9d08873152b6fa63e14fadd8ae89a5" exitCode=0 Jun 11 13:10:34.299510 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:34.299385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" event={"ID":"afabb4c16b9e8795399ed37bfbea3188","Type":"ContainerDied","Data":"c70790aa96de8bcd3d846253ca7c37b5eb9d08873152b6fa63e14fadd8ae89a5"} Jun 11 13:10:35.272969 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:35.272508 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:35.272969 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:35.272630 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:35.315978 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:35.315173 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" event={"ID":"afabb4c16b9e8795399ed37bfbea3188","Type":"ContainerStarted","Data":"8376c978b4d09270f9c4de2396c2d499d9dcc26955a63eb197424e2d3dc42969"} Jun 11 13:10:35.851531 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:35.851494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:35.851732 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:35.851641 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:10:35.851732 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:35.851706 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret podName:b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b nodeName:}" failed. No retries permitted until 2026-06-11 13:10:39.851688623 +0000 UTC m=+9.997318669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret") pod "global-pull-secret-syncer-vtjvx" (UID: "b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:10:35.952782 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:35.952739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs\") pod \"network-metrics-daemon-dxrv4\" (UID: \"a521071a-24e5-4c21-9121-d72a6e4fcdb8\") " pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:35.952944 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:35.952879 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:10:35.953019 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:35.952955 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs podName:a521071a-24e5-4c21-9121-d72a6e4fcdb8 nodeName:}" failed. No retries permitted until 2026-06-11 13:10:39.952933923 +0000 UTC m=+10.098563968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs") pod "network-metrics-daemon-dxrv4" (UID: "a521071a-24e5-4c21-9121-d72a6e4fcdb8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:10:36.053771 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:36.053733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txkc\" (UniqueName: \"kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc\") pod \"network-check-target-6jbm2\" (UID: \"68893489-b0ff-4a91-afc4-f2465ed780c8\") " pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:36.053988 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:36.053970 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:10:36.054063 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:36.053998 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:10:36.054063 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:36.054010 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8txkc for pod openshift-network-diagnostics/network-check-target-6jbm2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:10:36.054155 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:36.054071 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc podName:68893489-b0ff-4a91-afc4-f2465ed780c8 nodeName:}" failed. No retries permitted until 2026-06-11 13:10:40.054053305 +0000 UTC m=+10.199683357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8txkc" (UniqueName: "kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc") pod "network-check-target-6jbm2" (UID: "68893489-b0ff-4a91-afc4-f2465ed780c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:10:36.271879 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:36.271843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:36.271879 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:36.271870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:36.272120 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:36.271983 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:10:36.272120 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:36.272101 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:10:37.272451 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:37.272403 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:37.272890 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:37.272561 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:38.272126 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:38.272089 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:38.272851 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:38.272620 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:10:38.273245 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:38.272870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:38.273245 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:38.273023 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:10:39.271771 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:39.271739 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:39.271936 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:39.271870 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:39.887344 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:39.887309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:39.887812 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:39.887444 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:10:39.887812 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:39.887528 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret podName:b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b nodeName:}" failed. No retries permitted until 2026-06-11 13:10:47.887505952 +0000 UTC m=+18.033135997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret") pod "global-pull-secret-syncer-vtjvx" (UID: "b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:10:39.987783 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:39.987752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs\") pod \"network-metrics-daemon-dxrv4\" (UID: \"a521071a-24e5-4c21-9121-d72a6e4fcdb8\") " pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:39.987951 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:39.987930 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:10:39.988018 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:39.988002 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs podName:a521071a-24e5-4c21-9121-d72a6e4fcdb8 nodeName:}" failed. No retries permitted until 2026-06-11 13:10:47.987984086 +0000 UTC m=+18.133614127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs") pod "network-metrics-daemon-dxrv4" (UID: "a521071a-24e5-4c21-9121-d72a6e4fcdb8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:10:40.088317 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:40.088266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txkc\" (UniqueName: \"kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc\") pod \"network-check-target-6jbm2\" (UID: \"68893489-b0ff-4a91-afc4-f2465ed780c8\") " pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:40.088503 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:40.088447 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:10:40.088503 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:40.088472 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:10:40.088503 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:40.088484 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8txkc for pod openshift-network-diagnostics/network-check-target-6jbm2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:10:40.088650 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:40.088544 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc podName:68893489-b0ff-4a91-afc4-f2465ed780c8 nodeName:}" failed. No retries permitted until 2026-06-11 13:10:48.08852788 +0000 UTC m=+18.234157917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8txkc" (UniqueName: "kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc") pod "network-check-target-6jbm2" (UID: "68893489-b0ff-4a91-afc4-f2465ed780c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:10:40.273461 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:40.273010 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:40.273461 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:40.273125 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:10:40.273461 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:40.273462 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:40.273720 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:40.273557 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:10:41.272485 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:41.272453 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:41.272878 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:41.272581 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:42.272092 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:42.271941 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:42.272092 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:42.271951 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:42.272092 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:42.272069 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:10:42.272380 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:42.272129 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:10:43.272636 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:43.272449 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:43.273213 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:43.272731 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:43.334111 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:43.334074 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g8rr2" event={"ID":"9f4f82d6-9818-4618-ab71-902e0f62f5fc","Type":"ContainerStarted","Data":"da67ad90cd01471a05c2fe25092c34cb916b3f1f02829be0b4fd845b52f70291"} Jun 11 13:10:43.337401 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:43.337342 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vd4rj" event={"ID":"55cd422e-237b-45ad-8b5d-102dc265673d","Type":"ContainerStarted","Data":"98592fa0e25a46e9cde1db2aeb49ef2e96fafd55d03ccc8620015cfd375c4d18"} Jun 11 13:10:43.340369 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:43.340315 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxl6s" event={"ID":"0d4968e5-3b3f-4f22-81b7-5d584801260d","Type":"ContainerStarted","Data":"0670b0096767acb9de259a4fd27d10af6b47a276c102347fe1d139a58ed5c04d"} Jun 11 13:10:43.342856 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:43.342788 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" event={"ID":"9b63e392-e212-4ece-98f2-caebb2a978d0","Type":"ContainerStarted","Data":"8afb43044b88091361ff4b3785e822d330e7868d1dbd1d616197653bd0e5297e"} Jun 11 13:10:43.344950 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:43.344923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2v47j" event={"ID":"b47d5232-ff49-4d97-b935-b0ac8be9a3ec","Type":"ContainerStarted","Data":"792409a33a2beeb3f55e7f315466db05ada345ad6da4182d0c5af7e2f3b6c9da"} Jun 11 13:10:43.347475 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:43.347446 2576 generic.go:356] "Generic (PLEG): container finished" podID="9bd5ecac-bf25-4ba9-a147-cfa1a3bed078" containerID="c74f324d2095a693bf0aa3fb2f1007c4895f5b6afba789a936d794d6fca32df5" exitCode=0 Jun 11 13:10:43.347560 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:43.347484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9txx" event={"ID":"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078","Type":"ContainerDied","Data":"c74f324d2095a693bf0aa3fb2f1007c4895f5b6afba789a936d794d6fca32df5"} Jun 11 13:10:43.349661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:43.349611 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" podStartSLOduration=12.349594421 podStartE2EDuration="12.349594421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:10:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:10:35.33301681 +0000 UTC m=+5.478646867" watchObservedRunningTime="2026-06-11 13:10:43.349594421 +0000 UTC m=+13.495224477" Jun 11 13:10:43.349924 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:43.349892 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g8rr2" podStartSLOduration=3.842558253 podStartE2EDuration="13.349881605s" totalImagesPullingTime="9.507323352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:10:43.348739129 +0000 UTC m=+13.494369183" watchObservedRunningTime="2026-06-11 13:10:43.349881605 +0000 UTC m=+13.495511660" Jun 11 13:10:43.363277 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:43.363180 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2v47j" podStartSLOduration=3.83518446 podStartE2EDuration="13.363166429s" totalImagesPullingTime="9.527981969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:10:43.362600943 +0000 UTC m=+13.508230997" watchObservedRunningTime="2026-06-11 13:10:43.363166429 +0000 UTC m=+13.508796481" Jun 11 13:10:43.377008 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:43.376609 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pxl6s" podStartSLOduration=3.867172325 podStartE2EDuration="13.376593552s" totalImagesPullingTime="9.509421227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:10:43.376232014 +0000 UTC m=+13.521862070" watchObservedRunningTime="2026-06-11 13:10:43.376593552 +0000 UTC m=+13.522223606" Jun 11 13:10:43.393108 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:43.393066 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vd4rj" podStartSLOduration=3.881669865 podStartE2EDuration="13.393049596s" totalImagesPullingTime="9.511379731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:10:43.392678176 +0000 UTC m=+13.538308230" watchObservedRunningTime="2026-06-11 13:10:43.393049596 +0000 UTC m=+13.538679652" Jun 11 13:10:43.821438 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:43.821396 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 13:10:44.272936 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:44.272800 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T13:10:43.821433903Z","UUID":"635f0cc9-fdee-4b4c-bd2a-6cf1fd561a38","Handler":null,"Name":"","Endpoint":""} Jun 11 13:10:44.272936 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:44.272890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:44.273470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:44.272962 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:44.273470 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:44.273046 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:10:44.273470 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:44.273377 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:10:44.274930 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:44.274907 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 13:10:44.275041 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:44.274953 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 13:10:44.353322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:44.353215 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" event={"ID":"9b63e392-e212-4ece-98f2-caebb2a978d0","Type":"ContainerStarted","Data":"40e345f872024bc2e7cc3d7254b157984fc6c47e7945fa25bd3f8d028f8fe180"} Jun 11 13:10:44.356566 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:44.355881 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4wkxp" event={"ID":"407ba999-1602-4425-80cf-49c8cab17aed","Type":"ContainerStarted","Data":"fca6dfe64a5c4cea96fbe94fb4cfb0e90944af1901d41c1a3e3b29e9cf24018b"} Jun 11 13:10:44.372391 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:44.372033 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4wkxp" podStartSLOduration=4.857226311 podStartE2EDuration="14.372014269s" totalImagesPullingTime="9.514787958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:10:44.371351154 +0000 UTC m=+14.516981208" watchObservedRunningTime="2026-06-11 13:10:44.372014269 +0000 UTC m=+14.517644323" Jun 11 13:10:45.272439 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:45.272396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:45.272636 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:45.272546 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:46.271893 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:46.271856 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:46.272311 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:46.271860 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:46.272311 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:46.272000 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:10:46.272311 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:46.272048 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:10:47.272749 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:47.272716 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:47.273245 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:47.272839 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:47.946723 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:47.946677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:47.946904 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:47.946861 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:10:47.946969 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:47.946921 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret podName:b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b nodeName:}" failed. No retries permitted until 2026-06-11 13:11:03.946902886 +0000 UTC m=+34.092532930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret") pod "global-pull-secret-syncer-vtjvx" (UID: "b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:10:47.992778 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:47.992746 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vd4rj" Jun 11 13:10:47.993312 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:47.993289 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vd4rj" Jun 11 13:10:48.047362 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:48.047315 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs\") pod \"network-metrics-daemon-dxrv4\" (UID: \"a521071a-24e5-4c21-9121-d72a6e4fcdb8\") " pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:48.047531 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:48.047469 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:10:48.047531 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:48.047518 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs podName:a521071a-24e5-4c21-9121-d72a6e4fcdb8 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:04.047505765 +0000 UTC m=+34.193135796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs") pod "network-metrics-daemon-dxrv4" (UID: "a521071a-24e5-4c21-9121-d72a6e4fcdb8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:10:48.147720 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:48.147690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txkc\" (UniqueName: \"kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc\") pod \"network-check-target-6jbm2\" (UID: \"68893489-b0ff-4a91-afc4-f2465ed780c8\") " pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:48.147887 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:48.147863 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:10:48.147952 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:48.147888 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:10:48.147952 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:48.147901 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8txkc for pod openshift-network-diagnostics/network-check-target-6jbm2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:10:48.148053 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:48.147968 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc podName:68893489-b0ff-4a91-afc4-f2465ed780c8 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:04.147948791 +0000 UTC m=+34.293578837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8txkc" (UniqueName: "kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc") pod "network-check-target-6jbm2" (UID: "68893489-b0ff-4a91-afc4-f2465ed780c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:10:48.272515 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:48.272483 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:48.272680 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:48.272615 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:10:48.272680 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:48.272671 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:48.272816 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:48.272796 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:10:49.272469 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:49.272397 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:49.272643 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:49.272521 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:50.273283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:50.273192 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:50.273836 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:50.273322 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:10:50.273836 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:50.273363 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:50.273836 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:50.273487 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:10:51.272671 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:51.272637 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:51.272802 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:51.272750 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:51.372859 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:51.372781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" event={"ID":"9b63e392-e212-4ece-98f2-caebb2a978d0","Type":"ContainerStarted","Data":"230a3c7323368922778222ade7f43cae12e7141d5523282380cb3b47a84d75ee"} Jun 11 13:10:51.374563 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:51.374540 2576 generic.go:356] "Generic (PLEG): container finished" podID="9bd5ecac-bf25-4ba9-a147-cfa1a3bed078" containerID="5dbbe4ad4b1846abb9e0b6ae113e92922cd3ab5b6ff1af17b6c52a8df062d693" exitCode=0 Jun 11 13:10:51.374669 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:51.374612 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9txx" event={"ID":"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078","Type":"ContainerDied","Data":"5dbbe4ad4b1846abb9e0b6ae113e92922cd3ab5b6ff1af17b6c52a8df062d693"} Jun 11 13:10:51.376086 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:51.376037 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-27s94" event={"ID":"0845cbb7-4753-461f-9d5f-1f165b89237d","Type":"ContainerStarted","Data":"e09c42bc45d18767b465844ba846d03dfdde1e9477be406a0199a8b0a11e5bdf"} Jun 11 13:10:51.389472 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:51.389434 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tbl" podStartSLOduration=3.832851327 podStartE2EDuration="21.389403577s" totalImagesPullingTime="17.55655225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:10:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:10:51.38878102 +0000 UTC m=+21.534411072" watchObservedRunningTime="2026-06-11 13:10:51.389403577 +0000 UTC m=+21.535033630" Jun 11 13:10:51.403449 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:51.403386 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-27s94" podStartSLOduration=3.481559001 podStartE2EDuration="21.40337398s" totalImagesPullingTime="17.921814979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:10:51.403237122 +0000 UTC m=+21.548867185" watchObservedRunningTime="2026-06-11 13:10:51.40337398 +0000 UTC m=+21.549004033" Jun 11 13:10:52.272783 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:52.272742 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:52.273082 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:52.272742 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:52.273082 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:52.272883 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:10:52.273082 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:52.272989 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:10:52.337274 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:52.337248 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vd4rj" Jun 11 13:10:52.337466 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:52.337379 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 13:10:52.337897 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:52.337870 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vd4rj" Jun 11 13:10:53.272302 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:53.272269 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:53.272726 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:53.272375 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:54.272311 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:54.272275 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:54.272684 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:54.272284 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:54.272684 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:54.272441 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:10:54.272684 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:54.272478 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:10:55.271664 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:55.271634 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:55.271852 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:55.271803 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:56.272396 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:56.272183 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:56.272737 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:56.272247 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:56.272737 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:56.272528 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:10:56.272737 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:56.272573 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:10:56.387199 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:56.387166 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" event={"ID":"b29e98c3-90cb-42ea-86a3-91849e998e5b","Type":"ContainerStarted","Data":"11b50bebe740164fe78d921da26dadf886c01095438e9fd7ca06b234adb9c589"} Jun 11 13:10:57.271898 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:57.271873 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:57.272023 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:57.271973 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:57.392993 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:57.392959 2576 generic.go:356] "Generic (PLEG): container finished" podID="9bd5ecac-bf25-4ba9-a147-cfa1a3bed078" containerID="fb12f1c901a2f097c0b2990e31242fdbc24e1edd7946d80a552fc1417255d64f" exitCode=0 Jun 11 13:10:57.393820 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:57.393059 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9txx" event={"ID":"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078","Type":"ContainerDied","Data":"fb12f1c901a2f097c0b2990e31242fdbc24e1edd7946d80a552fc1417255d64f"} Jun 11 13:10:57.396079 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:57.396035 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" event={"ID":"b29e98c3-90cb-42ea-86a3-91849e998e5b","Type":"ContainerStarted","Data":"5fe9761aa96c42a2847adce43918a7b59b16835c308a1e3a144aacc51c427673"} Jun 11 13:10:57.396173 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:57.396127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" event={"ID":"b29e98c3-90cb-42ea-86a3-91849e998e5b","Type":"ContainerStarted","Data":"1e158bb0517ec65b278381469ede19546193e75727d5e2ce55a1bd01a3da7e0f"} Jun 11 13:10:57.396227 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:57.396172 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" event={"ID":"b29e98c3-90cb-42ea-86a3-91849e998e5b","Type":"ContainerStarted","Data":"5b105be545fdc82c6da5d4e77c7ba20b813d38f81b98846160c61859e413f035"} Jun 11 13:10:57.396227 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:57.396218 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" event={"ID":"b29e98c3-90cb-42ea-86a3-91849e998e5b","Type":"ContainerStarted","Data":"117b6222b5f99df83017960d2591a1a70f0c9a0a5331ac29cd2cc557a17eaff2"} Jun 11 13:10:57.396291 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:57.396261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" event={"ID":"b29e98c3-90cb-42ea-86a3-91849e998e5b","Type":"ContainerStarted","Data":"9d045c9502dc0e6e8ee366dbf08a947d3867ca34440f5aeccb320fd6f662535f"} Jun 11 13:10:58.271941 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:58.271909 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:10:58.272135 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:58.272033 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:10:58.272135 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:58.272114 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:10:58.272250 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:58.272210 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:10:59.272484 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:59.272449 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:10:59.272855 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:10:59.272554 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:10:59.403580 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:59.403503 2576 generic.go:356] "Generic (PLEG): container finished" podID="9bd5ecac-bf25-4ba9-a147-cfa1a3bed078" containerID="1b5338c44cf835224cce9ca539a429f5d56e24982f14389873d2b2a2446fbef2" exitCode=0 Jun 11 13:10:59.403723 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:59.403590 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9txx" event={"ID":"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078","Type":"ContainerDied","Data":"1b5338c44cf835224cce9ca539a429f5d56e24982f14389873d2b2a2446fbef2"} Jun 11 13:10:59.406749 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:10:59.406721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" event={"ID":"b29e98c3-90cb-42ea-86a3-91849e998e5b","Type":"ContainerStarted","Data":"ed693f7b9f58288bbbcd78ace7dffaab864cbc78f3b0141e23277a6d7f325131"} Jun 11 13:11:00.272844 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:00.272806 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:11:00.273313 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:00.272909 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:11:00.273313 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:00.273000 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:11:00.273452 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:00.273315 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:11:01.272517 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:01.272330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:11:01.272650 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:01.272622 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:11:01.417301 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:01.417218 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" event={"ID":"b29e98c3-90cb-42ea-86a3-91849e998e5b","Type":"ContainerStarted","Data":"4ca7943eb42d9bd59e2958d8ee2e4d445fbb2a0c5bf5bd2e22597178faf518d7"} Jun 11 13:11:01.417825 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:01.417716 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:11:01.417825 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:01.417790 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:11:01.417951 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:01.417840 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:11:01.437300 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:01.437271 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:11:01.437664 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:01.437646 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:11:01.444965 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:01.444923 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" podStartSLOduration=8.381961605 podStartE2EDuration="31.444910215s" totalImagesPullingTime="23.06294861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:01.444680551 +0000 UTC m=+31.590310594" watchObservedRunningTime="2026-06-11 13:11:01.444910215 +0000 UTC m=+31.590540268" Jun 11 13:11:02.272651 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:02.272620 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:11:02.272832 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:02.272630 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:11:02.272832 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:02.272740 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:11:02.272942 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:02.272836 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:11:03.271771 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:03.271732 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:11:03.272310 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:03.271866 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:11:03.545858 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:03.545782 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6jbm2"] Jun 11 13:11:03.546037 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:03.545905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:11:03.546037 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:03.545992 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:11:03.554699 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:03.554675 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vtjvx"] Jun 11 13:11:03.554847 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:03.554754 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:11:03.554913 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:03.554838 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:11:03.555452 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:03.555431 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dxrv4"] Jun 11 13:11:03.555547 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:03.555505 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:11:03.555587 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:03.555577 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:11:03.964328 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:03.964241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:11:03.964528 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:03.964399 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:11:03.964528 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:03.964502 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret podName:b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b nodeName:}" failed. No retries permitted until 2026-06-11 13:11:35.964482847 +0000 UTC m=+66.110112882 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret") pod "global-pull-secret-syncer-vtjvx" (UID: "b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:11:04.065331 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:04.065299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs\") pod \"network-metrics-daemon-dxrv4\" (UID: \"a521071a-24e5-4c21-9121-d72a6e4fcdb8\") " pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:11:04.065456 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:04.065426 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:11:04.065508 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:04.065486 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs podName:a521071a-24e5-4c21-9121-d72a6e4fcdb8 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:36.065468956 +0000 UTC m=+66.211098987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs") pod "network-metrics-daemon-dxrv4" (UID: "a521071a-24e5-4c21-9121-d72a6e4fcdb8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:11:04.166547 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:04.166316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txkc\" (UniqueName: \"kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc\") pod \"network-check-target-6jbm2\" (UID: \"68893489-b0ff-4a91-afc4-f2465ed780c8\") " pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:11:04.166701 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:04.166499 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:11:04.166701 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:04.166613 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:11:04.166701 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:04.166624 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8txkc for pod openshift-network-diagnostics/network-check-target-6jbm2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:11:04.166701 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:04.166676 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc podName:68893489-b0ff-4a91-afc4-f2465ed780c8 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:36.166662013 +0000 UTC m=+66.312292045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8txkc" (UniqueName: "kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc") pod "network-check-target-6jbm2" (UID: "68893489-b0ff-4a91-afc4-f2465ed780c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:11:04.427018 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:04.426986 2576 generic.go:356] "Generic (PLEG): container finished" podID="9bd5ecac-bf25-4ba9-a147-cfa1a3bed078" containerID="a281f4e978c42fb92918cd5a40e69661532af05002e61b40ae0b68e69476c5bd" exitCode=0 Jun 11 13:11:04.427382 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:04.427042 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9txx" event={"ID":"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078","Type":"ContainerDied","Data":"a281f4e978c42fb92918cd5a40e69661532af05002e61b40ae0b68e69476c5bd"} Jun 11 13:11:05.272783 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:05.272748 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:11:05.272783 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:05.272776 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:11:05.272783 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:05.272795 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:11:05.273020 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:05.272901 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:11:05.273066 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:05.273014 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:11:05.273100 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:05.273068 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:11:05.432706 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:05.432673 2576 generic.go:356] "Generic (PLEG): container finished" podID="9bd5ecac-bf25-4ba9-a147-cfa1a3bed078" containerID="19b4bc8354aa08066aa87432bf9b1fb1f610b43d8ebc7cf6b7a116345a3e8275" exitCode=0 Jun 11 13:11:05.433084 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:05.432726 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9txx" event={"ID":"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078","Type":"ContainerDied","Data":"19b4bc8354aa08066aa87432bf9b1fb1f610b43d8ebc7cf6b7a116345a3e8275"} Jun 11 13:11:06.437917 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:06.437876 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9txx" event={"ID":"9bd5ecac-bf25-4ba9-a147-cfa1a3bed078","Type":"ContainerStarted","Data":"4b7ba9fba63369760498e81a3fa74c18eb77528e1dec4c267846884c424f610c"} Jun 11 13:11:06.475785 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:06.475734 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h9txx" podStartSLOduration=8.498945059 podStartE2EDuration="36.475720563s" totalImagesPullingTime="27.976775504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:10:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:06.4744257 +0000 UTC m=+36.620055743" watchObservedRunningTime="2026-06-11 13:11:06.475720563 +0000 UTC m=+36.621350616" Jun 11 13:11:07.271962 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:07.271922 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:11:07.272110 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:07.271968 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:11:07.272110 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:07.271968 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:11:07.272110 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:07.272022 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:11:07.272219 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:07.272131 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:11:07.272219 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:07.272185 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:11:09.272065 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.272018 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:11:09.272516 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.272073 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:11:09.272516 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.272133 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:11:09.272516 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:09.272152 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jbm2" podUID="68893489-b0ff-4a91-afc4-f2465ed780c8" Jun 11 13:11:09.272516 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:09.272214 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxrv4" podUID="a521071a-24e5-4c21-9121-d72a6e4fcdb8" Jun 11 13:11:09.272516 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:09.272276 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtjvx" podUID="b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b" Jun 11 13:11:09.682471 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.682389 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeReady" Jun 11 13:11:09.682598 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.682539 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 13:11:09.712239 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.712207 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b5556cc69-vrvnb"] Jun 11 13:11:09.716361 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.716334 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.719151 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.719128 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j"] Jun 11 13:11:09.719459 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.719430 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9w7l7\"" Jun 11 13:11:09.719771 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.719753 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 13:11:09.720914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.720845 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 13:11:09.721555 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.721525 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 13:11:09.723979 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.723959 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8"] Jun 11 13:11:09.724083 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.724065 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:09.726455 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.726435 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 13:11:09.726801 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.726784 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-46945"] Jun 11 13:11:09.726941 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.726926 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" Jun 11 13:11:09.727011 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.726972 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 13:11:09.728261 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.728214 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 13:11:09.728344 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.728299 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5fnxd\"" Jun 11 13:11:09.728470 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.728454 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 13:11:09.728518 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.728453 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 13:11:09.729399 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.729386 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66"] Jun 11 13:11:09.729529 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.729514 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:09.730090 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.730076 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 13:11:09.730479 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.730466 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:11:09.730535 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.730498 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 13:11:09.730831 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.730817 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2f66j\"" Jun 11 13:11:09.731559 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.731545 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:11:09.731784 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.731771 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 13:11:09.731967 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.731950 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4"] Jun 11 13:11:09.732053 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.732015 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" Jun 11 13:11:09.732053 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.732026 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 13:11:09.732160 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.731956 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-65dk5\"" Jun 11 13:11:09.732536 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.732518 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 13:11:09.734287 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.734267 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6c9684f6b5-5zf4s"] Jun 11 13:11:09.735223 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.734766 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:11:09.735223 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.734901 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hf8pn\"" Jun 11 13:11:09.735223 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.734978 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 13:11:09.735223 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.735136 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" Jun 11 13:11:09.736633 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.736619 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 13:11:09.738303 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.736748 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 13:11:09.738844 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.738828 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 13:11:09.739097 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.739083 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 13:11:09.739947 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.739766 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 13:11:09.740123 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.740098 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:11:09.740283 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.740268 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gn9wq"] Jun 11 13:11:09.740388 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.740370 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:09.740916 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.739028 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rtt7g\"" Jun 11 13:11:09.744288 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.744269 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 13:11:09.745475 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.745455 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 13:11:09.745997 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.745971 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 13:11:09.746551 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.746530 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 13:11:09.747158 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.747085 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 13:11:09.750471 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.750291 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tmtg5\"" Jun 11 13:11:09.750562 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.750363 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 13:11:09.750562 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.750529 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t"] Jun 11 13:11:09.750661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.750652 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 13:11:09.750759 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.750742 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gn9wq" Jun 11 13:11:09.752853 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.752834 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:11:09.753248 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.753232 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 13:11:09.753344 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.753284 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-shgzc\"" Jun 11 13:11:09.755979 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.755959 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66"] Jun 11 13:11:09.756096 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.755994 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8"] Jun 11 13:11:09.756096 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.756019 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j"] Jun 11 13:11:09.756096 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.756032 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4"] Jun 11 13:11:09.756096 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.756044 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t"] Jun 11 13:11:09.756096 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.756065 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c9684f6b5-5zf4s"] Jun 11 13:11:09.756096 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.756080 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-46945"] Jun 11 13:11:09.756096 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.756096 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b5556cc69-vrvnb"] Jun 11 13:11:09.756471 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.756111 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-whxvf"] Jun 11 13:11:09.757043 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.756609 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" Jun 11 13:11:09.758634 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.758614 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 13:11:09.758916 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.758896 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 13:11:09.758916 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.758911 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zkjk5\"" Jun 11 13:11:09.759927 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.759903 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-gbbdl"] Jun 11 13:11:09.760137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.760121 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-whxvf" Jun 11 13:11:09.762530 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.762512 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 13:11:09.762650 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.762514 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q8tj7\"" Jun 11 13:11:09.762790 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.762524 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 13:11:09.762855 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.762793 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-fsxf2"] Jun 11 13:11:09.762963 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.762931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:09.763492 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.763475 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 13:11:09.765130 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.765108 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 13:11:09.765211 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.765185 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 13:11:09.765280 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.765218 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 13:11:09.765335 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.765133 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 13:11:09.765436 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.765404 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-47z2g\"" Jun 11 13:11:09.765635 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.765599 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hp96k"] Jun 11 13:11:09.765793 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.765762 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fsxf2" Jun 11 13:11:09.768065 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.768036 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-k4hxb\"" Jun 11 13:11:09.768223 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.768205 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 13:11:09.768479 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.768461 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 13:11:09.768725 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.768700 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gn9wq"] Jun 11 13:11:09.768804 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.768734 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-fsxf2"] Jun 11 13:11:09.768804 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.768756 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-whxvf"] Jun 11 13:11:09.768804 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.768773 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-gbbdl"] Jun 11 13:11:09.768804 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.768798 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hp96k"] Jun 11 13:11:09.768994 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.768823 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:09.770271 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.770247 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 13:11:09.770754 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.770691 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 13:11:09.770848 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.770835 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 13:11:09.770951 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.770937 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s9zw4\"" Jun 11 13:11:09.811990 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.811969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-image-registry-private-configuration\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.812091 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.812004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-ca-trust-extracted\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.812091 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.812050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx9zk\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-kube-api-access-hx9zk\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.812091 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.812078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-installation-pull-secrets\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.812213 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.812098 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-bound-sa-token\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.812213 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.812125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-certificates\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.812213 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.812145 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.812213 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.812168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-trusted-ca\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.913263 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:09.913263 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-snapshots\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:09.913510 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqpbh\" (UniqueName: \"kubernetes.io/projected/6f36142e-73f8-4e51-b0aa-bd9daadad20e-kube-api-access-xqpbh\") pod \"volume-data-source-validator-78dd696465-gn9wq\" (UID: \"6f36142e-73f8-4e51-b0aa-bd9daadad20e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gn9wq" Jun 11 13:11:09.913510 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6n2z\" (UniqueName: \"kubernetes.io/projected/14dfa9fe-88ff-41c3-a4f8-564d9f3d11e6-kube-api-access-w6n2z\") pod \"network-check-source-dbd9cf844-fsxf2\" (UID: \"14dfa9fe-88ff-41c3-a4f8-564d9f3d11e6\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fsxf2" Jun 11 13:11:09.913510 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3020589-3d6c-4245-ad43-e3d40bf8794c-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-ll78t\" (UID: \"e3020589-3d6c-4245-ad43-e3d40bf8794c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" Jun 11 13:11:09.913510 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-certificates\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.913510 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09dcfe78-fdf2-4535-b96f-da069e0a0135-config\") pod \"console-operator-668fdbf85c-46945\" (UID: \"09dcfe78-fdf2-4535-b96f-da069e0a0135\") " pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:09.913510 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrll6\" (UniqueName: \"kubernetes.io/projected/19b7d659-a74d-4032-b931-a6998e537317-kube-api-access-qrll6\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q5lq4\" (UID: \"19b7d659-a74d-4032-b931-a6998e537317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" Jun 11 13:11:09.913510 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfqs4\" (UniqueName: \"kubernetes.io/projected/09dcfe78-fdf2-4535-b96f-da069e0a0135-kube-api-access-xfqs4\") pod \"console-operator-668fdbf85c-46945\" (UID: \"09dcfe78-fdf2-4535-b96f-da069e0a0135\") " pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:09.913510 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913461 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-service-ca-bundle\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:09.913510 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-stats-auth\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:09.913830 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-image-registry-private-configuration\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.913830 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09dcfe78-fdf2-4535-b96f-da069e0a0135-trusted-ca\") pod \"console-operator-668fdbf85c-46945\" (UID: \"09dcfe78-fdf2-4535-b96f-da069e0a0135\") " pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:09.913830 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx9zk\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-kube-api-access-hx9zk\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.913830 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913715 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:09.913830 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/972b42c4-89a7-4e5f-b203-aaadc81e9103-config\") pod \"service-ca-operator-6bc5ff68f5-s5z66\" (UID: \"972b42c4-89a7-4e5f-b203-aaadc81e9103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" Jun 11 13:11:09.913830 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7vhs\" (UniqueName: \"kubernetes.io/projected/972b42c4-89a7-4e5f-b203-aaadc81e9103-kube-api-access-f7vhs\") pod \"service-ca-operator-6bc5ff68f5-s5z66\" (UID: \"972b42c4-89a7-4e5f-b203-aaadc81e9103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" Jun 11 13:11:09.913830 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-serving-cert\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:09.914085 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:09.914085 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-bound-sa-token\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.914085 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-tmp\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:09.914085 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67rj5\" (UniqueName: \"kubernetes.io/projected/a896c6ec-422d-48f6-99d3-7931494ea0ef-kube-api-access-67rj5\") pod \"cluster-samples-operator-854f8b96b6-nwnl8\" (UID: \"a896c6ec-422d-48f6-99d3-7931494ea0ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" Jun 11 13:11:09.914085 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-default-certificate\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:09.914085 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.913993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-ll78t\" (UID: \"e3020589-3d6c-4245-ad43-e3d40bf8794c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" Jun 11 13:11:09.914085 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914024 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-certificates\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.914085 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914029 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-trusted-ca-bundle\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:09.914085 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/972b42c4-89a7-4e5f-b203-aaadc81e9103-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-s5z66\" (UID: \"972b42c4-89a7-4e5f-b203-aaadc81e9103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" Jun 11 13:11:09.914477 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.914477 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-trusted-ca\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.914477 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:09.914176 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:11:09.914477 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:09.914189 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b5556cc69-vrvnb: secret "image-registry-tls" not found Jun 11 13:11:09.914477 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:09.914232 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls podName:9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba nodeName:}" failed. No retries permitted until 2026-06-11 13:11:10.414218718 +0000 UTC m=+40.559848757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls") pod "image-registry-6b5556cc69-vrvnb" (UID: "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba") : secret "image-registry-tls" not found Jun 11 13:11:09.914477 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19b7d659-a74d-4032-b931-a6998e537317-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q5lq4\" (UID: \"19b7d659-a74d-4032-b931-a6998e537317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" Jun 11 13:11:09.914477 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2169af99-8f87-450c-8aff-772ef0a5e25f-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:09.914477 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09dcfe78-fdf2-4535-b96f-da069e0a0135-serving-cert\") pod \"console-operator-668fdbf85c-46945\" (UID: \"09dcfe78-fdf2-4535-b96f-da069e0a0135\") " pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:09.914477 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r9c5\" (UniqueName: \"kubernetes.io/projected/d91f7339-49e2-44d8-ae6c-240977329067-kube-api-access-6r9c5\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:09.914477 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:09.914477 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c570fbf0-ca38-4662-975f-7600c15a6844-tmp-dir\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:09.914477 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19b7d659-a74d-4032-b931-a6998e537317-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q5lq4\" (UID: \"19b7d659-a74d-4032-b931-a6998e537317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" Jun 11 13:11:09.914878 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-ca-trust-extracted\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.914878 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nwnl8\" (UID: \"a896c6ec-422d-48f6-99d3-7931494ea0ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" Jun 11 13:11:09.914878 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znb45\" (UniqueName: \"kubernetes.io/projected/3781575c-9cc6-45f5-9e7d-cbded40bcff5-kube-api-access-znb45\") pod \"ingress-canary-whxvf\" (UID: \"3781575c-9cc6-45f5-9e7d-cbded40bcff5\") " pod="openshift-ingress-canary/ingress-canary-whxvf" Jun 11 13:11:09.914878 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c570fbf0-ca38-4662-975f-7600c15a6844-config-volume\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:09.914878 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-installation-pull-secrets\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.914878 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914796 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d75rz\" (UniqueName: \"kubernetes.io/projected/2169af99-8f87-450c-8aff-772ef0a5e25f-kube-api-access-d75rz\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:09.914878 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914810 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-ca-trust-extracted\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.914878 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjhvs\" (UniqueName: \"kubernetes.io/projected/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-kube-api-access-mjhvs\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:09.914878 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3781575c-9cc6-45f5-9e7d-cbded40bcff5-cert\") pod \"ingress-canary-whxvf\" (UID: \"3781575c-9cc6-45f5-9e7d-cbded40bcff5\") " pod="openshift-ingress-canary/ingress-canary-whxvf" Jun 11 13:11:09.914878 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914861 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cwmj\" (UniqueName: \"kubernetes.io/projected/c570fbf0-ca38-4662-975f-7600c15a6844-kube-api-access-2cwmj\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:09.915195 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.914995 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-trusted-ca\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.917485 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.917459 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-installation-pull-secrets\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.917485 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.917478 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-image-registry-private-configuration\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.921732 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.921714 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx9zk\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-kube-api-access-hx9zk\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:09.924067 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:09.924039 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-bound-sa-token\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:10.016211 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19b7d659-a74d-4032-b931-a6998e537317-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q5lq4\" (UID: \"19b7d659-a74d-4032-b931-a6998e537317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" Jun 11 13:11:10.016384 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2169af99-8f87-450c-8aff-772ef0a5e25f-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:10.016384 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09dcfe78-fdf2-4535-b96f-da069e0a0135-serving-cert\") pod \"console-operator-668fdbf85c-46945\" (UID: \"09dcfe78-fdf2-4535-b96f-da069e0a0135\") " pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:10.016384 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r9c5\" (UniqueName: \"kubernetes.io/projected/d91f7339-49e2-44d8-ae6c-240977329067-kube-api-access-6r9c5\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:10.016384 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016315 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:10.016384 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c570fbf0-ca38-4662-975f-7600c15a6844-tmp-dir\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:10.016384 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19b7d659-a74d-4032-b931-a6998e537317-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q5lq4\" (UID: \"19b7d659-a74d-4032-b931-a6998e537317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" Jun 11 13:11:10.016711 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nwnl8\" (UID: \"a896c6ec-422d-48f6-99d3-7931494ea0ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" Jun 11 13:11:10.016711 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.016518 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 13:11:10.016711 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.016589 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls podName:a896c6ec-422d-48f6-99d3-7931494ea0ef nodeName:}" failed. No retries permitted until 2026-06-11 13:11:10.516570039 +0000 UTC m=+40.662200077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-nwnl8" (UID: "a896c6ec-422d-48f6-99d3-7931494ea0ef") : secret "samples-operator-tls" not found Jun 11 13:11:10.016876 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znb45\" (UniqueName: \"kubernetes.io/projected/3781575c-9cc6-45f5-9e7d-cbded40bcff5-kube-api-access-znb45\") pod \"ingress-canary-whxvf\" (UID: \"3781575c-9cc6-45f5-9e7d-cbded40bcff5\") " pod="openshift-ingress-canary/ingress-canary-whxvf" Jun 11 13:11:10.016876 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016734 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c570fbf0-ca38-4662-975f-7600c15a6844-tmp-dir\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:10.016876 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c570fbf0-ca38-4662-975f-7600c15a6844-config-volume\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:10.016876 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d75rz\" (UniqueName: \"kubernetes.io/projected/2169af99-8f87-450c-8aff-772ef0a5e25f-kube-api-access-d75rz\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:10.016876 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.016871 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:11:10.017101 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016885 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjhvs\" (UniqueName: \"kubernetes.io/projected/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-kube-api-access-mjhvs\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:10.017101 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3781575c-9cc6-45f5-9e7d-cbded40bcff5-cert\") pod \"ingress-canary-whxvf\" (UID: \"3781575c-9cc6-45f5-9e7d-cbded40bcff5\") " pod="openshift-ingress-canary/ingress-canary-whxvf" Jun 11 13:11:10.017101 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.016949 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls podName:c570fbf0-ca38-4662-975f-7600c15a6844 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:10.516930147 +0000 UTC m=+40.662560189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls") pod "dns-default-hp96k" (UID: "c570fbf0-ca38-4662-975f-7600c15a6844") : secret "dns-default-metrics-tls" not found Jun 11 13:11:10.017101 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cwmj\" (UniqueName: \"kubernetes.io/projected/c570fbf0-ca38-4662-975f-7600c15a6844-kube-api-access-2cwmj\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:10.017101 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017009 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2169af99-8f87-450c-8aff-772ef0a5e25f-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:10.017101 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.016884 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19b7d659-a74d-4032-b931-a6998e537317-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q5lq4\" (UID: \"19b7d659-a74d-4032-b931-a6998e537317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" Jun 11 13:11:10.017382 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.017117 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle podName:d91f7339-49e2-44d8-ae6c-240977329067 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:10.517099008 +0000 UTC m=+40.662729056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle") pod "router-default-6c9684f6b5-5zf4s" (UID: "d91f7339-49e2-44d8-ae6c-240977329067") : configmap references non-existent config key: service-ca.crt Jun 11 13:11:10.017382 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:10.017382 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-snapshots\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:10.017382 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqpbh\" (UniqueName: \"kubernetes.io/projected/6f36142e-73f8-4e51-b0aa-bd9daadad20e-kube-api-access-xqpbh\") pod \"volume-data-source-validator-78dd696465-gn9wq\" (UID: \"6f36142e-73f8-4e51-b0aa-bd9daadad20e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gn9wq" Jun 11 13:11:10.017382 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017237 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6n2z\" (UniqueName: \"kubernetes.io/projected/14dfa9fe-88ff-41c3-a4f8-564d9f3d11e6-kube-api-access-w6n2z\") pod \"network-check-source-dbd9cf844-fsxf2\" (UID: \"14dfa9fe-88ff-41c3-a4f8-564d9f3d11e6\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fsxf2" Jun 11 13:11:10.017382 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c570fbf0-ca38-4662-975f-7600c15a6844-config-volume\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:10.017382 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3020589-3d6c-4245-ad43-e3d40bf8794c-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-ll78t\" (UID: \"e3020589-3d6c-4245-ad43-e3d40bf8794c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" Jun 11 13:11:10.017747 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09dcfe78-fdf2-4535-b96f-da069e0a0135-config\") pod \"console-operator-668fdbf85c-46945\" (UID: \"09dcfe78-fdf2-4535-b96f-da069e0a0135\") " pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:10.017747 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017449 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrll6\" (UniqueName: \"kubernetes.io/projected/19b7d659-a74d-4032-b931-a6998e537317-kube-api-access-qrll6\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q5lq4\" (UID: \"19b7d659-a74d-4032-b931-a6998e537317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" Jun 11 13:11:10.017747 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfqs4\" (UniqueName: \"kubernetes.io/projected/09dcfe78-fdf2-4535-b96f-da069e0a0135-kube-api-access-xfqs4\") pod \"console-operator-668fdbf85c-46945\" (UID: \"09dcfe78-fdf2-4535-b96f-da069e0a0135\") " pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:10.017747 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-service-ca-bundle\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:10.017747 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-stats-auth\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:10.017747 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09dcfe78-fdf2-4535-b96f-da069e0a0135-trusted-ca\") pod \"console-operator-668fdbf85c-46945\" (UID: \"09dcfe78-fdf2-4535-b96f-da069e0a0135\") " pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:10.017747 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:10.017747 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/972b42c4-89a7-4e5f-b203-aaadc81e9103-config\") pod \"service-ca-operator-6bc5ff68f5-s5z66\" (UID: \"972b42c4-89a7-4e5f-b203-aaadc81e9103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" Jun 11 13:11:10.018137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7vhs\" (UniqueName: \"kubernetes.io/projected/972b42c4-89a7-4e5f-b203-aaadc81e9103-kube-api-access-f7vhs\") pod \"service-ca-operator-6bc5ff68f5-s5z66\" (UID: \"972b42c4-89a7-4e5f-b203-aaadc81e9103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" Jun 11 13:11:10.018137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-serving-cert\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:10.018137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:10.018137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-tmp\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:10.018137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67rj5\" (UniqueName: \"kubernetes.io/projected/a896c6ec-422d-48f6-99d3-7931494ea0ef-kube-api-access-67rj5\") pod \"cluster-samples-operator-854f8b96b6-nwnl8\" (UID: \"a896c6ec-422d-48f6-99d3-7931494ea0ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" Jun 11 13:11:10.018137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-snapshots\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:10.018137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-default-certificate\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:10.018137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-ll78t\" (UID: \"e3020589-3d6c-4245-ad43-e3d40bf8794c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" Jun 11 13:11:10.018137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.017982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-trusted-ca-bundle\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:10.018137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.018014 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/972b42c4-89a7-4e5f-b203-aaadc81e9103-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-s5z66\" (UID: \"972b42c4-89a7-4e5f-b203-aaadc81e9103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" Jun 11 13:11:10.018137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.018022 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-service-ca-bundle\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:10.018137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.018092 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09dcfe78-fdf2-4535-b96f-da069e0a0135-config\") pod \"console-operator-668fdbf85c-46945\" (UID: \"09dcfe78-fdf2-4535-b96f-da069e0a0135\") " pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:10.018137 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.018136 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 13:11:10.018791 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.018282 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 13:11:10.018791 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.018324 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert podName:e3020589-3d6c-4245-ad43-e3d40bf8794c nodeName:}" failed. No retries permitted until 2026-06-11 13:11:10.51830873 +0000 UTC m=+40.663938772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-ll78t" (UID: "e3020589-3d6c-4245-ad43-e3d40bf8794c") : secret "networking-console-plugin-cert" not found Jun 11 13:11:10.018791 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.018357 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls podName:2169af99-8f87-450c-8aff-772ef0a5e25f nodeName:}" failed. No retries permitted until 2026-06-11 13:11:10.518347964 +0000 UTC m=+40.663977995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-v6m5j" (UID: "2169af99-8f87-450c-8aff-772ef0a5e25f") : secret "cluster-monitoring-operator-tls" not found Jun 11 13:11:10.018955 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.018813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3020589-3d6c-4245-ad43-e3d40bf8794c-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-ll78t\" (UID: \"e3020589-3d6c-4245-ad43-e3d40bf8794c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" Jun 11 13:11:10.018955 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.018879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-trusted-ca-bundle\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:10.019056 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.018963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/972b42c4-89a7-4e5f-b203-aaadc81e9103-config\") pod \"service-ca-operator-6bc5ff68f5-s5z66\" (UID: \"972b42c4-89a7-4e5f-b203-aaadc81e9103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" Jun 11 13:11:10.019056 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.018974 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09dcfe78-fdf2-4535-b96f-da069e0a0135-trusted-ca\") pod \"console-operator-668fdbf85c-46945\" (UID: \"09dcfe78-fdf2-4535-b96f-da069e0a0135\") " pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:10.019159 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.019101 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-tmp\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:10.019216 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.019173 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:11:10.019266 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.019241 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs podName:d91f7339-49e2-44d8-ae6c-240977329067 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:10.519217081 +0000 UTC m=+40.664847127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs") pod "router-default-6c9684f6b5-5zf4s" (UID: "d91f7339-49e2-44d8-ae6c-240977329067") : secret "router-metrics-certs-default" not found Jun 11 13:11:10.020047 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.020025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09dcfe78-fdf2-4535-b96f-da069e0a0135-serving-cert\") pod \"console-operator-668fdbf85c-46945\" (UID: \"09dcfe78-fdf2-4535-b96f-da069e0a0135\") " pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:10.020430 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.020394 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-stats-auth\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:10.020749 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.020719 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3781575c-9cc6-45f5-9e7d-cbded40bcff5-cert\") pod \"ingress-canary-whxvf\" (UID: \"3781575c-9cc6-45f5-9e7d-cbded40bcff5\") " pod="openshift-ingress-canary/ingress-canary-whxvf" Jun 11 13:11:10.021096 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.021078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/972b42c4-89a7-4e5f-b203-aaadc81e9103-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-s5z66\" (UID: \"972b42c4-89a7-4e5f-b203-aaadc81e9103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" Jun 11 13:11:10.021225 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.021209 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-default-certificate\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:10.021344 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.021329 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-serving-cert\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:10.021381 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.021350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19b7d659-a74d-4032-b931-a6998e537317-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q5lq4\" (UID: \"19b7d659-a74d-4032-b931-a6998e537317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" Jun 11 13:11:10.028489 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.027868 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r9c5\" (UniqueName: \"kubernetes.io/projected/d91f7339-49e2-44d8-ae6c-240977329067-kube-api-access-6r9c5\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:10.028489 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.028078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjhvs\" (UniqueName: \"kubernetes.io/projected/5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4-kube-api-access-mjhvs\") pod \"insights-operator-896549976-gbbdl\" (UID: \"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4\") " pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:10.028489 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.028262 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7vhs\" (UniqueName: \"kubernetes.io/projected/972b42c4-89a7-4e5f-b203-aaadc81e9103-kube-api-access-f7vhs\") pod \"service-ca-operator-6bc5ff68f5-s5z66\" (UID: \"972b42c4-89a7-4e5f-b203-aaadc81e9103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" Jun 11 13:11:10.028489 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.028446 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znb45\" (UniqueName: \"kubernetes.io/projected/3781575c-9cc6-45f5-9e7d-cbded40bcff5-kube-api-access-znb45\") pod \"ingress-canary-whxvf\" (UID: \"3781575c-9cc6-45f5-9e7d-cbded40bcff5\") " pod="openshift-ingress-canary/ingress-canary-whxvf" Jun 11 13:11:10.029000 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.028933 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6n2z\" (UniqueName: \"kubernetes.io/projected/14dfa9fe-88ff-41c3-a4f8-564d9f3d11e6-kube-api-access-w6n2z\") pod \"network-check-source-dbd9cf844-fsxf2\" (UID: \"14dfa9fe-88ff-41c3-a4f8-564d9f3d11e6\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fsxf2" Jun 11 13:11:10.029333 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.029315 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cwmj\" (UniqueName: \"kubernetes.io/projected/c570fbf0-ca38-4662-975f-7600c15a6844-kube-api-access-2cwmj\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:10.029430 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.029318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrll6\" (UniqueName: \"kubernetes.io/projected/19b7d659-a74d-4032-b931-a6998e537317-kube-api-access-qrll6\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q5lq4\" (UID: \"19b7d659-a74d-4032-b931-a6998e537317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" Jun 11 13:11:10.029534 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.029515 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfqs4\" (UniqueName: \"kubernetes.io/projected/09dcfe78-fdf2-4535-b96f-da069e0a0135-kube-api-access-xfqs4\") pod \"console-operator-668fdbf85c-46945\" (UID: \"09dcfe78-fdf2-4535-b96f-da069e0a0135\") " pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:10.029764 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.029749 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67rj5\" (UniqueName: \"kubernetes.io/projected/a896c6ec-422d-48f6-99d3-7931494ea0ef-kube-api-access-67rj5\") pod \"cluster-samples-operator-854f8b96b6-nwnl8\" (UID: \"a896c6ec-422d-48f6-99d3-7931494ea0ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" Jun 11 13:11:10.030386 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.030367 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqpbh\" (UniqueName: \"kubernetes.io/projected/6f36142e-73f8-4e51-b0aa-bd9daadad20e-kube-api-access-xqpbh\") pod \"volume-data-source-validator-78dd696465-gn9wq\" (UID: \"6f36142e-73f8-4e51-b0aa-bd9daadad20e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gn9wq" Jun 11 13:11:10.030842 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.030822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d75rz\" (UniqueName: \"kubernetes.io/projected/2169af99-8f87-450c-8aff-772ef0a5e25f-kube-api-access-d75rz\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:10.066689 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.066659 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:10.074381 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.074218 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" Jun 11 13:11:10.079188 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.079159 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" Jun 11 13:11:10.091018 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.090994 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gn9wq" Jun 11 13:11:10.102378 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.102349 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-whxvf" Jun 11 13:11:10.106997 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.106973 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-gbbdl" Jun 11 13:11:10.112612 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.112559 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fsxf2" Jun 11 13:11:10.309111 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.309007 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-46945"] Jun 11 13:11:10.317545 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.317518 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4"] Jun 11 13:11:10.317725 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.317708 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66"] Jun 11 13:11:10.319551 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:11:10.318699 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09dcfe78_fdf2_4535_b96f_da069e0a0135.slice/crio-03b34cb70a24136513e66229f1d10c00a5dc883d5479c6ddb8e7410eeb5c40ea WatchSource:0}: Error finding container 03b34cb70a24136513e66229f1d10c00a5dc883d5479c6ddb8e7410eeb5c40ea: Status 404 returned error can't find the container with id 03b34cb70a24136513e66229f1d10c00a5dc883d5479c6ddb8e7410eeb5c40ea Jun 11 13:11:10.328698 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.328245 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gn9wq"] Jun 11 13:11:10.360674 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.360633 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-whxvf"] Jun 11 13:11:10.363459 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:11:10.363434 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3781575c_9cc6_45f5_9e7d_cbded40bcff5.slice/crio-a35c1bfedbae74f453683ec42b7a947102554b7a8dee13e93148b98785ab8402 WatchSource:0}: Error finding container a35c1bfedbae74f453683ec42b7a947102554b7a8dee13e93148b98785ab8402: Status 404 returned error can't find the container with id a35c1bfedbae74f453683ec42b7a947102554b7a8dee13e93148b98785ab8402 Jun 11 13:11:10.366309 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.366286 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-fsxf2"] Jun 11 13:11:10.369305 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:11:10.369284 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14dfa9fe_88ff_41c3_a4f8_564d9f3d11e6.slice/crio-843f2e05bca43617881748232ca32d432543b72ed8ff6922f34cfdcb9e931343 WatchSource:0}: Error finding container 843f2e05bca43617881748232ca32d432543b72ed8ff6922f34cfdcb9e931343: Status 404 returned error can't find the container with id 843f2e05bca43617881748232ca32d432543b72ed8ff6922f34cfdcb9e931343 Jun 11 13:11:10.381251 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.381230 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-gbbdl"] Jun 11 13:11:10.384354 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:11:10.384334 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a8206f8_335d_4c9e_bbad_fc7aa45b0dd4.slice/crio-d4ab58e834616e0e0f4d91e3a708a887e1db4919ce8e5aaa87da5379fb3fbdd9 WatchSource:0}: Error finding container d4ab58e834616e0e0f4d91e3a708a887e1db4919ce8e5aaa87da5379fb3fbdd9: Status 404 returned error can't find the container with id d4ab58e834616e0e0f4d91e3a708a887e1db4919ce8e5aaa87da5379fb3fbdd9 Jun 11 13:11:10.425073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.425039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:10.425231 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.425187 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:11:10.425231 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.425203 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b5556cc69-vrvnb: secret "image-registry-tls" not found Jun 11 13:11:10.425325 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.425263 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls podName:9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba nodeName:}" failed. No retries permitted until 2026-06-11 13:11:11.425243442 +0000 UTC m=+41.570873478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls") pod "image-registry-6b5556cc69-vrvnb" (UID: "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba") : secret "image-registry-tls" not found Jun 11 13:11:10.447368 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.447341 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-gbbdl" event={"ID":"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4","Type":"ContainerStarted","Data":"d4ab58e834616e0e0f4d91e3a708a887e1db4919ce8e5aaa87da5379fb3fbdd9"} Jun 11 13:11:10.448438 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.448395 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-whxvf" event={"ID":"3781575c-9cc6-45f5-9e7d-cbded40bcff5","Type":"ContainerStarted","Data":"a35c1bfedbae74f453683ec42b7a947102554b7a8dee13e93148b98785ab8402"} Jun 11 13:11:10.449405 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.449378 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gn9wq" event={"ID":"6f36142e-73f8-4e51-b0aa-bd9daadad20e","Type":"ContainerStarted","Data":"e3452f9434f0583ee60430062be28e549e76c5c06f5cc45417654c38cb5cda0c"} Jun 11 13:11:10.450445 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.450407 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-46945" event={"ID":"09dcfe78-fdf2-4535-b96f-da069e0a0135","Type":"ContainerStarted","Data":"03b34cb70a24136513e66229f1d10c00a5dc883d5479c6ddb8e7410eeb5c40ea"} Jun 11 13:11:10.451499 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.451480 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fsxf2" event={"ID":"14dfa9fe-88ff-41c3-a4f8-564d9f3d11e6","Type":"ContainerStarted","Data":"843f2e05bca43617881748232ca32d432543b72ed8ff6922f34cfdcb9e931343"} Jun 11 13:11:10.452422 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.452392 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" event={"ID":"19b7d659-a74d-4032-b931-a6998e537317","Type":"ContainerStarted","Data":"33794f2cb6992dd627a76b91c203cc6e91f63bb9febec3b4be47693e579f20b4"} Jun 11 13:11:10.453421 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.453392 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" event={"ID":"972b42c4-89a7-4e5f-b203-aaadc81e9103","Type":"ContainerStarted","Data":"f17d3744938291a232ec69510585c683faede6a029908eaa0c8dfc30757f71ae"} Jun 11 13:11:10.525939 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.525852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:10.525939 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.525889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:10.525939 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.525912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-ll78t\" (UID: \"e3020589-3d6c-4245-ad43-e3d40bf8794c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" Jun 11 13:11:10.526196 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.525970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:10.526196 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.525993 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nwnl8\" (UID: \"a896c6ec-422d-48f6-99d3-7931494ea0ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" Jun 11 13:11:10.526196 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.526005 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 13:11:10.526196 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:10.526047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:10.526196 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.526068 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 13:11:10.526196 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.526090 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls podName:2169af99-8f87-450c-8aff-772ef0a5e25f nodeName:}" failed. No retries permitted until 2026-06-11 13:11:11.526066644 +0000 UTC m=+41.671696689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-v6m5j" (UID: "2169af99-8f87-450c-8aff-772ef0a5e25f") : secret "cluster-monitoring-operator-tls" not found Jun 11 13:11:10.526196 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.526005 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:11:10.526196 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.526112 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls podName:a896c6ec-422d-48f6-99d3-7931494ea0ef nodeName:}" failed. No retries permitted until 2026-06-11 13:11:11.526096441 +0000 UTC m=+41.671726472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-nwnl8" (UID: "a896c6ec-422d-48f6-99d3-7931494ea0ef") : secret "samples-operator-tls" not found Jun 11 13:11:10.526196 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.526133 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 13:11:10.526196 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.526149 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs podName:d91f7339-49e2-44d8-ae6c-240977329067 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:11.526134528 +0000 UTC m=+41.671764563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs") pod "router-default-6c9684f6b5-5zf4s" (UID: "d91f7339-49e2-44d8-ae6c-240977329067") : secret "router-metrics-certs-default" not found Jun 11 13:11:10.526196 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.526167 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle podName:d91f7339-49e2-44d8-ae6c-240977329067 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:11.526158214 +0000 UTC m=+41.671788250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle") pod "router-default-6c9684f6b5-5zf4s" (UID: "d91f7339-49e2-44d8-ae6c-240977329067") : configmap references non-existent config key: service-ca.crt Jun 11 13:11:10.526196 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.526183 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert podName:e3020589-3d6c-4245-ad43-e3d40bf8794c nodeName:}" failed. No retries permitted until 2026-06-11 13:11:11.526175192 +0000 UTC m=+41.671805225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-ll78t" (UID: "e3020589-3d6c-4245-ad43-e3d40bf8794c") : secret "networking-console-plugin-cert" not found Jun 11 13:11:10.526196 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.526203 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:11:10.526757 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:10.526233 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls podName:c570fbf0-ca38-4662-975f-7600c15a6844 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:11.526225343 +0000 UTC m=+41.671855377 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls") pod "dns-default-hp96k" (UID: "c570fbf0-ca38-4662-975f-7600c15a6844") : secret "dns-default-metrics-tls" not found Jun 11 13:11:11.272503 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:11.272468 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:11:11.272969 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:11.272949 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:11:11.273407 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:11.273389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:11:11.277570 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:11.277493 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2fc6r\"" Jun 11 13:11:11.277847 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:11.277751 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 13:11:11.278933 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:11.278083 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 13:11:11.278933 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:11.278305 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lb4sh\"" Jun 11 13:11:11.447504 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:11.447318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:11.447944 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:11.447517 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:11:11.447944 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:11.447534 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b5556cc69-vrvnb: secret "image-registry-tls" not found Jun 11 13:11:11.447944 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:11.447593 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls podName:9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba nodeName:}" failed. No retries permitted until 2026-06-11 13:11:13.4475739 +0000 UTC m=+43.593203934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls") pod "image-registry-6b5556cc69-vrvnb" (UID: "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba") : secret "image-registry-tls" not found Jun 11 13:11:11.549353 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:11.548088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:11.549353 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:11.548148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:11.549353 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:11.548182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-ll78t\" (UID: \"e3020589-3d6c-4245-ad43-e3d40bf8794c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" Jun 11 13:11:11.549353 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:11.548258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:11.549353 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:11.548299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nwnl8\" (UID: \"a896c6ec-422d-48f6-99d3-7931494ea0ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" Jun 11 13:11:11.549353 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:11.548343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:11.549353 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:11.548503 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle podName:d91f7339-49e2-44d8-ae6c-240977329067 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:13.548484322 +0000 UTC m=+43.694114375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle") pod "router-default-6c9684f6b5-5zf4s" (UID: "d91f7339-49e2-44d8-ae6c-240977329067") : configmap references non-existent config key: service-ca.crt Jun 11 13:11:11.549353 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:11.548918 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 13:11:11.549353 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:11.548968 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls podName:2169af99-8f87-450c-8aff-772ef0a5e25f nodeName:}" failed. No retries permitted until 2026-06-11 13:11:13.54895281 +0000 UTC m=+43.694582858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-v6m5j" (UID: "2169af99-8f87-450c-8aff-772ef0a5e25f") : secret "cluster-monitoring-operator-tls" not found Jun 11 13:11:11.549353 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:11.549019 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:11:11.549353 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:11.549050 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs podName:d91f7339-49e2-44d8-ae6c-240977329067 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:13.549039886 +0000 UTC m=+43.694669920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs") pod "router-default-6c9684f6b5-5zf4s" (UID: "d91f7339-49e2-44d8-ae6c-240977329067") : secret "router-metrics-certs-default" not found Jun 11 13:11:11.549353 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:11.549096 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 13:11:11.549353 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:11.549126 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert podName:e3020589-3d6c-4245-ad43-e3d40bf8794c nodeName:}" failed. No retries permitted until 2026-06-11 13:11:13.549116562 +0000 UTC m=+43.694746595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-ll78t" (UID: "e3020589-3d6c-4245-ad43-e3d40bf8794c") : secret "networking-console-plugin-cert" not found Jun 11 13:11:11.549353 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:11.549175 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:11:11.550158 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:11.549200 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls podName:c570fbf0-ca38-4662-975f-7600c15a6844 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:13.549191458 +0000 UTC m=+43.694821493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls") pod "dns-default-hp96k" (UID: "c570fbf0-ca38-4662-975f-7600c15a6844") : secret "dns-default-metrics-tls" not found Jun 11 13:11:11.550158 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:11.549247 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 13:11:11.550158 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:11.549276 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls podName:a896c6ec-422d-48f6-99d3-7931494ea0ef nodeName:}" failed. No retries permitted until 2026-06-11 13:11:13.549265546 +0000 UTC m=+43.694895617 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-nwnl8" (UID: "a896c6ec-422d-48f6-99d3-7931494ea0ef") : secret "samples-operator-tls" not found Jun 11 13:11:12.463849 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:12.463520 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gn9wq" event={"ID":"6f36142e-73f8-4e51-b0aa-bd9daadad20e","Type":"ContainerStarted","Data":"ee36f438a1bad09fd0b866944f265c6ceacb5205d478a2e100ffb28ff2df2bc2"} Jun 11 13:11:12.478125 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:12.478069 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gn9wq" podStartSLOduration=37.722437668 podStartE2EDuration="39.478051115s" totalImagesPullingTime="1.755613447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:12.477064077 +0000 UTC m=+42.622694169" watchObservedRunningTime="2026-06-11 13:11:12.478051115 +0000 UTC m=+42.623681170" Jun 11 13:11:13.467895 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:13.467850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:13.468340 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:13.468007 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:11:13.468340 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:13.468021 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b5556cc69-vrvnb: secret "image-registry-tls" not found Jun 11 13:11:13.468340 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:13.468077 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls podName:9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba nodeName:}" failed. No retries permitted until 2026-06-11 13:11:17.468060235 +0000 UTC m=+47.613690283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls") pod "image-registry-6b5556cc69-vrvnb" (UID: "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba") : secret "image-registry-tls" not found Jun 11 13:11:13.568337 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:13.568297 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:13.568517 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:13.568388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:13.568517 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:13.568439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:13.568517 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:13.568474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-ll78t\" (UID: \"e3020589-3d6c-4245-ad43-e3d40bf8794c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" Jun 11 13:11:13.568701 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:13.568516 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle podName:d91f7339-49e2-44d8-ae6c-240977329067 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:17.568493681 +0000 UTC m=+47.714123733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle") pod "router-default-6c9684f6b5-5zf4s" (UID: "d91f7339-49e2-44d8-ae6c-240977329067") : configmap references non-existent config key: service-ca.crt Jun 11 13:11:13.568701 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:13.568538 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 13:11:13.568701 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:13.568559 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 13:11:13.568701 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:13.568570 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:11:13.568701 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:13.568590 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls podName:2169af99-8f87-450c-8aff-772ef0a5e25f nodeName:}" failed. No retries permitted until 2026-06-11 13:11:17.568579087 +0000 UTC m=+47.714209133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-v6m5j" (UID: "2169af99-8f87-450c-8aff-772ef0a5e25f") : secret "cluster-monitoring-operator-tls" not found Jun 11 13:11:13.568701 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:13.568616 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert podName:e3020589-3d6c-4245-ad43-e3d40bf8794c nodeName:}" failed. No retries permitted until 2026-06-11 13:11:17.568600604 +0000 UTC m=+47.714230634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-ll78t" (UID: "e3020589-3d6c-4245-ad43-e3d40bf8794c") : secret "networking-console-plugin-cert" not found Jun 11 13:11:13.568701 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:13.568642 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs podName:d91f7339-49e2-44d8-ae6c-240977329067 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:17.568632285 +0000 UTC m=+47.714262321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs") pod "router-default-6c9684f6b5-5zf4s" (UID: "d91f7339-49e2-44d8-ae6c-240977329067") : secret "router-metrics-certs-default" not found Jun 11 13:11:13.568701 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:13.568687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:13.569046 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:13.568732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nwnl8\" (UID: \"a896c6ec-422d-48f6-99d3-7931494ea0ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" Jun 11 13:11:13.569046 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:13.568791 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:11:13.569046 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:13.568825 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls podName:c570fbf0-ca38-4662-975f-7600c15a6844 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:17.568813438 +0000 UTC m=+47.714443480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls") pod "dns-default-hp96k" (UID: "c570fbf0-ca38-4662-975f-7600c15a6844") : secret "dns-default-metrics-tls" not found Jun 11 13:11:13.569046 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:13.568859 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 13:11:13.569046 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:13.568911 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls podName:a896c6ec-422d-48f6-99d3-7931494ea0ef nodeName:}" failed. No retries permitted until 2026-06-11 13:11:17.568892798 +0000 UTC m=+47.714522834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-nwnl8" (UID: "a896c6ec-422d-48f6-99d3-7931494ea0ef") : secret "samples-operator-tls" not found Jun 11 13:11:17.480000 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.479494 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-gbbdl" event={"ID":"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4","Type":"ContainerStarted","Data":"1bcfb32405e9a812f0738804cf74bd80a155f156a2fbb6d04d407c0882470a34"} Jun 11 13:11:17.481123 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.481090 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-whxvf" event={"ID":"3781575c-9cc6-45f5-9e7d-cbded40bcff5","Type":"ContainerStarted","Data":"19e9b306d120b01b1841e0fd1aa0f90a6777dcc66293970aded3a6c69ada8dae"} Jun 11 13:11:17.482889 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.482838 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/0.log" Jun 11 13:11:17.482889 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.482880 2576 generic.go:356] "Generic (PLEG): container finished" podID="09dcfe78-fdf2-4535-b96f-da069e0a0135" containerID="8727f9df207bfbe9ff99ad126a1b613badc7a3fb6dbb615a7041ef3b326dc84d" exitCode=255 Jun 11 13:11:17.483087 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.482952 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-46945" event={"ID":"09dcfe78-fdf2-4535-b96f-da069e0a0135","Type":"ContainerDied","Data":"8727f9df207bfbe9ff99ad126a1b613badc7a3fb6dbb615a7041ef3b326dc84d"} Jun 11 13:11:17.483143 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.483126 2576 scope.go:117] "RemoveContainer" containerID="8727f9df207bfbe9ff99ad126a1b613badc7a3fb6dbb615a7041ef3b326dc84d" Jun 11 13:11:17.484457 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.484434 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fsxf2" event={"ID":"14dfa9fe-88ff-41c3-a4f8-564d9f3d11e6","Type":"ContainerStarted","Data":"80afc4caf66d8ffb76b23b47b4c7f55a92ff2b3eaf9b5528547d90a13398375f"} Jun 11 13:11:17.485966 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.485945 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" event={"ID":"19b7d659-a74d-4032-b931-a6998e537317","Type":"ContainerStarted","Data":"8770c6100fb6820b06df1961f36b734f10aad24e0a7064a0fc974705cf1ee1e1"} Jun 11 13:11:17.487614 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.487591 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" event={"ID":"972b42c4-89a7-4e5f-b203-aaadc81e9103","Type":"ContainerStarted","Data":"56112dd74cd50527ceeecf99c9a6ce07421c99740a31f4ea48fe34756e402084"} Jun 11 13:11:17.500601 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.500557 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-gbbdl" podStartSLOduration=38.283828867 podStartE2EDuration="44.500539869s" totalImagesPullingTime="6.216711002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:17.499461023 +0000 UTC m=+47.645091081" watchObservedRunningTime="2026-06-11 13:11:17.500539869 +0000 UTC m=+47.646169920" Jun 11 13:11:17.503959 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.503934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:17.505609 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:17.505024 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:11:17.505609 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:17.505044 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b5556cc69-vrvnb: secret "image-registry-tls" not found Jun 11 13:11:17.505609 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:17.505093 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls podName:9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba nodeName:}" failed. No retries permitted until 2026-06-11 13:11:25.505075712 +0000 UTC m=+55.650705757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls") pod "image-registry-6b5556cc69-vrvnb" (UID: "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba") : secret "image-registry-tls" not found Jun 11 13:11:17.535654 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.535505 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" podStartSLOduration=38.259462649 podStartE2EDuration="44.535468496s" totalImagesPullingTime="6.276005847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:17.534495561 +0000 UTC m=+47.680125615" watchObservedRunningTime="2026-06-11 13:11:17.535468496 +0000 UTC m=+47.681098550" Jun 11 13:11:17.557092 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.551652 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" podStartSLOduration=38.274102147 podStartE2EDuration="44.551633619s" totalImagesPullingTime="6.277531472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:17.551520904 +0000 UTC m=+47.697150958" watchObservedRunningTime="2026-06-11 13:11:17.551633619 +0000 UTC m=+47.697263673" Jun 11 13:11:17.576605 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.571092 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-whxvf" podStartSLOduration=2.333057758 podStartE2EDuration="8.571071045s" totalImagesPullingTime="6.238013287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:17.569106918 +0000 UTC m=+47.714736972" watchObservedRunningTime="2026-06-11 13:11:17.571071045 +0000 UTC m=+47.716701100" Jun 11 13:11:17.583567 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.583523 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fsxf2" podStartSLOduration=38.339283192 podStartE2EDuration="44.583508535s" totalImagesPullingTime="6.244225343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:17.582795184 +0000 UTC m=+47.728425238" watchObservedRunningTime="2026-06-11 13:11:17.583508535 +0000 UTC m=+47.729138587" Jun 11 13:11:17.605438 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.605297 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:17.605438 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.605353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nwnl8\" (UID: \"a896c6ec-422d-48f6-99d3-7931494ea0ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" Jun 11 13:11:17.605438 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.605400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:17.605654 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.605480 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:17.605654 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.605512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:17.605654 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:17.605546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-ll78t\" (UID: \"e3020589-3d6c-4245-ad43-e3d40bf8794c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" Jun 11 13:11:17.605832 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:17.605723 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 13:11:17.605832 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:17.605778 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert podName:e3020589-3d6c-4245-ad43-e3d40bf8794c nodeName:}" failed. No retries permitted until 2026-06-11 13:11:25.605760668 +0000 UTC m=+55.751390707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-ll78t" (UID: "e3020589-3d6c-4245-ad43-e3d40bf8794c") : secret "networking-console-plugin-cert" not found Jun 11 13:11:17.606289 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:17.606047 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle podName:d91f7339-49e2-44d8-ae6c-240977329067 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:25.606027636 +0000 UTC m=+55.751657673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle") pod "router-default-6c9684f6b5-5zf4s" (UID: "d91f7339-49e2-44d8-ae6c-240977329067") : configmap references non-existent config key: service-ca.crt Jun 11 13:11:17.606289 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:17.606120 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 13:11:17.606289 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:17.606125 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:11:17.606289 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:17.606157 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls podName:2169af99-8f87-450c-8aff-772ef0a5e25f nodeName:}" failed. No retries permitted until 2026-06-11 13:11:25.606146166 +0000 UTC m=+55.751776202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-v6m5j" (UID: "2169af99-8f87-450c-8aff-772ef0a5e25f") : secret "cluster-monitoring-operator-tls" not found Jun 11 13:11:17.606289 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:17.606172 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs podName:d91f7339-49e2-44d8-ae6c-240977329067 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:25.606163362 +0000 UTC m=+55.751793400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs") pod "router-default-6c9684f6b5-5zf4s" (UID: "d91f7339-49e2-44d8-ae6c-240977329067") : secret "router-metrics-certs-default" not found Jun 11 13:11:17.606289 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:17.606193 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:11:17.606289 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:17.606224 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls podName:c570fbf0-ca38-4662-975f-7600c15a6844 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:25.606210692 +0000 UTC m=+55.751840728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls") pod "dns-default-hp96k" (UID: "c570fbf0-ca38-4662-975f-7600c15a6844") : secret "dns-default-metrics-tls" not found Jun 11 13:11:17.606289 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:17.606224 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 13:11:17.606289 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:17.606270 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls podName:a896c6ec-422d-48f6-99d3-7931494ea0ef nodeName:}" failed. No retries permitted until 2026-06-11 13:11:25.606260054 +0000 UTC m=+55.751890093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-nwnl8" (UID: "a896c6ec-422d-48f6-99d3-7931494ea0ef") : secret "samples-operator-tls" not found Jun 11 13:11:18.492495 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:18.492467 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:11:18.492936 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:18.492902 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/0.log" Jun 11 13:11:18.493003 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:18.492944 2576 generic.go:356] "Generic (PLEG): container finished" podID="09dcfe78-fdf2-4535-b96f-da069e0a0135" containerID="5b155284457ca3049202d66b07c81183c7274506f928cd52559229e60b8620e7" exitCode=255 Jun 11 13:11:18.493059 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:18.493021 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-46945" event={"ID":"09dcfe78-fdf2-4535-b96f-da069e0a0135","Type":"ContainerDied","Data":"5b155284457ca3049202d66b07c81183c7274506f928cd52559229e60b8620e7"} Jun 11 13:11:18.493107 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:18.493082 2576 scope.go:117] "RemoveContainer" containerID="8727f9df207bfbe9ff99ad126a1b613badc7a3fb6dbb615a7041ef3b326dc84d" Jun 11 13:11:18.493312 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:18.493297 2576 scope.go:117] "RemoveContainer" containerID="5b155284457ca3049202d66b07c81183c7274506f928cd52559229e60b8620e7" Jun 11 13:11:18.493519 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:18.493493 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-46945_openshift-console-operator(09dcfe78-fdf2-4535-b96f-da069e0a0135)\"" pod="openshift-console-operator/console-operator-668fdbf85c-46945" podUID="09dcfe78-fdf2-4535-b96f-da069e0a0135" Jun 11 13:11:19.498222 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:19.498195 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:11:19.498672 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:19.498564 2576 scope.go:117] "RemoveContainer" containerID="5b155284457ca3049202d66b07c81183c7274506f928cd52559229e60b8620e7" Jun 11 13:11:19.498737 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:19.498718 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-46945_openshift-console-operator(09dcfe78-fdf2-4535-b96f-da069e0a0135)\"" pod="openshift-console-operator/console-operator-668fdbf85c-46945" podUID="09dcfe78-fdf2-4535-b96f-da069e0a0135" Jun 11 13:11:19.626308 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:19.626278 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxl6s_0d4968e5-3b3f-4f22-81b7-5d584801260d/dns-node-resolver/0.log" Jun 11 13:11:20.067475 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:20.067428 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:20.067636 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:20.067498 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:20.226231 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:20.226204 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g8rr2_9f4f82d6-9818-4618-ab71-902e0f62f5fc/node-ca/0.log" Jun 11 13:11:20.501875 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:20.501801 2576 scope.go:117] "RemoveContainer" containerID="5b155284457ca3049202d66b07c81183c7274506f928cd52559229e60b8620e7" Jun 11 13:11:20.502282 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:20.501968 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-46945_openshift-console-operator(09dcfe78-fdf2-4535-b96f-da069e0a0135)\"" pod="openshift-console-operator/console-operator-668fdbf85c-46945" podUID="09dcfe78-fdf2-4535-b96f-da069e0a0135" Jun 11 13:11:21.026464 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:21.026435 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-whxvf_3781575c-9cc6-45f5-9e7d-cbded40bcff5/serve-healthcheck-canary/0.log" Jun 11 13:11:25.578299 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:25.578269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:25.578758 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:25.578441 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:11:25.578758 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:25.578459 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b5556cc69-vrvnb: secret "image-registry-tls" not found Jun 11 13:11:25.578758 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:25.578514 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls podName:9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba nodeName:}" failed. No retries permitted until 2026-06-11 13:11:41.578499604 +0000 UTC m=+71.724129640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls") pod "image-registry-6b5556cc69-vrvnb" (UID: "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba") : secret "image-registry-tls" not found Jun 11 13:11:25.679706 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:25.679676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:25.679872 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:25.679726 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:25.679872 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:25.679753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:25.679872 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:25.679773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-ll78t\" (UID: \"e3020589-3d6c-4245-ad43-e3d40bf8794c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" Jun 11 13:11:25.679872 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:25.679850 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle podName:d91f7339-49e2-44d8-ae6c-240977329067 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:41.679827566 +0000 UTC m=+71.825457603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle") pod "router-default-6c9684f6b5-5zf4s" (UID: "d91f7339-49e2-44d8-ae6c-240977329067") : configmap references non-existent config key: service-ca.crt Jun 11 13:11:25.680080 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:25.679896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:25.680080 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:25.679947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nwnl8\" (UID: \"a896c6ec-422d-48f6-99d3-7931494ea0ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" Jun 11 13:11:25.680223 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:25.680081 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 13:11:25.680223 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:25.680145 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls podName:a896c6ec-422d-48f6-99d3-7931494ea0ef nodeName:}" failed. No retries permitted until 2026-06-11 13:11:41.680130231 +0000 UTC m=+71.825760265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-nwnl8" (UID: "a896c6ec-422d-48f6-99d3-7931494ea0ef") : secret "samples-operator-tls" not found Jun 11 13:11:25.680343 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:25.680292 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 13:11:25.680343 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:25.680313 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 13:11:25.680483 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:25.680349 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls podName:2169af99-8f87-450c-8aff-772ef0a5e25f nodeName:}" failed. No retries permitted until 2026-06-11 13:11:41.680331652 +0000 UTC m=+71.825961684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-v6m5j" (UID: "2169af99-8f87-450c-8aff-772ef0a5e25f") : secret "cluster-monitoring-operator-tls" not found Jun 11 13:11:25.680483 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:25.680360 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:11:25.680483 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:25.680363 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert podName:e3020589-3d6c-4245-ad43-e3d40bf8794c nodeName:}" failed. No retries permitted until 2026-06-11 13:11:41.680357151 +0000 UTC m=+71.825987182 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-ll78t" (UID: "e3020589-3d6c-4245-ad43-e3d40bf8794c") : secret "networking-console-plugin-cert" not found Jun 11 13:11:25.680483 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:25.680432 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs podName:d91f7339-49e2-44d8-ae6c-240977329067 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:41.680400636 +0000 UTC m=+71.826030674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs") pod "router-default-6c9684f6b5-5zf4s" (UID: "d91f7339-49e2-44d8-ae6c-240977329067") : secret "router-metrics-certs-default" not found Jun 11 13:11:25.680678 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:25.680549 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:11:25.680678 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:11:25.680614 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls podName:c570fbf0-ca38-4662-975f-7600c15a6844 nodeName:}" failed. No retries permitted until 2026-06-11 13:11:41.680597648 +0000 UTC m=+71.826227696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls") pod "dns-default-hp96k" (UID: "c570fbf0-ca38-4662-975f-7600c15a6844") : secret "dns-default-metrics-tls" not found Jun 11 13:11:33.272914 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:33.272885 2576 scope.go:117] "RemoveContainer" containerID="5b155284457ca3049202d66b07c81183c7274506f928cd52559229e60b8620e7" Jun 11 13:11:33.432653 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:33.432625 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8cz6" Jun 11 13:11:33.548592 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:33.548513 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:11:33.548592 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:33.548572 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-46945" event={"ID":"09dcfe78-fdf2-4535-b96f-da069e0a0135","Type":"ContainerStarted","Data":"68677cc03b42b71c640393297159fb6f553870d52024141951fd714c9c1b295a"} Jun 11 13:11:33.548898 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:33.548880 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:33.563710 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:33.563655 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-46945" podStartSLOduration=54.285846679 podStartE2EDuration="1m0.563609313s" totalImagesPullingTime="6.277762634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:33.563455531 +0000 UTC m=+63.709085597" watchObservedRunningTime="2026-06-11 13:11:33.563609313 +0000 UTC m=+63.709239365" Jun 11 13:11:34.036996 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:34.036962 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-46945" Jun 11 13:11:35.971316 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:35.971274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:11:35.973695 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:35.973676 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 13:11:35.986456 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:35.986406 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b-original-pull-secret\") pod \"global-pull-secret-syncer-vtjvx\" (UID: \"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b\") " pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:11:36.071796 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:36.071759 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs\") pod \"network-metrics-daemon-dxrv4\" (UID: \"a521071a-24e5-4c21-9121-d72a6e4fcdb8\") " pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:11:36.073928 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:36.073908 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 13:11:36.084696 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:36.084671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a521071a-24e5-4c21-9121-d72a6e4fcdb8-metrics-certs\") pod \"network-metrics-daemon-dxrv4\" (UID: \"a521071a-24e5-4c21-9121-d72a6e4fcdb8\") " pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:11:36.172631 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:36.172590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txkc\" (UniqueName: \"kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc\") pod \"network-check-target-6jbm2\" (UID: \"68893489-b0ff-4a91-afc4-f2465ed780c8\") " pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:11:36.175045 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:36.175023 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8txkc\" (UniqueName: \"kubernetes.io/projected/68893489-b0ff-4a91-afc4-f2465ed780c8-kube-api-access-8txkc\") pod \"network-check-target-6jbm2\" (UID: \"68893489-b0ff-4a91-afc4-f2465ed780c8\") " pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:11:36.196153 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:36.196129 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lb4sh\"" Jun 11 13:11:36.204841 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:36.204822 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:11:36.206075 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:36.206055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtjvx" Jun 11 13:11:36.216742 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:36.216715 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2fc6r\"" Jun 11 13:11:36.225722 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:36.225660 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxrv4" Jun 11 13:11:36.372427 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:36.372338 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dxrv4"] Jun 11 13:11:36.374731 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:11:36.374710 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda521071a_24e5_4c21_9121_d72a6e4fcdb8.slice/crio-582dc2d45a4c4c9bf26f23404fb0527ed0494619ee5a0d9ef66f967d7add8590 WatchSource:0}: Error finding container 582dc2d45a4c4c9bf26f23404fb0527ed0494619ee5a0d9ef66f967d7add8590: Status 404 returned error can't find the container with id 582dc2d45a4c4c9bf26f23404fb0527ed0494619ee5a0d9ef66f967d7add8590 Jun 11 13:11:36.551375 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:36.551326 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6jbm2"] Jun 11 13:11:36.552916 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:36.552891 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vtjvx"] Jun 11 13:11:36.554346 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:11:36.554317 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68893489_b0ff_4a91_afc4_f2465ed780c8.slice/crio-fbc4198e9a42fc6725e25848d838d8de67c36786806434b736361ba0d2a0c08b WatchSource:0}: Error finding container fbc4198e9a42fc6725e25848d838d8de67c36786806434b736361ba0d2a0c08b: Status 404 returned error can't find the container with id fbc4198e9a42fc6725e25848d838d8de67c36786806434b736361ba0d2a0c08b Jun 11 13:11:36.555662 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:11:36.555639 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a8a2a9_d3a7_4b18_bb2c_871c7f2edd4b.slice/crio-31218ab3a1a0b4265f8569538cf6d8e926f184f5004717d03ff686e50c7b9b41 WatchSource:0}: Error finding container 31218ab3a1a0b4265f8569538cf6d8e926f184f5004717d03ff686e50c7b9b41: Status 404 returned error can't find the container with id 31218ab3a1a0b4265f8569538cf6d8e926f184f5004717d03ff686e50c7b9b41 Jun 11 13:11:36.558113 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:36.558090 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dxrv4" event={"ID":"a521071a-24e5-4c21-9121-d72a6e4fcdb8","Type":"ContainerStarted","Data":"582dc2d45a4c4c9bf26f23404fb0527ed0494619ee5a0d9ef66f967d7add8590"} Jun 11 13:11:37.562773 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:37.562735 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6jbm2" event={"ID":"68893489-b0ff-4a91-afc4-f2465ed780c8","Type":"ContainerStarted","Data":"c357241246062b029ddb46c5d030a2f548fb90c09683e48f54a23c988d89989d"} Jun 11 13:11:37.563182 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:37.562794 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6jbm2" event={"ID":"68893489-b0ff-4a91-afc4-f2465ed780c8","Type":"ContainerStarted","Data":"fbc4198e9a42fc6725e25848d838d8de67c36786806434b736361ba0d2a0c08b"} Jun 11 13:11:37.563182 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:37.562820 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:11:37.565282 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:37.565219 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dxrv4" event={"ID":"a521071a-24e5-4c21-9121-d72a6e4fcdb8","Type":"ContainerStarted","Data":"e3872fbc3fd7e1ac9d9acfecb44a13c0a89a7fb991f82d504ec6ffa0c02ca190"} Jun 11 13:11:37.565282 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:37.565270 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dxrv4" event={"ID":"a521071a-24e5-4c21-9121-d72a6e4fcdb8","Type":"ContainerStarted","Data":"03ec4658ffcb26288bbc3decc42ab7db0435472e4fb6e8b08588e6b68de99a87"} Jun 11 13:11:37.566672 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:37.566645 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vtjvx" event={"ID":"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b","Type":"ContainerStarted","Data":"31218ab3a1a0b4265f8569538cf6d8e926f184f5004717d03ff686e50c7b9b41"} Jun 11 13:11:37.576735 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:37.576692 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6jbm2" podStartSLOduration=67.576668557 podStartE2EDuration="1m7.576668557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:37.576138611 +0000 UTC m=+67.721768664" watchObservedRunningTime="2026-06-11 13:11:37.576668557 +0000 UTC m=+67.722298607" Jun 11 13:11:37.591460 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:37.591395 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dxrv4" podStartSLOduration=66.813822296 podStartE2EDuration="1m7.59138147s" totalImagesPullingTime="777.559174ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:37.590730809 +0000 UTC m=+67.736360864" watchObservedRunningTime="2026-06-11 13:11:37.59138147 +0000 UTC m=+67.737011524" Jun 11 13:11:41.623081 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.623045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:41.625443 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.625400 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls\") pod \"image-registry-6b5556cc69-vrvnb\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:41.723894 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.723857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:41.724095 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.723904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:41.724095 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.723985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-ll78t\" (UID: \"e3020589-3d6c-4245-ad43-e3d40bf8794c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" Jun 11 13:11:41.724095 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.724047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:41.724263 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.724247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nwnl8\" (UID: \"a896c6ec-422d-48f6-99d3-7931494ea0ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" Jun 11 13:11:41.724315 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.724300 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:41.725009 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.724987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91f7339-49e2-44d8-ae6c-240977329067-service-ca-bundle\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:41.726472 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.726443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91f7339-49e2-44d8-ae6c-240977329067-metrics-certs\") pod \"router-default-6c9684f6b5-5zf4s\" (UID: \"d91f7339-49e2-44d8-ae6c-240977329067\") " pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:41.726839 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.726818 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2169af99-8f87-450c-8aff-772ef0a5e25f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-v6m5j\" (UID: \"2169af99-8f87-450c-8aff-772ef0a5e25f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:41.726922 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.726834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3020589-3d6c-4245-ad43-e3d40bf8794c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-ll78t\" (UID: \"e3020589-3d6c-4245-ad43-e3d40bf8794c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" Jun 11 13:11:41.726922 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.726820 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c570fbf0-ca38-4662-975f-7600c15a6844-metrics-tls\") pod \"dns-default-hp96k\" (UID: \"c570fbf0-ca38-4662-975f-7600c15a6844\") " pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:41.727011 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.726985 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a896c6ec-422d-48f6-99d3-7931494ea0ef-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nwnl8\" (UID: \"a896c6ec-422d-48f6-99d3-7931494ea0ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" Jun 11 13:11:41.833653 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.833622 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9w7l7\"" Jun 11 13:11:41.841554 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.841529 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:41.848292 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.848272 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5fnxd\"" Jun 11 13:11:41.856277 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.856199 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" Jun 11 13:11:41.857994 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.857966 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2f66j\"" Jun 11 13:11:41.866609 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.866591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" Jun 11 13:11:41.888061 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.888022 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tmtg5\"" Jun 11 13:11:41.896178 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.895964 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:41.899080 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.898643 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zkjk5\"" Jun 11 13:11:41.906886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.906638 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" Jun 11 13:11:41.920549 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.920475 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s9zw4\"" Jun 11 13:11:41.928196 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:41.928003 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:42.014023 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.013774 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b5556cc69-vrvnb"] Jun 11 13:11:42.041301 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.041211 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j"] Jun 11 13:11:42.072314 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.072220 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8"] Jun 11 13:11:42.101948 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.101919 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c9684f6b5-5zf4s"] Jun 11 13:11:42.105508 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:11:42.105482 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91f7339_49e2_44d8_ae6c_240977329067.slice/crio-db2cbb8199dbd98d408b198719e9f42075a610f2f2af57e22a9719c586c6dc5a WatchSource:0}: Error finding container db2cbb8199dbd98d408b198719e9f42075a610f2f2af57e22a9719c586c6dc5a: Status 404 returned error can't find the container with id db2cbb8199dbd98d408b198719e9f42075a610f2f2af57e22a9719c586c6dc5a Jun 11 13:11:42.117872 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.117849 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t"] Jun 11 13:11:42.122024 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:11:42.121996 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3020589_3d6c_4245_ad43_e3d40bf8794c.slice/crio-fa237e9cddc554fe9e4b73654128c0bb188f04503505e4a08ec2e2ea3f83fab3 WatchSource:0}: Error finding container fa237e9cddc554fe9e4b73654128c0bb188f04503505e4a08ec2e2ea3f83fab3: Status 404 returned error can't find the container with id fa237e9cddc554fe9e4b73654128c0bb188f04503505e4a08ec2e2ea3f83fab3 Jun 11 13:11:42.140990 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.140937 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hp96k"] Jun 11 13:11:42.591009 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.590968 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" event={"ID":"d91f7339-49e2-44d8-ae6c-240977329067","Type":"ContainerStarted","Data":"49b361af7900bc79dd0aac1ba1f9f1dcec585074a29a9c82344f38db57c0b00d"} Jun 11 13:11:42.591212 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.591074 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" event={"ID":"d91f7339-49e2-44d8-ae6c-240977329067","Type":"ContainerStarted","Data":"db2cbb8199dbd98d408b198719e9f42075a610f2f2af57e22a9719c586c6dc5a"} Jun 11 13:11:42.592792 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.592759 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" event={"ID":"a896c6ec-422d-48f6-99d3-7931494ea0ef","Type":"ContainerStarted","Data":"affca40c7d656bf64b95c8614e5395958c67e95a9b32b90ff743f3d6de67fed9"} Jun 11 13:11:42.594025 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.593999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" event={"ID":"2169af99-8f87-450c-8aff-772ef0a5e25f","Type":"ContainerStarted","Data":"6ee99be630e43bb5357e5c5492e647a6b1fcd0a7c4a7f3078f40fc0529845640"} Jun 11 13:11:42.595963 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.595909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" event={"ID":"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba","Type":"ContainerStarted","Data":"d7fba8178808bbd2874571b686da34c626340d20b6cf050dadb911fe9e1aae11"} Jun 11 13:11:42.595963 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.595949 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" event={"ID":"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba","Type":"ContainerStarted","Data":"b904074bb0828abb6fde6f8f40b16b9d16db8747efbb62fba9ce6c1a55785445"} Jun 11 13:11:42.596131 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.595976 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:11:42.597169 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.597142 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hp96k" event={"ID":"c570fbf0-ca38-4662-975f-7600c15a6844","Type":"ContainerStarted","Data":"996e31ca41c3d2d5fdfbb005a03d2f109eb9ac4678b00faf3c7956436af9fd98"} Jun 11 13:11:42.598491 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.598465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" event={"ID":"e3020589-3d6c-4245-ad43-e3d40bf8794c","Type":"ContainerStarted","Data":"fa237e9cddc554fe9e4b73654128c0bb188f04503505e4a08ec2e2ea3f83fab3"} Jun 11 13:11:42.609527 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.609341 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" podStartSLOduration=69.609324768 podStartE2EDuration="1m9.609324768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:42.608671189 +0000 UTC m=+72.754301241" watchObservedRunningTime="2026-06-11 13:11:42.609324768 +0000 UTC m=+72.754954821" Jun 11 13:11:42.625718 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.625140 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" podStartSLOduration=72.625124046 podStartE2EDuration="1m12.625124046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:42.624496273 +0000 UTC m=+72.770126329" watchObservedRunningTime="2026-06-11 13:11:42.625124046 +0000 UTC m=+72.770754101" Jun 11 13:11:42.898744 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.897240 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:42.900919 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.900709 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:42.942182 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.942145 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj"] Jun 11 13:11:42.945520 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.944904 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:42.953349 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.953313 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 13:11:42.955452 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.954823 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 13:11:42.955452 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.955060 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 13:11:42.955452 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.955263 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 13:11:42.957394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.953539 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 13:11:42.957394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.956446 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 13:11:42.961127 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.960929 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 13:11:42.961840 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:42.961768 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj"] Jun 11 13:11:43.036117 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.035814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.036117 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.035869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm99q\" (UniqueName: \"kubernetes.io/projected/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-kube-api-access-qm99q\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.036117 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.035904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-hub\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.036117 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.035931 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.036117 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.035962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.036117 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.035996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-ca\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.051457 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.051428 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g86xr"] Jun 11 13:11:43.054062 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.054040 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.056740 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.056691 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 13:11:43.058087 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.057755 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 13:11:43.059469 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.059128 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w9bx2\"" Jun 11 13:11:43.060589 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.060526 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g86xr"] Jun 11 13:11:43.136945 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.136908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-ca\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.137112 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.136965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90b76fba-bbce-41cc-a172-96256e7a30b2-crio-socket\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.137112 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.137005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90b76fba-bbce-41cc-a172-96256e7a30b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.137112 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.137052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90b76fba-bbce-41cc-a172-96256e7a30b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.137112 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.137084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpm84\" (UniqueName: \"kubernetes.io/projected/90b76fba-bbce-41cc-a172-96256e7a30b2-kube-api-access-cpm84\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.137340 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.137316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.137918 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.137892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm99q\" (UniqueName: \"kubernetes.io/projected/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-kube-api-access-qm99q\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.138027 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.137938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-hub\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.138027 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.137962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.138027 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.137990 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.138027 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.138013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90b76fba-bbce-41cc-a172-96256e7a30b2-data-volume\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.139827 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.139803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.143007 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.142983 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-hub\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.143571 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.143550 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.145745 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.145699 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.149558 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.149483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-ca\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.158022 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.157976 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm99q\" (UniqueName: \"kubernetes.io/projected/f0b73d54-9a8e-43e7-ba7c-836b5e1bd711-kube-api-access-qm99q\") pod \"cluster-proxy-proxy-agent-5876b5879-577xj\" (UID: \"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.240192 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.238767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90b76fba-bbce-41cc-a172-96256e7a30b2-data-volume\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.240192 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.238827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90b76fba-bbce-41cc-a172-96256e7a30b2-crio-socket\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.240192 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.238866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90b76fba-bbce-41cc-a172-96256e7a30b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.240192 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.238912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90b76fba-bbce-41cc-a172-96256e7a30b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.240192 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.238945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpm84\" (UniqueName: \"kubernetes.io/projected/90b76fba-bbce-41cc-a172-96256e7a30b2-kube-api-access-cpm84\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.240192 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.239745 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90b76fba-bbce-41cc-a172-96256e7a30b2-data-volume\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.240771 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.240269 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90b76fba-bbce-41cc-a172-96256e7a30b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.240771 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.240348 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90b76fba-bbce-41cc-a172-96256e7a30b2-crio-socket\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.243712 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.243664 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90b76fba-bbce-41cc-a172-96256e7a30b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.252793 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.252728 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpm84\" (UniqueName: \"kubernetes.io/projected/90b76fba-bbce-41cc-a172-96256e7a30b2-kube-api-access-cpm84\") pod \"insights-runtime-extractor-g86xr\" (UID: \"90b76fba-bbce-41cc-a172-96256e7a30b2\") " pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.274906 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.274760 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" Jun 11 13:11:43.375831 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.375793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g86xr" Jun 11 13:11:43.604579 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.604489 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:43.606119 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:43.606094 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6c9684f6b5-5zf4s" Jun 11 13:11:46.350660 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.349778 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g86xr"] Jun 11 13:11:46.394586 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.394513 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj"] Jun 11 13:11:46.416664 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:11:46.416630 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0b73d54_9a8e_43e7_ba7c_836b5e1bd711.slice/crio-49007c8e38e402d51a6dba3b01a9786e0c5f9d0cc6a97445bbcc974b83b976f0 WatchSource:0}: Error finding container 49007c8e38e402d51a6dba3b01a9786e0c5f9d0cc6a97445bbcc974b83b976f0: Status 404 returned error can't find the container with id 49007c8e38e402d51a6dba3b01a9786e0c5f9d0cc6a97445bbcc974b83b976f0 Jun 11 13:11:46.618157 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.618125 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hp96k" event={"ID":"c570fbf0-ca38-4662-975f-7600c15a6844","Type":"ContainerStarted","Data":"5757a187ee42f2273d2f3cce3de816c83daafba8137f8a74e328b5d25bfbe99e"} Jun 11 13:11:46.618354 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.618175 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hp96k" event={"ID":"c570fbf0-ca38-4662-975f-7600c15a6844","Type":"ContainerStarted","Data":"ef442ac61b3454d86a6c5a190ea2a0de987336a05b3efaa902036fe6e4512af5"} Jun 11 13:11:46.618354 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.618251 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hp96k" Jun 11 13:11:46.619797 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.619773 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" event={"ID":"e3020589-3d6c-4245-ad43-e3d40bf8794c","Type":"ContainerStarted","Data":"8c92db2d7e0db7ef4d84e2d9b9fe487631091651ecdde44bc624db652a5d4e7b"} Jun 11 13:11:46.621583 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.621554 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" event={"ID":"a896c6ec-422d-48f6-99d3-7931494ea0ef","Type":"ContainerStarted","Data":"4b77bf4d6280075dc47446bd9263f9303ec0fe6607d568170bd68609769b1673"} Jun 11 13:11:46.621660 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.621600 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" event={"ID":"a896c6ec-422d-48f6-99d3-7931494ea0ef","Type":"ContainerStarted","Data":"e3faf12af97042817ff51f8fc62de93eb7cbb65900d0957df5234143b00ad48c"} Jun 11 13:11:46.623040 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.623019 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g86xr" event={"ID":"90b76fba-bbce-41cc-a172-96256e7a30b2","Type":"ContainerStarted","Data":"dd3a8e9135045d8c071d32218b7a7d29f292f243da0a2c6703661be510f66bcf"} Jun 11 13:11:46.623141 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.623068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g86xr" event={"ID":"90b76fba-bbce-41cc-a172-96256e7a30b2","Type":"ContainerStarted","Data":"755ec3f978a96232da44ec554a1721d9c6ce6f8bcd61e84219af578747b2133a"} Jun 11 13:11:46.624219 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.624197 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" event={"ID":"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711","Type":"ContainerStarted","Data":"49007c8e38e402d51a6dba3b01a9786e0c5f9d0cc6a97445bbcc974b83b976f0"} Jun 11 13:11:46.625643 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.625625 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vtjvx" event={"ID":"b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b","Type":"ContainerStarted","Data":"5dee727a8ec6925b00e81e945422f335f4def2ca43960f0075183c9f0edbfb9e"} Jun 11 13:11:46.627038 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.627020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" event={"ID":"2169af99-8f87-450c-8aff-772ef0a5e25f","Type":"ContainerStarted","Data":"7e85d1604a3f78d3f486493c30c289bb9b42f3da99c41e249ee3e828e06426cd"} Jun 11 13:11:46.639597 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.638285 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hp96k" podStartSLOduration=33.637318564 podStartE2EDuration="37.638267888s" totalImagesPullingTime="4.000949324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:46.63797495 +0000 UTC m=+76.783605007" watchObservedRunningTime="2026-06-11 13:11:46.638267888 +0000 UTC m=+76.783897942" Jun 11 13:11:46.656172 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.656133 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-v6m5j" podStartSLOduration=69.562579897 podStartE2EDuration="1m13.656118829s" totalImagesPullingTime="4.093538932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:46.65531756 +0000 UTC m=+76.800947614" watchObservedRunningTime="2026-06-11 13:11:46.656118829 +0000 UTC m=+76.801748881" Jun 11 13:11:46.670520 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.670482 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-ll78t" podStartSLOduration=69.648185255 podStartE2EDuration="1m13.670469766s" totalImagesPullingTime="4.022284511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:46.669460638 +0000 UTC m=+76.815090689" watchObservedRunningTime="2026-06-11 13:11:46.670469766 +0000 UTC m=+76.816099819" Jun 11 13:11:46.683869 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.683827 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vtjvx" podStartSLOduration=67.098138882 podStartE2EDuration="1m16.683813531s" totalImagesPullingTime="9.585674649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:46.682792193 +0000 UTC m=+76.828422247" watchObservedRunningTime="2026-06-11 13:11:46.683813531 +0000 UTC m=+76.829443584" Jun 11 13:11:46.699258 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:46.699218 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nwnl8" podStartSLOduration=69.667454726 podStartE2EDuration="1m13.699204901s" totalImagesPullingTime="4.031750175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:46.697566186 +0000 UTC m=+76.843196240" watchObservedRunningTime="2026-06-11 13:11:46.699204901 +0000 UTC m=+76.844834983" Jun 11 13:11:47.634907 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:47.634871 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g86xr" event={"ID":"90b76fba-bbce-41cc-a172-96256e7a30b2","Type":"ContainerStarted","Data":"5ae4f8fc920c20fec1fbee294aad7fbd026027b453602328cbb8d208901e5f36"} Jun 11 13:11:51.652248 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:51.652186 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g86xr" event={"ID":"90b76fba-bbce-41cc-a172-96256e7a30b2","Type":"ContainerStarted","Data":"327c6a61ad5edcaf76a0e1f01d2204dc76b4358684bfc641f1f970c35b9400e9"} Jun 11 13:11:51.653994 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:51.653970 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" event={"ID":"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711","Type":"ContainerStarted","Data":"6d67f3cf7856b4642d176f08c8dac129710599b5d51b3542283a742df643d176"} Jun 11 13:11:51.654154 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:51.654137 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" event={"ID":"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711","Type":"ContainerStarted","Data":"87739c66d72c18ca9a4b274c88d336801fdaedc02d72256dfa70c65d82368c66"} Jun 11 13:11:51.677152 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:51.677107 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g86xr" podStartSLOduration=3.875420022 podStartE2EDuration="8.677093986s" totalImagesPullingTime="4.801673964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:11:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:51.675788337 +0000 UTC m=+81.821418390" watchObservedRunningTime="2026-06-11 13:11:51.677093986 +0000 UTC m=+81.822724017" Jun 11 13:11:52.660112 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:52.660073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" event={"ID":"f0b73d54-9a8e-43e7-ba7c-836b5e1bd711","Type":"ContainerStarted","Data":"43909e046779753b237bde77077f510e8217f52cf2b5571039d223fb289d867f"} Jun 11 13:11:52.676975 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:52.676930 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5876b5879-577xj" podStartSLOduration=5.673070891 podStartE2EDuration="10.676915815s" totalImagesPullingTime="5.003844924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:52.675874062 +0000 UTC m=+82.821504113" watchObservedRunningTime="2026-06-11 13:11:52.676915815 +0000 UTC m=+82.822545869" Jun 11 13:11:56.637632 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:11:56.637591 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hp96k" Jun 11 13:12:01.846500 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:01.846464 2576 patch_prober.go:28] interesting pod/image-registry-6b5556cc69-vrvnb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 13:12:01.846855 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:01.846526 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" podUID="9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 13:12:03.607242 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:03.607217 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:12:05.601014 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:05.600974 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b5556cc69-vrvnb"] Jun 11 13:12:08.573134 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:08.573103 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6jbm2" Jun 11 13:12:12.220129 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.220094 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf"] Jun 11 13:12:12.225679 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.225657 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.228815 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.228786 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 13:12:12.228815 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.228807 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 13:12:12.229010 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.228830 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 13:12:12.229010 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.228799 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wzpwc\"" Jun 11 13:12:12.229010 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.229003 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 13:12:12.233657 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.233634 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6njpb"] Jun 11 13:12:12.237621 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.237601 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.239737 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.239716 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 13:12:12.239840 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.239742 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 13:12:12.239840 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.239774 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 13:12:12.239953 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.239932 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-97grj\"" Jun 11 13:12:12.243428 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.243394 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf"] Jun 11 13:12:12.272609 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.272577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.272777 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.272627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qg8j\" (UniqueName: \"kubernetes.io/projected/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-api-access-2qg8j\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.272777 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.272676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-textfile\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.272777 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.272709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f37909ca-785e-4f2a-bb65-e90d572687a0-sys\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.272777 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.272755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b7a438e-bc51-4208-84d5-487f2b5e06e2-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.273001 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.272807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.273001 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.272845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.273001 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.272911 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f37909ca-785e-4f2a-bb65-e90d572687a0-root\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.273001 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.272939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.273001 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.272966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-wtmp\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.273195 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.273058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b7a438e-bc51-4208-84d5-487f2b5e06e2-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.273195 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.273103 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.273195 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.273132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrqfb\" (UniqueName: \"kubernetes.io/projected/f37909ca-785e-4f2a-bb65-e90d572687a0-kube-api-access-xrqfb\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.273195 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.273170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-tls\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.273332 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.273197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f37909ca-785e-4f2a-bb65-e90d572687a0-metrics-client-ca\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.374451 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.374398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b7a438e-bc51-4208-84d5-487f2b5e06e2-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.374451 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.374452 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.374692 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.374474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrqfb\" (UniqueName: \"kubernetes.io/projected/f37909ca-785e-4f2a-bb65-e90d572687a0-kube-api-access-xrqfb\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.374692 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.374497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-tls\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.374692 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.374517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f37909ca-785e-4f2a-bb65-e90d572687a0-metrics-client-ca\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.374692 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.374539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.374692 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.374572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qg8j\" (UniqueName: \"kubernetes.io/projected/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-api-access-2qg8j\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.374692 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.374598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-textfile\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.374692 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:12:12.374639 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 13:12:12.374692 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:12:12.374650 2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 13:12:12.375159 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:12:12.374706 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-tls podName:f37909ca-785e-4f2a-bb65-e90d572687a0 nodeName:}" failed. No retries permitted until 2026-06-11 13:12:12.874682401 +0000 UTC m=+103.020312432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-tls") pod "node-exporter-6njpb" (UID: "f37909ca-785e-4f2a-bb65-e90d572687a0") : secret "node-exporter-tls" not found Jun 11 13:12:12.375159 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:12:12.374726 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-state-metrics-tls podName:5b7a438e-bc51-4208-84d5-487f2b5e06e2 nodeName:}" failed. No retries permitted until 2026-06-11 13:12:12.874715852 +0000 UTC m=+103.020345886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-twdbf" (UID: "5b7a438e-bc51-4208-84d5-487f2b5e06e2") : secret "kube-state-metrics-tls" not found Jun 11 13:12:12.375159 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.374816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f37909ca-785e-4f2a-bb65-e90d572687a0-sys\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.375159 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.374887 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b7a438e-bc51-4208-84d5-487f2b5e06e2-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.375159 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.375038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.375159 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.375078 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.375159 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.374925 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-textfile\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.375159 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.375142 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f37909ca-785e-4f2a-bb65-e90d572687a0-metrics-client-ca\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.375555 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.374951 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f37909ca-785e-4f2a-bb65-e90d572687a0-sys\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.375555 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.375184 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f37909ca-785e-4f2a-bb65-e90d572687a0-root\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.375555 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.375145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f37909ca-785e-4f2a-bb65-e90d572687a0-root\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.375555 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.375195 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b7a438e-bc51-4208-84d5-487f2b5e06e2-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.375555 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.375217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.375555 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.375247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-wtmp\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.375555 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.375284 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b7a438e-bc51-4208-84d5-487f2b5e06e2-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.375555 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.375307 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.375555 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.375474 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-wtmp\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.375814 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.375559 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.377522 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.377506 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.377684 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.377669 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.382912 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.382882 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrqfb\" (UniqueName: \"kubernetes.io/projected/f37909ca-785e-4f2a-bb65-e90d572687a0-kube-api-access-xrqfb\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.383731 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.383707 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qg8j\" (UniqueName: \"kubernetes.io/projected/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-api-access-2qg8j\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.879384 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.879345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:12.879597 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.879394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-tls\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.881815 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.881784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f37909ca-785e-4f2a-bb65-e90d572687a0-node-exporter-tls\") pod \"node-exporter-6njpb\" (UID: \"f37909ca-785e-4f2a-bb65-e90d572687a0\") " pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:12.881921 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:12.881870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b7a438e-bc51-4208-84d5-487f2b5e06e2-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-twdbf\" (UID: \"5b7a438e-bc51-4208-84d5-487f2b5e06e2\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:13.136143 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:13.136055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" Jun 11 13:12:13.146814 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:13.146788 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6njpb" Jun 11 13:12:13.157491 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:12:13.157458 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37909ca_785e_4f2a_bb65_e90d572687a0.slice/crio-aaa67eb9f354d22555cf65196b57895a5916b00d88810f220978785172198d99 WatchSource:0}: Error finding container aaa67eb9f354d22555cf65196b57895a5916b00d88810f220978785172198d99: Status 404 returned error can't find the container with id aaa67eb9f354d22555cf65196b57895a5916b00d88810f220978785172198d99 Jun 11 13:12:13.295066 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:13.294961 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf"] Jun 11 13:12:13.297974 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:12:13.297939 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7a438e_bc51_4208_84d5_487f2b5e06e2.slice/crio-e5399af247d11eda374ebb3a0ed333ad844160d4dc1cf7e7558f8773b3e9b175 WatchSource:0}: Error finding container e5399af247d11eda374ebb3a0ed333ad844160d4dc1cf7e7558f8773b3e9b175: Status 404 returned error can't find the container with id e5399af247d11eda374ebb3a0ed333ad844160d4dc1cf7e7558f8773b3e9b175 Jun 11 13:12:13.740333 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:13.740286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6njpb" event={"ID":"f37909ca-785e-4f2a-bb65-e90d572687a0","Type":"ContainerStarted","Data":"aaa67eb9f354d22555cf65196b57895a5916b00d88810f220978785172198d99"} Jun 11 13:12:13.741817 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:13.741784 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" event={"ID":"5b7a438e-bc51-4208-84d5-487f2b5e06e2","Type":"ContainerStarted","Data":"e5399af247d11eda374ebb3a0ed333ad844160d4dc1cf7e7558f8773b3e9b175"} Jun 11 13:12:14.747842 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:14.747740 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6njpb" event={"ID":"f37909ca-785e-4f2a-bb65-e90d572687a0","Type":"ContainerStarted","Data":"74a6fdc7a32ed450388726121d08172b0cae22b53d6487d67be4fafeb5592469"} Jun 11 13:12:15.753762 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:15.753725 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" event={"ID":"5b7a438e-bc51-4208-84d5-487f2b5e06e2","Type":"ContainerStarted","Data":"bdf52c69440f73276793f8f3c28f28cbf02eb9ac9de2141d4c9368f71ce92ae9"} Jun 11 13:12:15.754211 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:15.753829 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" event={"ID":"5b7a438e-bc51-4208-84d5-487f2b5e06e2","Type":"ContainerStarted","Data":"87d72e35bd2c6ef206563e509b78fa868e77323a2352d7001fadafaad1cf7005"} Jun 11 13:12:15.754211 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:15.753861 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" event={"ID":"5b7a438e-bc51-4208-84d5-487f2b5e06e2","Type":"ContainerStarted","Data":"7ce7da042f613966664db4fc9490f0dbded5a4b16dbcf1b8d99b4dcde15f45b2"} Jun 11 13:12:15.755284 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:15.755256 2576 generic.go:356] "Generic (PLEG): container finished" podID="f37909ca-785e-4f2a-bb65-e90d572687a0" containerID="74a6fdc7a32ed450388726121d08172b0cae22b53d6487d67be4fafeb5592469" exitCode=0 Jun 11 13:12:15.755399 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:15.755295 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6njpb" event={"ID":"f37909ca-785e-4f2a-bb65-e90d572687a0","Type":"ContainerDied","Data":"74a6fdc7a32ed450388726121d08172b0cae22b53d6487d67be4fafeb5592469"} Jun 11 13:12:15.774054 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:15.774005 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-twdbf" podStartSLOduration=2.264799323 podStartE2EDuration="3.773988793s" totalImagesPullingTime="1.50918947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:12:15.772161403 +0000 UTC m=+105.917791455" watchObservedRunningTime="2026-06-11 13:12:15.773988793 +0000 UTC m=+105.919618873" Jun 11 13:12:16.761491 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:16.761450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6njpb" event={"ID":"f37909ca-785e-4f2a-bb65-e90d572687a0","Type":"ContainerStarted","Data":"af42623f008ce315ba99c4012fafbc0cfa3cbb6f70fbe5dfd2a558c45b4cd692"} Jun 11 13:12:16.761911 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:16.761505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6njpb" event={"ID":"f37909ca-785e-4f2a-bb65-e90d572687a0","Type":"ContainerStarted","Data":"7d2041f49869d73491fff1a613b05b95cc6a88c58b522d4996d53ea56d5ccd8c"} Jun 11 13:12:16.781501 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:16.781446 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6njpb" podStartSLOduration=3.603335521 podStartE2EDuration="4.781429399s" totalImagesPullingTime="1.101675509s" totalInitContainerRuntime="76.418369ms" isStatefulPod=true podCreationTimestamp="2026-06-11 13:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:12:16.779192416 +0000 UTC m=+106.924822470" watchObservedRunningTime="2026-06-11 13:12:16.781429399 +0000 UTC m=+106.927059449" Jun 11 13:12:18.418977 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.418942 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:12:18.422665 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.422642 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.424924 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.424904 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 13:12:18.425043 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.424910 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qn6qq\"" Jun 11 13:12:18.425141 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.425115 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a0l1hf4fc8ct4\"" Jun 11 13:12:18.425212 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.425199 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 13:12:18.425938 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.425902 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 13:12:18.425938 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.425921 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 13:12:18.426123 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.426003 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 13:12:18.426123 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.426006 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 13:12:18.426226 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.426135 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 13:12:18.426302 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.426281 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 13:12:18.426363 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.426326 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 13:12:18.426363 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.426345 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 13:12:18.426485 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.426389 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 13:12:18.426485 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.426433 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 13:12:18.426485 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.426345 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 13:12:18.426822 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.426806 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 13:12:18.427493 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.427474 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 13:12:18.441732 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.441704 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:12:18.531871 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.531833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.531871 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.531873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-config\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532260 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.531896 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532260 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.531950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532260 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.531971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532260 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/feca4095-83f3-473c-bf59-6e9f09544a0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532260 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532260 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532137 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532260 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv8sb\" (UniqueName: \"kubernetes.io/projected/feca4095-83f3-473c-bf59-6e9f09544a0e-kube-api-access-kv8sb\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532260 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532400 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/feca4095-83f3-473c-bf59-6e9f09544a0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532673 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532908 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.532908 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.532746 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633132 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633132 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633361 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633361 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633361 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633361 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633361 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633297 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633361 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633688 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633462 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-config\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633688 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633688 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633688 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633582 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633688 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/feca4095-83f3-473c-bf59-6e9f09544a0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633688 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633644 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.633688 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633675 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.634010 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv8sb\" (UniqueName: \"kubernetes.io/projected/feca4095-83f3-473c-bf59-6e9f09544a0e-kube-api-access-kv8sb\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.634010 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.634010 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633771 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.634010 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/feca4095-83f3-473c-bf59-6e9f09544a0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.634010 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.633830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.634248 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.634005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.634248 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.634031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.634248 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.634045 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.634746 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.634655 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.634939 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.634916 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.635049 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.635024 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.636911 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.636882 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.637143 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.637087 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.637307 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.637285 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-config\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.637667 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.637643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.637667 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.637655 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.637816 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.637803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.638324 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.638294 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/feca4095-83f3-473c-bf59-6e9f09544a0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.639167 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.639129 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.639475 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.639456 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.639610 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.639595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/feca4095-83f3-473c-bf59-6e9f09544a0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.639656 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.639595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/feca4095-83f3-473c-bf59-6e9f09544a0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.639656 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.639645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.640001 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.639975 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/feca4095-83f3-473c-bf59-6e9f09544a0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.641263 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.641241 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv8sb\" (UniqueName: \"kubernetes.io/projected/feca4095-83f3-473c-bf59-6e9f09544a0e-kube-api-access-kv8sb\") pod \"prometheus-k8s-0\" (UID: \"feca4095-83f3-473c-bf59-6e9f09544a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.732189 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.732097 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:18.902227 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:12:18.902200 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeca4095_83f3_473c_bf59_6e9f09544a0e.slice/crio-7422136ad556041d959b0eee9999caba905943c378392ee3869169bc5e53c74f WatchSource:0}: Error finding container 7422136ad556041d959b0eee9999caba905943c378392ee3869169bc5e53c74f: Status 404 returned error can't find the container with id 7422136ad556041d959b0eee9999caba905943c378392ee3869169bc5e53c74f Jun 11 13:12:18.909315 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:18.909285 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:12:19.774882 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:19.774851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feca4095-83f3-473c-bf59-6e9f09544a0e","Type":"ContainerStarted","Data":"7422136ad556041d959b0eee9999caba905943c378392ee3869169bc5e53c74f"} Jun 11 13:12:20.780749 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:20.780717 2576 generic.go:356] "Generic (PLEG): container finished" podID="feca4095-83f3-473c-bf59-6e9f09544a0e" containerID="77d3e37b34df1bd3c94f3d1d356bd2d3ab9fc5a6d8a2c15a8eaffcdbd8a752f8" exitCode=0 Jun 11 13:12:20.781126 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:20.780796 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feca4095-83f3-473c-bf59-6e9f09544a0e","Type":"ContainerDied","Data":"77d3e37b34df1bd3c94f3d1d356bd2d3ab9fc5a6d8a2c15a8eaffcdbd8a752f8"} Jun 11 13:12:24.800530 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:24.800489 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feca4095-83f3-473c-bf59-6e9f09544a0e","Type":"ContainerStarted","Data":"de836e0bc60862101815fa8da33c600c960af0ffa1d8c3e95da56c385c237cc0"} Jun 11 13:12:24.800940 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:24.800601 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feca4095-83f3-473c-bf59-6e9f09544a0e","Type":"ContainerStarted","Data":"c5568c4221f671adb2d322cf6b3746063fb48c1e303b9444f06eaf318f0f65a0"} Jun 11 13:12:26.812557 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:26.812520 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feca4095-83f3-473c-bf59-6e9f09544a0e","Type":"ContainerStarted","Data":"f42bb120ea116086d23cb68b07994a28215f9bd1e69365cf2a04e0b94cc07534"} Jun 11 13:12:26.812936 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:26.812582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feca4095-83f3-473c-bf59-6e9f09544a0e","Type":"ContainerStarted","Data":"38f697e1f0e511d1219d05fc71d204cb60b087003d60eec6e46d315c658b6981"} Jun 11 13:12:26.812936 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:26.812607 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feca4095-83f3-473c-bf59-6e9f09544a0e","Type":"ContainerStarted","Data":"552e22b763a6235828fab36b81cb1bfb7cefb60c1d91573eb3072b42158c65fa"} Jun 11 13:12:26.812936 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:26.812633 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feca4095-83f3-473c-bf59-6e9f09544a0e","Type":"ContainerStarted","Data":"4971c57cbf5170914c161424b576d711fbd19fc9af307824e8513578c9e685f0"} Jun 11 13:12:26.884716 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:26.884655 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.206902416 podStartE2EDuration="8.884630979s" totalImagesPullingTime="6.656365274s" totalInitContainerRuntime="21.363289ms" isStatefulPod=false podCreationTimestamp="2026-06-11 13:12:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:12:26.882775655 +0000 UTC m=+117.028405730" watchObservedRunningTime="2026-06-11 13:12:26.884630979 +0000 UTC m=+117.030261086" Jun 11 13:12:28.732960 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:28.732921 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:12:30.620649 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:30.620550 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" podUID="9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" containerName="registry" containerID="cri-o://d7fba8178808bbd2874571b686da34c626340d20b6cf050dadb911fe9e1aae11" gracePeriod=30 Jun 11 13:12:30.829717 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:30.829684 2576 generic.go:356] "Generic (PLEG): container finished" podID="9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" containerID="d7fba8178808bbd2874571b686da34c626340d20b6cf050dadb911fe9e1aae11" exitCode=0 Jun 11 13:12:30.829886 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:30.829753 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" event={"ID":"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba","Type":"ContainerDied","Data":"d7fba8178808bbd2874571b686da34c626340d20b6cf050dadb911fe9e1aae11"} Jun 11 13:12:30.873055 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:30.872995 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:12:31.047554 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.047517 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx9zk\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-kube-api-access-hx9zk\") pod \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " Jun 11 13:12:31.047754 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.047571 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls\") pod \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " Jun 11 13:12:31.047754 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.047599 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-ca-trust-extracted\") pod \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " Jun 11 13:12:31.047754 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.047655 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-installation-pull-secrets\") pod \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " Jun 11 13:12:31.047754 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.047678 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-bound-sa-token\") pod \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " Jun 11 13:12:31.047754 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.047713 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-certificates\") pod \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " Jun 11 13:12:31.047754 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.047739 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-trusted-ca\") pod \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " Jun 11 13:12:31.048070 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.047763 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-image-registry-private-configuration\") pod \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\" (UID: \"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba\") " Jun 11 13:12:31.048294 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.048228 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" (UID: "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:12:31.048455 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.048290 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" (UID: "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:12:31.050456 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.050380 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" (UID: "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:12:31.050560 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.050459 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" (UID: "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:12:31.050560 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.050509 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" (UID: "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:12:31.050680 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.050575 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-kube-api-access-hx9zk" (OuterVolumeSpecName: "kube-api-access-hx9zk") pod "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" (UID: "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba"). InnerVolumeSpecName "kube-api-access-hx9zk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:12:31.050680 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.050628 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" (UID: "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:12:31.056206 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.056186 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" (UID: "9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:12:31.148818 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.148732 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx9zk\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-kube-api-access-hx9zk\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:12:31.148818 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.148762 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-tls\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:12:31.148818 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.148776 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-ca-trust-extracted\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:12:31.148818 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.148788 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-installation-pull-secrets\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:12:31.148818 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.148800 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-bound-sa-token\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:12:31.148818 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.148812 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-registry-certificates\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:12:31.149099 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.148825 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-trusted-ca\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:12:31.149099 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.148838 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba-image-registry-private-configuration\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:12:31.835280 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.835251 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" Jun 11 13:12:31.835780 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.835251 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b5556cc69-vrvnb" event={"ID":"9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba","Type":"ContainerDied","Data":"b904074bb0828abb6fde6f8f40b16b9d16db8747efbb62fba9ce6c1a55785445"} Jun 11 13:12:31.835780 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.835382 2576 scope.go:117] "RemoveContainer" containerID="d7fba8178808bbd2874571b686da34c626340d20b6cf050dadb911fe9e1aae11" Jun 11 13:12:31.855532 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.855507 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b5556cc69-vrvnb"] Jun 11 13:12:31.858360 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:31.858340 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b5556cc69-vrvnb"] Jun 11 13:12:32.278026 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:32.277993 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" path="/var/lib/kubelet/pods/9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba/volumes" Jun 11 13:12:32.841167 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:32.841132 2576 generic.go:356] "Generic (PLEG): container finished" podID="972b42c4-89a7-4e5f-b203-aaadc81e9103" containerID="56112dd74cd50527ceeecf99c9a6ce07421c99740a31f4ea48fe34756e402084" exitCode=0 Jun 11 13:12:32.841538 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:32.841207 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" event={"ID":"972b42c4-89a7-4e5f-b203-aaadc81e9103","Type":"ContainerDied","Data":"56112dd74cd50527ceeecf99c9a6ce07421c99740a31f4ea48fe34756e402084"} Jun 11 13:12:32.841591 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:32.841559 2576 scope.go:117] "RemoveContainer" containerID="56112dd74cd50527ceeecf99c9a6ce07421c99740a31f4ea48fe34756e402084" Jun 11 13:12:33.849031 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:33.848988 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-s5z66" event={"ID":"972b42c4-89a7-4e5f-b203-aaadc81e9103","Type":"ContainerStarted","Data":"bc363f8c414ecc53f9cf0fb51719f7884dda2c602c5db7ad25b3481ec2f849a3"} Jun 11 13:12:37.869133 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:37.869045 2576 generic.go:356] "Generic (PLEG): container finished" podID="19b7d659-a74d-4032-b931-a6998e537317" containerID="8770c6100fb6820b06df1961f36b734f10aad24e0a7064a0fc974705cf1ee1e1" exitCode=0 Jun 11 13:12:37.869505 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:37.869122 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" event={"ID":"19b7d659-a74d-4032-b931-a6998e537317","Type":"ContainerDied","Data":"8770c6100fb6820b06df1961f36b734f10aad24e0a7064a0fc974705cf1ee1e1"} Jun 11 13:12:37.869505 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:37.869464 2576 scope.go:117] "RemoveContainer" containerID="8770c6100fb6820b06df1961f36b734f10aad24e0a7064a0fc974705cf1ee1e1" Jun 11 13:12:38.875921 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:38.875885 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q5lq4" event={"ID":"19b7d659-a74d-4032-b931-a6998e537317","Type":"ContainerStarted","Data":"67a5e2943febe4f87d03cd15a979510a29dd332d237d5aee2f73388f0dbc9139"} Jun 11 13:12:52.931078 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:52.931045 2576 generic.go:356] "Generic (PLEG): container finished" podID="5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4" containerID="1bcfb32405e9a812f0738804cf74bd80a155f156a2fbb6d04d407c0882470a34" exitCode=0 Jun 11 13:12:52.931513 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:52.931121 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-gbbdl" event={"ID":"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4","Type":"ContainerDied","Data":"1bcfb32405e9a812f0738804cf74bd80a155f156a2fbb6d04d407c0882470a34"} Jun 11 13:12:52.931513 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:52.931480 2576 scope.go:117] "RemoveContainer" containerID="1bcfb32405e9a812f0738804cf74bd80a155f156a2fbb6d04d407c0882470a34" Jun 11 13:12:53.937010 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:12:53.936982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-gbbdl" event={"ID":"5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4","Type":"ContainerStarted","Data":"7d1e8c1403ebe60339353fdd74a2e59cc023ed444733f9ab948c69faa1154dc0"} Jun 11 13:13:18.733257 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:13:18.733203 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:13:18.748917 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:13:18.748891 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:13:19.054280 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:13:19.054207 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:15:30.220695 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:15:30.220664 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:15:30.221228 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:15:30.221022 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:15:30.231596 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:15:30.231576 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 13:16:15.174908 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.174870 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx"] Jun 11 13:16:15.175399 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.175319 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" containerName="registry" Jun 11 13:16:15.175399 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.175335 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" containerName="registry" Jun 11 13:16:15.175507 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.175406 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d3a2cfa-c84c-400d-b4b5-d1915a9a1aba" containerName="registry" Jun 11 13:16:15.177841 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.177825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.180610 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.180584 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 13:16:15.180723 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.180686 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 13:16:15.180817 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.180800 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 13:16:15.181058 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.181045 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 13:16:15.181197 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.181181 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ppnnb\"" Jun 11 13:16:15.198694 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.198670 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx"] Jun 11 13:16:15.320264 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.320221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/072e65a5-4af8-4770-bac6-79c6af347ad1-manifests\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.320264 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.320268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/072e65a5-4af8-4770-bac6-79c6af347ad1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.320512 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.320295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/072e65a5-4af8-4770-bac6-79c6af347ad1-tmp\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.320512 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.320336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/072e65a5-4af8-4770-bac6-79c6af347ad1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.320512 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.320360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkzcl\" (UniqueName: \"kubernetes.io/projected/072e65a5-4af8-4770-bac6-79c6af347ad1-kube-api-access-wkzcl\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.421352 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.421317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkzcl\" (UniqueName: \"kubernetes.io/projected/072e65a5-4af8-4770-bac6-79c6af347ad1-kube-api-access-wkzcl\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.421567 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.421466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/072e65a5-4af8-4770-bac6-79c6af347ad1-manifests\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.421567 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.421502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/072e65a5-4af8-4770-bac6-79c6af347ad1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.421567 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.421537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/072e65a5-4af8-4770-bac6-79c6af347ad1-tmp\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.421567 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.421563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/072e65a5-4af8-4770-bac6-79c6af347ad1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.421891 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.421870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/072e65a5-4af8-4770-bac6-79c6af347ad1-manifests\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.423898 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.423870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/072e65a5-4af8-4770-bac6-79c6af347ad1-tmp\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.424093 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.424076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/072e65a5-4af8-4770-bac6-79c6af347ad1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.424153 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.424103 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/072e65a5-4af8-4770-bac6-79c6af347ad1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.429246 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.429193 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkzcl\" (UniqueName: \"kubernetes.io/projected/072e65a5-4af8-4770-bac6-79c6af347ad1-kube-api-access-wkzcl\") pod \"opendatahub-operator-controller-manager-7cdf5bf854-d5njx\" (UID: \"072e65a5-4af8-4770-bac6-79c6af347ad1\") " pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.488521 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.488488 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:15.638192 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.638168 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx"] Jun 11 13:16:15.640233 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:16:15.640206 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072e65a5_4af8_4770_bac6_79c6af347ad1.slice/crio-75fb4092a1e26f3ee3dc56a662b1fa8c853294195c53e8d23ad1331df492f322 WatchSource:0}: Error finding container 75fb4092a1e26f3ee3dc56a662b1fa8c853294195c53e8d23ad1331df492f322: Status 404 returned error can't find the container with id 75fb4092a1e26f3ee3dc56a662b1fa8c853294195c53e8d23ad1331df492f322 Jun 11 13:16:15.642078 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.642061 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 13:16:15.710103 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:15.710019 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" event={"ID":"072e65a5-4af8-4770-bac6-79c6af347ad1","Type":"ContainerStarted","Data":"75fb4092a1e26f3ee3dc56a662b1fa8c853294195c53e8d23ad1331df492f322"} Jun 11 13:16:19.734501 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:19.734461 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" event={"ID":"072e65a5-4af8-4770-bac6-79c6af347ad1","Type":"ContainerStarted","Data":"ebcf911a0915cb9bf9043ebd42e499fee82b0555fbd15c0761b13fa8a6789611"} Jun 11 13:16:20.740343 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:20.740305 2576 generic.go:356] "Generic (PLEG): container finished" podID="072e65a5-4af8-4770-bac6-79c6af347ad1" containerID="ebcf911a0915cb9bf9043ebd42e499fee82b0555fbd15c0761b13fa8a6789611" exitCode=0 Jun 11 13:16:20.740745 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:20.740395 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" event={"ID":"072e65a5-4af8-4770-bac6-79c6af347ad1","Type":"ContainerDied","Data":"ebcf911a0915cb9bf9043ebd42e499fee82b0555fbd15c0761b13fa8a6789611"} Jun 11 13:16:21.746856 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:21.746810 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" event={"ID":"072e65a5-4af8-4770-bac6-79c6af347ad1","Type":"ContainerStarted","Data":"d9fc3ec280be0c1684f6b2c51ea3c6e0008e4a677900b4ab54cd1375d739cc42"} Jun 11 13:16:21.747326 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:21.746966 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:21.771178 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:21.771125 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" podStartSLOduration=1.952626758 podStartE2EDuration="6.77110609s" totalImagesPullingTime="3.845896776s" totalInitContainerRuntime="972.582556ms" isStatefulPod=false podCreationTimestamp="2026-06-11 13:16:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:16:21.768854934 +0000 UTC m=+351.914485001" watchObservedRunningTime="2026-06-11 13:16:21.77110609 +0000 UTC m=+351.916736142" Jun 11 13:16:32.753944 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:32.753912 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7cdf5bf854-d5njx" Jun 11 13:16:43.799735 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.799692 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb"] Jun 11 13:16:43.810090 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.810067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:43.812326 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.812303 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:16:43.812492 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.812387 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 13:16:43.813493 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.813471 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 13:16:43.813795 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.813659 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fnwkm\"" Jun 11 13:16:43.813795 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.813699 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 13:16:43.813795 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.813607 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 13:16:43.815781 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.815762 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb"] Jun 11 13:16:43.874310 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.874275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3206aff6-f680-4892-8b6e-f26df8216094-metrics-cert\") pod \"lws-controller-manager-d5c7595f8-lqjpb\" (UID: \"3206aff6-f680-4892-8b6e-f26df8216094\") " pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:43.874495 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.874342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3206aff6-f680-4892-8b6e-f26df8216094-manager-config\") pod \"lws-controller-manager-d5c7595f8-lqjpb\" (UID: \"3206aff6-f680-4892-8b6e-f26df8216094\") " pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:43.874495 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.874378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvlmd\" (UniqueName: \"kubernetes.io/projected/3206aff6-f680-4892-8b6e-f26df8216094-kube-api-access-hvlmd\") pod \"lws-controller-manager-d5c7595f8-lqjpb\" (UID: \"3206aff6-f680-4892-8b6e-f26df8216094\") " pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:43.874495 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.874398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3206aff6-f680-4892-8b6e-f26df8216094-cert\") pod \"lws-controller-manager-d5c7595f8-lqjpb\" (UID: \"3206aff6-f680-4892-8b6e-f26df8216094\") " pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:43.975238 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.975203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvlmd\" (UniqueName: \"kubernetes.io/projected/3206aff6-f680-4892-8b6e-f26df8216094-kube-api-access-hvlmd\") pod \"lws-controller-manager-d5c7595f8-lqjpb\" (UID: \"3206aff6-f680-4892-8b6e-f26df8216094\") " pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:43.975442 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.975253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3206aff6-f680-4892-8b6e-f26df8216094-cert\") pod \"lws-controller-manager-d5c7595f8-lqjpb\" (UID: \"3206aff6-f680-4892-8b6e-f26df8216094\") " pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:43.975442 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.975317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3206aff6-f680-4892-8b6e-f26df8216094-metrics-cert\") pod \"lws-controller-manager-d5c7595f8-lqjpb\" (UID: \"3206aff6-f680-4892-8b6e-f26df8216094\") " pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:43.975442 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.975384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3206aff6-f680-4892-8b6e-f26df8216094-manager-config\") pod \"lws-controller-manager-d5c7595f8-lqjpb\" (UID: \"3206aff6-f680-4892-8b6e-f26df8216094\") " pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:43.976048 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.976024 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3206aff6-f680-4892-8b6e-f26df8216094-manager-config\") pod \"lws-controller-manager-d5c7595f8-lqjpb\" (UID: \"3206aff6-f680-4892-8b6e-f26df8216094\") " pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:43.977811 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.977772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3206aff6-f680-4892-8b6e-f26df8216094-metrics-cert\") pod \"lws-controller-manager-d5c7595f8-lqjpb\" (UID: \"3206aff6-f680-4892-8b6e-f26df8216094\") " pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:43.977939 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.977819 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3206aff6-f680-4892-8b6e-f26df8216094-cert\") pod \"lws-controller-manager-d5c7595f8-lqjpb\" (UID: \"3206aff6-f680-4892-8b6e-f26df8216094\") " pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:43.984377 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:43.984341 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvlmd\" (UniqueName: \"kubernetes.io/projected/3206aff6-f680-4892-8b6e-f26df8216094-kube-api-access-hvlmd\") pod \"lws-controller-manager-d5c7595f8-lqjpb\" (UID: \"3206aff6-f680-4892-8b6e-f26df8216094\") " pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:44.121523 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:44.121437 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:44.261045 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:44.261015 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb"] Jun 11 13:16:44.263201 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:16:44.263172 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3206aff6_f680_4892_8b6e_f26df8216094.slice/crio-cce54e164a31bdea76567639b252909320ff4e82896f65f2108bfaeb99f9fe54 WatchSource:0}: Error finding container cce54e164a31bdea76567639b252909320ff4e82896f65f2108bfaeb99f9fe54: Status 404 returned error can't find the container with id cce54e164a31bdea76567639b252909320ff4e82896f65f2108bfaeb99f9fe54 Jun 11 13:16:44.849074 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:44.849039 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" event={"ID":"3206aff6-f680-4892-8b6e-f26df8216094","Type":"ContainerStarted","Data":"cce54e164a31bdea76567639b252909320ff4e82896f65f2108bfaeb99f9fe54"} Jun 11 13:16:47.870158 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:47.870120 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" event={"ID":"3206aff6-f680-4892-8b6e-f26df8216094","Type":"ContainerStarted","Data":"bde64f26bf9cdfd51ac8115fbb8e3d5d54016fc69db9b3eb8edf1e475f719ba6"} Jun 11 13:16:47.870704 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:47.870258 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:16:47.891525 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:47.891474 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" podStartSLOduration=1.874759413 podStartE2EDuration="4.891460129s" totalImagesPullingTime="3.016700716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:16:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:16:47.889618999 +0000 UTC m=+378.035249054" watchObservedRunningTime="2026-06-11 13:16:47.891460129 +0000 UTC m=+378.037090181" Jun 11 13:16:57.229309 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:57.229275 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-68c659989f-jdd28"] Jun 11 13:16:57.232127 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:57.232109 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-68c659989f-jdd28" Jun 11 13:16:57.235361 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:57.235341 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6n2nd\"" Jun 11 13:16:57.235734 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:57.235713 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 13:16:57.308506 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:57.308471 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-68c659989f-jdd28"] Jun 11 13:16:57.403102 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:57.403066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/74d294b8-6b90-4741-8191-edc92b7bcf59-redirect-config\") pod \"dashboard-redirect-68c659989f-jdd28\" (UID: \"74d294b8-6b90-4741-8191-edc92b7bcf59\") " pod="opendatahub/dashboard-redirect-68c659989f-jdd28" Jun 11 13:16:57.403278 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:57.403175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpdrf\" (UniqueName: \"kubernetes.io/projected/74d294b8-6b90-4741-8191-edc92b7bcf59-kube-api-access-qpdrf\") pod \"dashboard-redirect-68c659989f-jdd28\" (UID: \"74d294b8-6b90-4741-8191-edc92b7bcf59\") " pod="opendatahub/dashboard-redirect-68c659989f-jdd28" Jun 11 13:16:57.504338 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:57.504257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/74d294b8-6b90-4741-8191-edc92b7bcf59-redirect-config\") pod \"dashboard-redirect-68c659989f-jdd28\" (UID: \"74d294b8-6b90-4741-8191-edc92b7bcf59\") " pod="opendatahub/dashboard-redirect-68c659989f-jdd28" Jun 11 13:16:57.504338 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:57.504297 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpdrf\" (UniqueName: \"kubernetes.io/projected/74d294b8-6b90-4741-8191-edc92b7bcf59-kube-api-access-qpdrf\") pod \"dashboard-redirect-68c659989f-jdd28\" (UID: \"74d294b8-6b90-4741-8191-edc92b7bcf59\") " pod="opendatahub/dashboard-redirect-68c659989f-jdd28" Jun 11 13:16:57.504966 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:57.504945 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/74d294b8-6b90-4741-8191-edc92b7bcf59-redirect-config\") pod \"dashboard-redirect-68c659989f-jdd28\" (UID: \"74d294b8-6b90-4741-8191-edc92b7bcf59\") " pod="opendatahub/dashboard-redirect-68c659989f-jdd28" Jun 11 13:16:57.517041 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:57.517014 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpdrf\" (UniqueName: \"kubernetes.io/projected/74d294b8-6b90-4741-8191-edc92b7bcf59-kube-api-access-qpdrf\") pod \"dashboard-redirect-68c659989f-jdd28\" (UID: \"74d294b8-6b90-4741-8191-edc92b7bcf59\") " pod="opendatahub/dashboard-redirect-68c659989f-jdd28" Jun 11 13:16:57.542493 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:57.542472 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-68c659989f-jdd28" Jun 11 13:16:57.678922 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:57.678887 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-68c659989f-jdd28"] Jun 11 13:16:57.681787 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:16:57.681765 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74d294b8_6b90_4741_8191_edc92b7bcf59.slice/crio-aa34690826042ef4f8d17caf248975d5818387db026f61b6dcfea0a64d4c346c WatchSource:0}: Error finding container aa34690826042ef4f8d17caf248975d5818387db026f61b6dcfea0a64d4c346c: Status 404 returned error can't find the container with id aa34690826042ef4f8d17caf248975d5818387db026f61b6dcfea0a64d4c346c Jun 11 13:16:57.915536 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:57.915503 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-68c659989f-jdd28" event={"ID":"74d294b8-6b90-4741-8191-edc92b7bcf59","Type":"ContainerStarted","Data":"aa34690826042ef4f8d17caf248975d5818387db026f61b6dcfea0a64d4c346c"} Jun 11 13:16:58.877151 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:16:58.877118 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d5c7595f8-lqjpb" Jun 11 13:17:02.941646 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:02.941612 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-68c659989f-jdd28" event={"ID":"74d294b8-6b90-4741-8191-edc92b7bcf59","Type":"ContainerStarted","Data":"744ff1cfb6649fa72562809e22234f065e56f085a150b304174baca8b6dc66fc"} Jun 11 13:17:02.959726 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:02.959672 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-68c659989f-jdd28" podStartSLOduration=1.642205418 podStartE2EDuration="5.959658036s" totalImagesPullingTime="4.317452618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:17:02.957920173 +0000 UTC m=+393.103550226" watchObservedRunningTime="2026-06-11 13:17:02.959658036 +0000 UTC m=+393.105288088" Jun 11 13:17:14.756201 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.756161 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv"] Jun 11 13:17:14.761131 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.761107 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.763607 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.763583 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dhmbz\"" Jun 11 13:17:14.763725 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.763623 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 13:17:14.771546 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.771521 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv"] Jun 11 13:17:14.851773 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.851736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.852095 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.852017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.852095 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.852060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.852348 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.852106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.852348 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.852261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.852348 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.852306 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhchb\" (UniqueName: \"kubernetes.io/projected/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-kube-api-access-zhchb\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.852348 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.852343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.852631 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.852378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.852631 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.852431 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.953151 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.953116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.953394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.953163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhchb\" (UniqueName: \"kubernetes.io/projected/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-kube-api-access-zhchb\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.953394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.953189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.953394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.953211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.953394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.953235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.953394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.953261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.953394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.953285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.953394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.953312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.953801 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.953518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.953801 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.953627 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.953911 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.953816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.954000 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.953972 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.954124 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.954060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.954171 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.954135 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.955991 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.955965 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.956081 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.956052 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.960812 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.960789 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:14.961489 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:14.961465 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhchb\" (UniqueName: \"kubernetes.io/projected/e95a1ca3-7ad6-411d-87ba-14e6182e7f98-kube-api-access-zhchb\") pod \"data-science-gateway-data-science-gateway-class-74759f9795brzwv\" (UID: \"e95a1ca3-7ad6-411d-87ba-14e6182e7f98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:15.071893 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:15.071857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:15.206919 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:15.206895 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv"] Jun 11 13:17:15.998408 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:15.998371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" event={"ID":"e95a1ca3-7ad6-411d-87ba-14e6182e7f98","Type":"ContainerStarted","Data":"e141aa538cc85ed05b8ad47c489769c451600d114948fc0b2c62d6eba10371c0"} Jun 11 13:17:32.642458 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:32.642395 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:17:32.642744 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:32.642501 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:17:32.642744 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:32.642534 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:17:33.079960 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:33.079921 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" event={"ID":"e95a1ca3-7ad6-411d-87ba-14e6182e7f98","Type":"ContainerStarted","Data":"8c8121b651a38cfe72d5d09f073846fe792c9cef4020c8f33babd0d0ec0a61de"} Jun 11 13:17:33.103504 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:33.103459 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" podStartSLOduration=1.6738323309999998 podStartE2EDuration="19.103440251s" totalImagesPullingTime="17.42960792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:17:33.101699952 +0000 UTC m=+423.247330005" watchObservedRunningTime="2026-06-11 13:17:33.103440251 +0000 UTC m=+423.249070305" Jun 11 13:17:34.072871 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:34.072841 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:34.077266 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:34.077242 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:34.083906 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:34.083884 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:34.084667 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:34.084651 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795brzwv" Jun 11 13:17:36.235277 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.235234 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8c5z2"] Jun 11 13:17:36.237996 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.237970 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8c5z2" Jun 11 13:17:36.240222 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.240194 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 13:17:36.241032 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.241009 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 13:17:36.241032 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.241023 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vwrgl\"" Jun 11 13:17:36.247995 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.247966 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8c5z2"] Jun 11 13:17:36.339739 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.339702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9r87\" (UniqueName: \"kubernetes.io/projected/2f04367a-31e2-4818-bb53-8ad776b7304a-kube-api-access-s9r87\") pod \"kuadrant-operator-catalog-8c5z2\" (UID: \"2f04367a-31e2-4818-bb53-8ad776b7304a\") " pod="kuadrant-system/kuadrant-operator-catalog-8c5z2" Jun 11 13:17:36.441103 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.441070 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9r87\" (UniqueName: \"kubernetes.io/projected/2f04367a-31e2-4818-bb53-8ad776b7304a-kube-api-access-s9r87\") pod \"kuadrant-operator-catalog-8c5z2\" (UID: \"2f04367a-31e2-4818-bb53-8ad776b7304a\") " pod="kuadrant-system/kuadrant-operator-catalog-8c5z2" Jun 11 13:17:36.448617 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.448592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9r87\" (UniqueName: \"kubernetes.io/projected/2f04367a-31e2-4818-bb53-8ad776b7304a-kube-api-access-s9r87\") pod \"kuadrant-operator-catalog-8c5z2\" (UID: \"2f04367a-31e2-4818-bb53-8ad776b7304a\") " pod="kuadrant-system/kuadrant-operator-catalog-8c5z2" Jun 11 13:17:36.549012 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.548975 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8c5z2" Jun 11 13:17:36.602612 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.602580 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8c5z2"] Jun 11 13:17:36.682735 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.682610 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8c5z2"] Jun 11 13:17:36.685674 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:17:36.685646 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f04367a_31e2_4818_bb53_8ad776b7304a.slice/crio-8eb74833ffee00c19cf018d7e7dc839d18417ad75f95e2f9d1369dbc68cbfe53 WatchSource:0}: Error finding container 8eb74833ffee00c19cf018d7e7dc839d18417ad75f95e2f9d1369dbc68cbfe53: Status 404 returned error can't find the container with id 8eb74833ffee00c19cf018d7e7dc839d18417ad75f95e2f9d1369dbc68cbfe53 Jun 11 13:17:36.810835 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.810761 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qdtsz"] Jun 11 13:17:36.813755 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.813739 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qdtsz" Jun 11 13:17:36.821354 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.821109 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qdtsz"] Jun 11 13:17:36.946271 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:36.946233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckbwk\" (UniqueName: \"kubernetes.io/projected/afba3ae7-d5be-4bb8-8eb6-6be7fbecb248-kube-api-access-ckbwk\") pod \"kuadrant-operator-catalog-qdtsz\" (UID: \"afba3ae7-d5be-4bb8-8eb6-6be7fbecb248\") " pod="kuadrant-system/kuadrant-operator-catalog-qdtsz" Jun 11 13:17:37.047316 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:37.047280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckbwk\" (UniqueName: \"kubernetes.io/projected/afba3ae7-d5be-4bb8-8eb6-6be7fbecb248-kube-api-access-ckbwk\") pod \"kuadrant-operator-catalog-qdtsz\" (UID: \"afba3ae7-d5be-4bb8-8eb6-6be7fbecb248\") " pod="kuadrant-system/kuadrant-operator-catalog-qdtsz" Jun 11 13:17:37.054816 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:37.054789 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckbwk\" (UniqueName: \"kubernetes.io/projected/afba3ae7-d5be-4bb8-8eb6-6be7fbecb248-kube-api-access-ckbwk\") pod \"kuadrant-operator-catalog-qdtsz\" (UID: \"afba3ae7-d5be-4bb8-8eb6-6be7fbecb248\") " pod="kuadrant-system/kuadrant-operator-catalog-qdtsz" Jun 11 13:17:37.098545 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:37.098476 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8c5z2" event={"ID":"2f04367a-31e2-4818-bb53-8ad776b7304a","Type":"ContainerStarted","Data":"8eb74833ffee00c19cf018d7e7dc839d18417ad75f95e2f9d1369dbc68cbfe53"} Jun 11 13:17:37.123785 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:37.123758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qdtsz" Jun 11 13:17:37.266443 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:37.266394 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qdtsz"] Jun 11 13:17:37.279010 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:17:37.278985 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafba3ae7_d5be_4bb8_8eb6_6be7fbecb248.slice/crio-1b2305c194f8769cf17ddc8a4753b01663d82d07082127822d71f2a0dbe9e65b WatchSource:0}: Error finding container 1b2305c194f8769cf17ddc8a4753b01663d82d07082127822d71f2a0dbe9e65b: Status 404 returned error can't find the container with id 1b2305c194f8769cf17ddc8a4753b01663d82d07082127822d71f2a0dbe9e65b Jun 11 13:17:38.103676 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:38.103636 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qdtsz" event={"ID":"afba3ae7-d5be-4bb8-8eb6-6be7fbecb248","Type":"ContainerStarted","Data":"1b2305c194f8769cf17ddc8a4753b01663d82d07082127822d71f2a0dbe9e65b"} Jun 11 13:17:40.114685 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:40.114642 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8c5z2" event={"ID":"2f04367a-31e2-4818-bb53-8ad776b7304a","Type":"ContainerStarted","Data":"6b5fa7e3442f8c019143e164603e5e4519961331b9ce6f0a8e9f447c4b838f87"} Jun 11 13:17:40.115180 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:40.114715 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8c5z2" podUID="2f04367a-31e2-4818-bb53-8ad776b7304a" containerName="registry-server" containerID="cri-o://6b5fa7e3442f8c019143e164603e5e4519961331b9ce6f0a8e9f447c4b838f87" gracePeriod=2 Jun 11 13:17:40.116190 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:40.116165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qdtsz" event={"ID":"afba3ae7-d5be-4bb8-8eb6-6be7fbecb248","Type":"ContainerStarted","Data":"b8375a226bd362c968064650f1d46310436b86ce3ba2f4aa7d6ae0a92e444e68"} Jun 11 13:17:40.129980 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:40.129930 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8c5z2" podStartSLOduration=1.517947019 podStartE2EDuration="4.129910528s" totalImagesPullingTime="2.611963509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:17:40.12966628 +0000 UTC m=+430.275296334" watchObservedRunningTime="2026-06-11 13:17:40.129910528 +0000 UTC m=+430.275540578" Jun 11 13:17:40.143670 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:40.143631 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qdtsz" podStartSLOduration=2.122101473 podStartE2EDuration="4.143616491s" totalImagesPullingTime="2.021515018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:17:40.142723282 +0000 UTC m=+430.288353337" watchObservedRunningTime="2026-06-11 13:17:40.143616491 +0000 UTC m=+430.289246567" Jun 11 13:17:40.363712 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:40.363687 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8c5z2" Jun 11 13:17:40.477339 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:40.477253 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9r87\" (UniqueName: \"kubernetes.io/projected/2f04367a-31e2-4818-bb53-8ad776b7304a-kube-api-access-s9r87\") pod \"2f04367a-31e2-4818-bb53-8ad776b7304a\" (UID: \"2f04367a-31e2-4818-bb53-8ad776b7304a\") " Jun 11 13:17:40.479387 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:40.479361 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f04367a-31e2-4818-bb53-8ad776b7304a-kube-api-access-s9r87" (OuterVolumeSpecName: "kube-api-access-s9r87") pod "2f04367a-31e2-4818-bb53-8ad776b7304a" (UID: "2f04367a-31e2-4818-bb53-8ad776b7304a"). InnerVolumeSpecName "kube-api-access-s9r87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:17:40.578637 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:40.578601 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9r87\" (UniqueName: \"kubernetes.io/projected/2f04367a-31e2-4818-bb53-8ad776b7304a-kube-api-access-s9r87\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:17:41.122109 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:41.122076 2576 generic.go:356] "Generic (PLEG): container finished" podID="2f04367a-31e2-4818-bb53-8ad776b7304a" containerID="6b5fa7e3442f8c019143e164603e5e4519961331b9ce6f0a8e9f447c4b838f87" exitCode=0 Jun 11 13:17:41.122504 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:41.122125 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8c5z2" Jun 11 13:17:41.122504 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:41.122165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8c5z2" event={"ID":"2f04367a-31e2-4818-bb53-8ad776b7304a","Type":"ContainerDied","Data":"6b5fa7e3442f8c019143e164603e5e4519961331b9ce6f0a8e9f447c4b838f87"} Jun 11 13:17:41.122504 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:41.122244 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8c5z2" event={"ID":"2f04367a-31e2-4818-bb53-8ad776b7304a","Type":"ContainerDied","Data":"8eb74833ffee00c19cf018d7e7dc839d18417ad75f95e2f9d1369dbc68cbfe53"} Jun 11 13:17:41.122504 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:41.122269 2576 scope.go:117] "RemoveContainer" containerID="6b5fa7e3442f8c019143e164603e5e4519961331b9ce6f0a8e9f447c4b838f87" Jun 11 13:17:41.131332 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:41.131310 2576 scope.go:117] "RemoveContainer" containerID="6b5fa7e3442f8c019143e164603e5e4519961331b9ce6f0a8e9f447c4b838f87" Jun 11 13:17:41.131611 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:17:41.131591 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b5fa7e3442f8c019143e164603e5e4519961331b9ce6f0a8e9f447c4b838f87\": container with ID starting with 6b5fa7e3442f8c019143e164603e5e4519961331b9ce6f0a8e9f447c4b838f87 not found: ID does not exist" containerID="6b5fa7e3442f8c019143e164603e5e4519961331b9ce6f0a8e9f447c4b838f87" Jun 11 13:17:41.131668 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:41.131620 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5fa7e3442f8c019143e164603e5e4519961331b9ce6f0a8e9f447c4b838f87"} err="failed to get container status \"6b5fa7e3442f8c019143e164603e5e4519961331b9ce6f0a8e9f447c4b838f87\": rpc error: code = NotFound desc = could not find container \"6b5fa7e3442f8c019143e164603e5e4519961331b9ce6f0a8e9f447c4b838f87\": container with ID starting with 6b5fa7e3442f8c019143e164603e5e4519961331b9ce6f0a8e9f447c4b838f87 not found: ID does not exist" Jun 11 13:17:41.142879 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:41.142857 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8c5z2"] Jun 11 13:17:41.145993 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:41.145973 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8c5z2"] Jun 11 13:17:42.278120 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:42.278089 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f04367a-31e2-4818-bb53-8ad776b7304a" path="/var/lib/kubelet/pods/2f04367a-31e2-4818-bb53-8ad776b7304a/volumes" Jun 11 13:17:47.124449 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:47.124393 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qdtsz" Jun 11 13:17:47.124977 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:47.124470 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qdtsz" Jun 11 13:17:47.147895 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:47.147863 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qdtsz" Jun 11 13:17:47.170947 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:17:47.170926 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qdtsz" Jun 11 13:18:05.448570 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:05.448485 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4ms5l"] Jun 11 13:18:05.449077 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:05.448826 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f04367a-31e2-4818-bb53-8ad776b7304a" containerName="registry-server" Jun 11 13:18:05.449077 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:05.448837 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f04367a-31e2-4818-bb53-8ad776b7304a" containerName="registry-server" Jun 11 13:18:05.449077 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:05.448890 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f04367a-31e2-4818-bb53-8ad776b7304a" containerName="registry-server" Jun 11 13:18:05.458718 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:05.458691 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ms5l" Jun 11 13:18:05.460851 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:05.460827 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5vqcf\"" Jun 11 13:18:05.461003 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:05.460977 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4ms5l"] Jun 11 13:18:05.485444 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:05.485399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s96z5\" (UniqueName: \"kubernetes.io/projected/6f1e1fd6-8f78-4f10-b7c5-5a4d8de7d56f-kube-api-access-s96z5\") pod \"authorino-operator-75cc8d5cb7-4ms5l\" (UID: \"6f1e1fd6-8f78-4f10-b7c5-5a4d8de7d56f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ms5l" Jun 11 13:18:05.586127 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:05.586087 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s96z5\" (UniqueName: \"kubernetes.io/projected/6f1e1fd6-8f78-4f10-b7c5-5a4d8de7d56f-kube-api-access-s96z5\") pod \"authorino-operator-75cc8d5cb7-4ms5l\" (UID: \"6f1e1fd6-8f78-4f10-b7c5-5a4d8de7d56f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ms5l" Jun 11 13:18:05.597149 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:05.597120 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s96z5\" (UniqueName: \"kubernetes.io/projected/6f1e1fd6-8f78-4f10-b7c5-5a4d8de7d56f-kube-api-access-s96z5\") pod \"authorino-operator-75cc8d5cb7-4ms5l\" (UID: \"6f1e1fd6-8f78-4f10-b7c5-5a4d8de7d56f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ms5l" Jun 11 13:18:05.769918 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:05.769883 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ms5l" Jun 11 13:18:05.905993 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:05.905969 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4ms5l"] Jun 11 13:18:05.908372 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:18:05.908351 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1e1fd6_8f78_4f10_b7c5_5a4d8de7d56f.slice/crio-afe97bec9b6b14186853e77fdf8dd0a03e200c9e958fe1f5a0af9ede105ed675 WatchSource:0}: Error finding container afe97bec9b6b14186853e77fdf8dd0a03e200c9e958fe1f5a0af9ede105ed675: Status 404 returned error can't find the container with id afe97bec9b6b14186853e77fdf8dd0a03e200c9e958fe1f5a0af9ede105ed675 Jun 11 13:18:06.236640 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:06.236550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ms5l" event={"ID":"6f1e1fd6-8f78-4f10-b7c5-5a4d8de7d56f","Type":"ContainerStarted","Data":"afe97bec9b6b14186853e77fdf8dd0a03e200c9e958fe1f5a0af9ede105ed675"} Jun 11 13:18:08.248161 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:08.248113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ms5l" event={"ID":"6f1e1fd6-8f78-4f10-b7c5-5a4d8de7d56f","Type":"ContainerStarted","Data":"3af8bf63fc42ea431489aace30a59771c7fb2cd3664f9ff4670157033e271a8d"} Jun 11 13:18:08.248559 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:08.248209 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ms5l" Jun 11 13:18:08.271722 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:08.271672 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ms5l" podStartSLOduration=1.053334776 podStartE2EDuration="3.271656054s" totalImagesPullingTime="2.218321278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:18:08.270757647 +0000 UTC m=+458.416387701" watchObservedRunningTime="2026-06-11 13:18:08.271656054 +0000 UTC m=+458.417286107" Jun 11 13:18:19.254772 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:19.254742 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ms5l" Jun 11 13:18:32.776175 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:32.776139 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s"] Jun 11 13:18:32.780622 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:32.780601 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:32.783759 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:32.783733 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nbdpr\"" Jun 11 13:18:32.794732 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:32.794710 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s"] Jun 11 13:18:32.943611 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:32.943575 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fdtt\" (UniqueName: \"kubernetes.io/projected/ff72c53c-c346-4ab8-82c5-5a5c6ef14027-kube-api-access-9fdtt\") pod \"kuadrant-operator-controller-manager-55467d9f7-rhs5s\" (UID: \"ff72c53c-c346-4ab8-82c5-5a5c6ef14027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:32.943791 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:32.943672 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff72c53c-c346-4ab8-82c5-5a5c6ef14027-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rhs5s\" (UID: \"ff72c53c-c346-4ab8-82c5-5a5c6ef14027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:33.044562 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.044480 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff72c53c-c346-4ab8-82c5-5a5c6ef14027-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rhs5s\" (UID: \"ff72c53c-c346-4ab8-82c5-5a5c6ef14027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:33.044562 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.044530 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fdtt\" (UniqueName: \"kubernetes.io/projected/ff72c53c-c346-4ab8-82c5-5a5c6ef14027-kube-api-access-9fdtt\") pod \"kuadrant-operator-controller-manager-55467d9f7-rhs5s\" (UID: \"ff72c53c-c346-4ab8-82c5-5a5c6ef14027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:33.044861 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.044839 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff72c53c-c346-4ab8-82c5-5a5c6ef14027-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rhs5s\" (UID: \"ff72c53c-c346-4ab8-82c5-5a5c6ef14027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:33.056041 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.056015 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fdtt\" (UniqueName: \"kubernetes.io/projected/ff72c53c-c346-4ab8-82c5-5a5c6ef14027-kube-api-access-9fdtt\") pod \"kuadrant-operator-controller-manager-55467d9f7-rhs5s\" (UID: \"ff72c53c-c346-4ab8-82c5-5a5c6ef14027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:33.090660 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.090634 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:33.210428 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.210382 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s"] Jun 11 13:18:33.216536 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.216256 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s"] Jun 11 13:18:33.235931 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.235898 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds"] Jun 11 13:18:33.240800 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.240777 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" Jun 11 13:18:33.255866 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.255812 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds"] Jun 11 13:18:33.347125 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.347095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5mld\" (UniqueName: \"kubernetes.io/projected/ab1a2f83-7e11-4565-83f8-4d730d1f7208-kube-api-access-b5mld\") pod \"kuadrant-operator-controller-manager-55467d9f7-b5cds\" (UID: \"ab1a2f83-7e11-4565-83f8-4d730d1f7208\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" Jun 11 13:18:33.347252 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.347170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab1a2f83-7e11-4565-83f8-4d730d1f7208-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-b5cds\" (UID: \"ab1a2f83-7e11-4565-83f8-4d730d1f7208\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" Jun 11 13:18:33.349702 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:18:33.349673 2576 log.go:32] "RunPodSandbox from runtime service failed" err=< Jun 11 13:18:33.349702 ip-10-0-140-41 kubenswrapper[2576]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-rhs5s_kuadrant-system_ff72c53c-c346-4ab8-82c5-5a5c6ef14027_0(f478fa9285895f3ab7894526458ee705143927b7fa89b09ec75b53a849458c20): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-rhs5s to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f478fa9285895f3ab7894526458ee705143927b7fa89b09ec75b53a849458c20" Netns:"/var/run/netns/58645e44-42e0-4e98-bd24-eaa6a3f26e90" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-rhs5s;K8S_POD_INFRA_CONTAINER_ID=f478fa9285895f3ab7894526458ee705143927b7fa89b09ec75b53a849458c20;K8S_POD_UID=ff72c53c-c346-4ab8-82c5-5a5c6ef14027" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s/ff72c53c-c346-4ab8-82c5-5a5c6ef14027]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-rhs5s in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-rhs5s in out of cluster comm: status update failed for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s: pods "kuadrant-operator-controller-manager-55467d9f7-rhs5s" not found Jun 11 13:18:33.349702 ip-10-0-140-41 kubenswrapper[2576]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 11 13:18:33.349702 ip-10-0-140-41 kubenswrapper[2576]: > Jun 11 13:18:33.349881 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:18:33.349733 2576 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jun 11 13:18:33.349881 ip-10-0-140-41 kubenswrapper[2576]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-rhs5s_kuadrant-system_ff72c53c-c346-4ab8-82c5-5a5c6ef14027_0(f478fa9285895f3ab7894526458ee705143927b7fa89b09ec75b53a849458c20): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-rhs5s to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f478fa9285895f3ab7894526458ee705143927b7fa89b09ec75b53a849458c20" Netns:"/var/run/netns/58645e44-42e0-4e98-bd24-eaa6a3f26e90" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-rhs5s;K8S_POD_INFRA_CONTAINER_ID=f478fa9285895f3ab7894526458ee705143927b7fa89b09ec75b53a849458c20;K8S_POD_UID=ff72c53c-c346-4ab8-82c5-5a5c6ef14027" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s/ff72c53c-c346-4ab8-82c5-5a5c6ef14027]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-rhs5s in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-rhs5s in out of cluster comm: status update failed for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s: pods "kuadrant-operator-controller-manager-55467d9f7-rhs5s" not found Jun 11 13:18:33.349881 ip-10-0-140-41 kubenswrapper[2576]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 11 13:18:33.349881 ip-10-0-140-41 kubenswrapper[2576]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:33.358783 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.358762 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:33.361071 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:18:33.361041 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-rhs5s\" is forbidden: User \"system:node:ip-10-0-140-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-41.ec2.internal' and this object" podUID="ff72c53c-c346-4ab8-82c5-5a5c6ef14027" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:33.367227 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.367209 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:33.369587 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:18:33.369558 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-rhs5s\" is forbidden: User \"system:node:ip-10-0-140-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-41.ec2.internal' and this object" podUID="ff72c53c-c346-4ab8-82c5-5a5c6ef14027" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:33.448091 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.448060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab1a2f83-7e11-4565-83f8-4d730d1f7208-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-b5cds\" (UID: \"ab1a2f83-7e11-4565-83f8-4d730d1f7208\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" Jun 11 13:18:33.448263 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.448146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5mld\" (UniqueName: \"kubernetes.io/projected/ab1a2f83-7e11-4565-83f8-4d730d1f7208-kube-api-access-b5mld\") pod \"kuadrant-operator-controller-manager-55467d9f7-b5cds\" (UID: \"ab1a2f83-7e11-4565-83f8-4d730d1f7208\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" Jun 11 13:18:33.448527 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.448507 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab1a2f83-7e11-4565-83f8-4d730d1f7208-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-b5cds\" (UID: \"ab1a2f83-7e11-4565-83f8-4d730d1f7208\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" Jun 11 13:18:33.459381 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.459360 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5mld\" (UniqueName: \"kubernetes.io/projected/ab1a2f83-7e11-4565-83f8-4d730d1f7208-kube-api-access-b5mld\") pod \"kuadrant-operator-controller-manager-55467d9f7-b5cds\" (UID: \"ab1a2f83-7e11-4565-83f8-4d730d1f7208\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" Jun 11 13:18:33.548933 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.548901 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff72c53c-c346-4ab8-82c5-5a5c6ef14027-extensions-socket-volume\") pod \"ff72c53c-c346-4ab8-82c5-5a5c6ef14027\" (UID: \"ff72c53c-c346-4ab8-82c5-5a5c6ef14027\") " Jun 11 13:18:33.549118 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.548949 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fdtt\" (UniqueName: \"kubernetes.io/projected/ff72c53c-c346-4ab8-82c5-5a5c6ef14027-kube-api-access-9fdtt\") pod \"ff72c53c-c346-4ab8-82c5-5a5c6ef14027\" (UID: \"ff72c53c-c346-4ab8-82c5-5a5c6ef14027\") " Jun 11 13:18:33.549220 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.549199 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff72c53c-c346-4ab8-82c5-5a5c6ef14027-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ff72c53c-c346-4ab8-82c5-5a5c6ef14027" (UID: "ff72c53c-c346-4ab8-82c5-5a5c6ef14027"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:18:33.551099 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.551073 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff72c53c-c346-4ab8-82c5-5a5c6ef14027-kube-api-access-9fdtt" (OuterVolumeSpecName: "kube-api-access-9fdtt") pod "ff72c53c-c346-4ab8-82c5-5a5c6ef14027" (UID: "ff72c53c-c346-4ab8-82c5-5a5c6ef14027"). InnerVolumeSpecName "kube-api-access-9fdtt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:18:33.554074 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.554055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" Jun 11 13:18:33.649999 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.649966 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fdtt\" (UniqueName: \"kubernetes.io/projected/ff72c53c-c346-4ab8-82c5-5a5c6ef14027-kube-api-access-9fdtt\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:18:33.649999 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.649996 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff72c53c-c346-4ab8-82c5-5a5c6ef14027-extensions-socket-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:18:33.692343 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:33.692317 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds"] Jun 11 13:18:33.694205 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:18:33.694182 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1a2f83_7e11_4565_83f8_4d730d1f7208.slice/crio-7fa2463f2d11c979d4c0cbe3d03c245c63cd19618ecb37607ffd75d2cadde309 WatchSource:0}: Error finding container 7fa2463f2d11c979d4c0cbe3d03c245c63cd19618ecb37607ffd75d2cadde309: Status 404 returned error can't find the container with id 7fa2463f2d11c979d4c0cbe3d03c245c63cd19618ecb37607ffd75d2cadde309 Jun 11 13:18:34.280281 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:34.280248 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff72c53c-c346-4ab8-82c5-5a5c6ef14027" path="/var/lib/kubelet/pods/ff72c53c-c346-4ab8-82c5-5a5c6ef14027/volumes" Jun 11 13:18:34.364784 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:34.364706 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" event={"ID":"ab1a2f83-7e11-4565-83f8-4d730d1f7208","Type":"ContainerStarted","Data":"7fa2463f2d11c979d4c0cbe3d03c245c63cd19618ecb37607ffd75d2cadde309"} Jun 11 13:18:34.364784 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:34.364729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:34.369822 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:18:34.369794 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-rhs5s\" is forbidden: User \"system:node:ip-10-0-140-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-41.ec2.internal' and this object" podUID="ff72c53c-c346-4ab8-82c5-5a5c6ef14027" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rhs5s" Jun 11 13:18:40.394197 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:40.394161 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" event={"ID":"ab1a2f83-7e11-4565-83f8-4d730d1f7208","Type":"ContainerStarted","Data":"aefeb4607dbbbcc77a22a1a246577f29a32215eaaf62623fd3cd072a25c32f41"} Jun 11 13:18:40.394712 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:40.394248 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" Jun 11 13:18:40.414544 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:40.414493 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" podStartSLOduration=1.393701209 podStartE2EDuration="7.414478182s" totalImagesPullingTime="6.020776973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:18:40.411959425 +0000 UTC m=+490.557589478" watchObservedRunningTime="2026-06-11 13:18:40.414478182 +0000 UTC m=+490.560108235" Jun 11 13:18:51.400959 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:18:51.400928 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" Jun 11 13:19:03.782609 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:03.782575 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds"] Jun 11 13:19:03.783194 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:03.782824 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" podUID="ab1a2f83-7e11-4565-83f8-4d730d1f7208" containerName="manager" containerID="cri-o://aefeb4607dbbbcc77a22a1a246577f29a32215eaaf62623fd3cd072a25c32f41" gracePeriod=10 Jun 11 13:19:04.034167 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.034116 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" Jun 11 13:19:04.121005 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.120973 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab1a2f83-7e11-4565-83f8-4d730d1f7208-extensions-socket-volume\") pod \"ab1a2f83-7e11-4565-83f8-4d730d1f7208\" (UID: \"ab1a2f83-7e11-4565-83f8-4d730d1f7208\") " Jun 11 13:19:04.121177 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.121063 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5mld\" (UniqueName: \"kubernetes.io/projected/ab1a2f83-7e11-4565-83f8-4d730d1f7208-kube-api-access-b5mld\") pod \"ab1a2f83-7e11-4565-83f8-4d730d1f7208\" (UID: \"ab1a2f83-7e11-4565-83f8-4d730d1f7208\") " Jun 11 13:19:04.121515 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.121488 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1a2f83-7e11-4565-83f8-4d730d1f7208-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ab1a2f83-7e11-4565-83f8-4d730d1f7208" (UID: "ab1a2f83-7e11-4565-83f8-4d730d1f7208"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:19:04.123079 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.123052 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab1a2f83-7e11-4565-83f8-4d730d1f7208-kube-api-access-b5mld" (OuterVolumeSpecName: "kube-api-access-b5mld") pod "ab1a2f83-7e11-4565-83f8-4d730d1f7208" (UID: "ab1a2f83-7e11-4565-83f8-4d730d1f7208"). InnerVolumeSpecName "kube-api-access-b5mld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:19:04.222575 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.222540 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5mld\" (UniqueName: \"kubernetes.io/projected/ab1a2f83-7e11-4565-83f8-4d730d1f7208-kube-api-access-b5mld\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:19:04.222575 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.222567 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab1a2f83-7e11-4565-83f8-4d730d1f7208-extensions-socket-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:19:04.498006 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.497973 2576 generic.go:356] "Generic (PLEG): container finished" podID="ab1a2f83-7e11-4565-83f8-4d730d1f7208" containerID="aefeb4607dbbbcc77a22a1a246577f29a32215eaaf62623fd3cd072a25c32f41" exitCode=0 Jun 11 13:19:04.498173 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.498032 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" Jun 11 13:19:04.498173 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.498045 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" event={"ID":"ab1a2f83-7e11-4565-83f8-4d730d1f7208","Type":"ContainerDied","Data":"aefeb4607dbbbcc77a22a1a246577f29a32215eaaf62623fd3cd072a25c32f41"} Jun 11 13:19:04.498173 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.498091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds" event={"ID":"ab1a2f83-7e11-4565-83f8-4d730d1f7208","Type":"ContainerDied","Data":"7fa2463f2d11c979d4c0cbe3d03c245c63cd19618ecb37607ffd75d2cadde309"} Jun 11 13:19:04.498173 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.498113 2576 scope.go:117] "RemoveContainer" containerID="aefeb4607dbbbcc77a22a1a246577f29a32215eaaf62623fd3cd072a25c32f41" Jun 11 13:19:04.506705 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.506648 2576 scope.go:117] "RemoveContainer" containerID="aefeb4607dbbbcc77a22a1a246577f29a32215eaaf62623fd3cd072a25c32f41" Jun 11 13:19:04.506925 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:19:04.506905 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aefeb4607dbbbcc77a22a1a246577f29a32215eaaf62623fd3cd072a25c32f41\": container with ID starting with aefeb4607dbbbcc77a22a1a246577f29a32215eaaf62623fd3cd072a25c32f41 not found: ID does not exist" containerID="aefeb4607dbbbcc77a22a1a246577f29a32215eaaf62623fd3cd072a25c32f41" Jun 11 13:19:04.506986 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.506932 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aefeb4607dbbbcc77a22a1a246577f29a32215eaaf62623fd3cd072a25c32f41"} err="failed to get container status \"aefeb4607dbbbcc77a22a1a246577f29a32215eaaf62623fd3cd072a25c32f41\": rpc error: code = NotFound desc = could not find container \"aefeb4607dbbbcc77a22a1a246577f29a32215eaaf62623fd3cd072a25c32f41\": container with ID starting with aefeb4607dbbbcc77a22a1a246577f29a32215eaaf62623fd3cd072a25c32f41 not found: ID does not exist" Jun 11 13:19:04.514481 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.514458 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds"] Jun 11 13:19:04.520937 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:04.520917 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-b5cds"] Jun 11 13:19:06.278394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:06.278363 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab1a2f83-7e11-4565-83f8-4d730d1f7208" path="/var/lib/kubelet/pods/ab1a2f83-7e11-4565-83f8-4d730d1f7208/volumes" Jun 11 13:19:07.765484 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.765453 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv"] Jun 11 13:19:07.765849 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.765799 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab1a2f83-7e11-4565-83f8-4d730d1f7208" containerName="manager" Jun 11 13:19:07.765849 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.765811 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab1a2f83-7e11-4565-83f8-4d730d1f7208" containerName="manager" Jun 11 13:19:07.765953 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.765866 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab1a2f83-7e11-4565-83f8-4d730d1f7208" containerName="manager" Jun 11 13:19:07.770180 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.770164 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.772975 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.772957 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7t794\"" Jun 11 13:19:07.781164 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.781142 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv"] Jun 11 13:19:07.853402 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.853371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.853611 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.853444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.853611 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.853544 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.853709 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.853609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.853709 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.853651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.853709 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.853704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.853819 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.853757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.853819 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.853792 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.853903 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.853817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgv62\" (UniqueName: \"kubernetes.io/projected/e3a9a35c-ad6b-405e-b7f2-31e58421a643-kube-api-access-wgv62\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.954818 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.954782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.954818 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.954818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgv62\" (UniqueName: \"kubernetes.io/projected/e3a9a35c-ad6b-405e-b7f2-31e58421a643-kube-api-access-wgv62\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.955079 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.954954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.955079 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.955003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.955079 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.955058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.955233 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.955112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.955233 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.955157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.955233 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.955204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.955377 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.955331 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.955451 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.955383 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.955451 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.955392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.955540 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.955517 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.955729 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.955712 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.955860 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.955841 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.957453 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.957398 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.957654 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.957637 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.964187 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.964164 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgv62\" (UniqueName: \"kubernetes.io/projected/e3a9a35c-ad6b-405e-b7f2-31e58421a643-kube-api-access-wgv62\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:07.964280 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:07.964229 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3a9a35c-ad6b-405e-b7f2-31e58421a643-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-4qzwv\" (UID: \"e3a9a35c-ad6b-405e-b7f2-31e58421a643\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:08.080995 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:08.080901 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:08.218967 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:08.218944 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv"] Jun 11 13:19:08.220967 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:19:08.220933 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a9a35c_ad6b_405e_b7f2_31e58421a643.slice/crio-71e03719123e8b4c2cfd1e49de1ff8bafd2664094ef6f1f0cff1154e81746d10 WatchSource:0}: Error finding container 71e03719123e8b4c2cfd1e49de1ff8bafd2664094ef6f1f0cff1154e81746d10: Status 404 returned error can't find the container with id 71e03719123e8b4c2cfd1e49de1ff8bafd2664094ef6f1f0cff1154e81746d10 Jun 11 13:19:08.223052 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:08.223008 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:19:08.223117 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:08.223103 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:19:08.223192 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:08.223176 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:19:08.519223 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:08.519191 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" event={"ID":"e3a9a35c-ad6b-405e-b7f2-31e58421a643","Type":"ContainerStarted","Data":"38d83739309ddc0c0fc3f4318b52f0de51e7bf2140423214520031a8787a5f0f"} Jun 11 13:19:08.519425 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:08.519242 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" event={"ID":"e3a9a35c-ad6b-405e-b7f2-31e58421a643","Type":"ContainerStarted","Data":"71e03719123e8b4c2cfd1e49de1ff8bafd2664094ef6f1f0cff1154e81746d10"} Jun 11 13:19:08.539458 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:08.539382 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" podStartSLOduration=1.539360781 podStartE2EDuration="1.539360781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:19:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:19:08.537617885 +0000 UTC m=+518.683247942" watchObservedRunningTime="2026-06-11 13:19:08.539360781 +0000 UTC m=+518.684990835" Jun 11 13:19:09.081270 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.081230 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:09.082952 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.082928 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-4qzwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jun 11 13:19:09.083036 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.082981 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" podUID="e3a9a35c-ad6b-405e-b7f2-31e58421a643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jun 11 13:19:09.773833 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.773799 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h9qf6"] Jun 11 13:19:09.776991 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.776967 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" Jun 11 13:19:09.779395 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.779372 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jtv55\"" Jun 11 13:19:09.779533 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.779372 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 13:19:09.785180 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.785155 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h9qf6"] Jun 11 13:19:09.872781 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.872738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz5pz\" (UniqueName: \"kubernetes.io/projected/4c29efb2-bdca-48df-a7f1-e02b236230c7-kube-api-access-mz5pz\") pod \"limitador-limitador-64c94fd64f-h9qf6\" (UID: \"4c29efb2-bdca-48df-a7f1-e02b236230c7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" Jun 11 13:19:09.872973 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.872926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4c29efb2-bdca-48df-a7f1-e02b236230c7-config-file\") pod \"limitador-limitador-64c94fd64f-h9qf6\" (UID: \"4c29efb2-bdca-48df-a7f1-e02b236230c7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" Jun 11 13:19:09.876090 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.876063 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h9qf6"] Jun 11 13:19:09.973638 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.973598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4c29efb2-bdca-48df-a7f1-e02b236230c7-config-file\") pod \"limitador-limitador-64c94fd64f-h9qf6\" (UID: \"4c29efb2-bdca-48df-a7f1-e02b236230c7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" Jun 11 13:19:09.973833 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.973716 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz5pz\" (UniqueName: \"kubernetes.io/projected/4c29efb2-bdca-48df-a7f1-e02b236230c7-kube-api-access-mz5pz\") pod \"limitador-limitador-64c94fd64f-h9qf6\" (UID: \"4c29efb2-bdca-48df-a7f1-e02b236230c7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" Jun 11 13:19:09.974311 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.974288 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4c29efb2-bdca-48df-a7f1-e02b236230c7-config-file\") pod \"limitador-limitador-64c94fd64f-h9qf6\" (UID: \"4c29efb2-bdca-48df-a7f1-e02b236230c7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" Jun 11 13:19:09.983692 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:09.983663 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz5pz\" (UniqueName: \"kubernetes.io/projected/4c29efb2-bdca-48df-a7f1-e02b236230c7-kube-api-access-mz5pz\") pod \"limitador-limitador-64c94fd64f-h9qf6\" (UID: \"4c29efb2-bdca-48df-a7f1-e02b236230c7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" Jun 11 13:19:10.085188 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:10.085106 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:10.087968 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:10.087946 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" Jun 11 13:19:10.226378 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:10.226356 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h9qf6"] Jun 11 13:19:10.228698 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:19:10.228671 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c29efb2_bdca_48df_a7f1_e02b236230c7.slice/crio-372e8ad0d54de295584e2dcc53e25c05fc4349039ea50239d8c4912ab6155ec6 WatchSource:0}: Error finding container 372e8ad0d54de295584e2dcc53e25c05fc4349039ea50239d8c4912ab6155ec6: Status 404 returned error can't find the container with id 372e8ad0d54de295584e2dcc53e25c05fc4349039ea50239d8c4912ab6155ec6 Jun 11 13:19:10.528552 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:10.528519 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" event={"ID":"4c29efb2-bdca-48df-a7f1-e02b236230c7","Type":"ContainerStarted","Data":"372e8ad0d54de295584e2dcc53e25c05fc4349039ea50239d8c4912ab6155ec6"} Jun 11 13:19:10.528821 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:10.528804 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:10.529913 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:10.529894 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:19:13.543755 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:13.543721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" event={"ID":"4c29efb2-bdca-48df-a7f1-e02b236230c7","Type":"ContainerStarted","Data":"c8eb0142288f6784251f1785669b58b37dd1aa3b835c323178d899d5c865cf49"} Jun 11 13:19:13.544156 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:13.543854 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" Jun 11 13:19:13.558363 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:13.558319 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" podStartSLOduration=1.416649737 podStartE2EDuration="4.558305353s" totalImagesPullingTime="3.141655616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:19:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:19:13.557720911 +0000 UTC m=+523.703350975" watchObservedRunningTime="2026-06-11 13:19:13.558305353 +0000 UTC m=+523.703935405" Jun 11 13:19:24.550245 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:24.550162 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" Jun 11 13:19:24.867726 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:24.867638 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h9qf6"] Jun 11 13:19:24.867873 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:24.867824 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" podUID="4c29efb2-bdca-48df-a7f1-e02b236230c7" containerName="limitador" containerID="cri-o://c8eb0142288f6784251f1785669b58b37dd1aa3b835c323178d899d5c865cf49" gracePeriod=30 Jun 11 13:19:25.429110 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.429048 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" Jun 11 13:19:25.521700 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.521664 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4c29efb2-bdca-48df-a7f1-e02b236230c7-config-file\") pod \"4c29efb2-bdca-48df-a7f1-e02b236230c7\" (UID: \"4c29efb2-bdca-48df-a7f1-e02b236230c7\") " Jun 11 13:19:25.521891 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.521759 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz5pz\" (UniqueName: \"kubernetes.io/projected/4c29efb2-bdca-48df-a7f1-e02b236230c7-kube-api-access-mz5pz\") pod \"4c29efb2-bdca-48df-a7f1-e02b236230c7\" (UID: \"4c29efb2-bdca-48df-a7f1-e02b236230c7\") " Jun 11 13:19:25.522117 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.522085 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c29efb2-bdca-48df-a7f1-e02b236230c7-config-file" (OuterVolumeSpecName: "config-file") pod "4c29efb2-bdca-48df-a7f1-e02b236230c7" (UID: "4c29efb2-bdca-48df-a7f1-e02b236230c7"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:19:25.523771 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.523745 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c29efb2-bdca-48df-a7f1-e02b236230c7-kube-api-access-mz5pz" (OuterVolumeSpecName: "kube-api-access-mz5pz") pod "4c29efb2-bdca-48df-a7f1-e02b236230c7" (UID: "4c29efb2-bdca-48df-a7f1-e02b236230c7"). InnerVolumeSpecName "kube-api-access-mz5pz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:19:25.597733 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.597695 2576 generic.go:356] "Generic (PLEG): container finished" podID="4c29efb2-bdca-48df-a7f1-e02b236230c7" containerID="c8eb0142288f6784251f1785669b58b37dd1aa3b835c323178d899d5c865cf49" exitCode=0 Jun 11 13:19:25.598209 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.597739 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" Jun 11 13:19:25.598209 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.597781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" event={"ID":"4c29efb2-bdca-48df-a7f1-e02b236230c7","Type":"ContainerDied","Data":"c8eb0142288f6784251f1785669b58b37dd1aa3b835c323178d899d5c865cf49"} Jun 11 13:19:25.598209 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.597839 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9qf6" event={"ID":"4c29efb2-bdca-48df-a7f1-e02b236230c7","Type":"ContainerDied","Data":"372e8ad0d54de295584e2dcc53e25c05fc4349039ea50239d8c4912ab6155ec6"} Jun 11 13:19:25.598209 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.597866 2576 scope.go:117] "RemoveContainer" containerID="c8eb0142288f6784251f1785669b58b37dd1aa3b835c323178d899d5c865cf49" Jun 11 13:19:25.607311 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.607291 2576 scope.go:117] "RemoveContainer" containerID="c8eb0142288f6784251f1785669b58b37dd1aa3b835c323178d899d5c865cf49" Jun 11 13:19:25.607617 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:19:25.607600 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8eb0142288f6784251f1785669b58b37dd1aa3b835c323178d899d5c865cf49\": container with ID starting with c8eb0142288f6784251f1785669b58b37dd1aa3b835c323178d899d5c865cf49 not found: ID does not exist" containerID="c8eb0142288f6784251f1785669b58b37dd1aa3b835c323178d899d5c865cf49" Jun 11 13:19:25.607685 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.607626 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8eb0142288f6784251f1785669b58b37dd1aa3b835c323178d899d5c865cf49"} err="failed to get container status \"c8eb0142288f6784251f1785669b58b37dd1aa3b835c323178d899d5c865cf49\": rpc error: code = NotFound desc = could not find container \"c8eb0142288f6784251f1785669b58b37dd1aa3b835c323178d899d5c865cf49\": container with ID starting with c8eb0142288f6784251f1785669b58b37dd1aa3b835c323178d899d5c865cf49 not found: ID does not exist" Jun 11 13:19:25.621862 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.621835 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h9qf6"] Jun 11 13:19:25.622563 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.622450 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz5pz\" (UniqueName: \"kubernetes.io/projected/4c29efb2-bdca-48df-a7f1-e02b236230c7-kube-api-access-mz5pz\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:19:25.622563 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.622478 2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4c29efb2-bdca-48df-a7f1-e02b236230c7-config-file\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:19:25.624084 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:25.624066 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h9qf6"] Jun 11 13:19:26.277559 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:26.277524 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c29efb2-bdca-48df-a7f1-e02b236230c7" path="/var/lib/kubelet/pods/4c29efb2-bdca-48df-a7f1-e02b236230c7/volumes" Jun 11 13:19:31.217053 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.217021 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw"] Jun 11 13:19:31.217456 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.217395 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c29efb2-bdca-48df-a7f1-e02b236230c7" containerName="limitador" Jun 11 13:19:31.217456 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.217408 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c29efb2-bdca-48df-a7f1-e02b236230c7" containerName="limitador" Jun 11 13:19:31.217574 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.217493 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c29efb2-bdca-48df-a7f1-e02b236230c7" containerName="limitador" Jun 11 13:19:31.221974 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.221956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw" Jun 11 13:19:31.224422 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.224388 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-tjt42\"" Jun 11 13:19:31.224557 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.224393 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 11 13:19:31.225378 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.225347 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 11 13:19:31.225378 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.225362 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 11 13:19:31.228221 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.228198 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw"] Jun 11 13:19:31.274471 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.274438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlz9p\" (UniqueName: \"kubernetes.io/projected/122345f1-ce48-4f5e-9f9a-e6bbf01ccc53-kube-api-access-wlz9p\") pod \"postgres-69fb4594cf-b78kw\" (UID: \"122345f1-ce48-4f5e-9f9a-e6bbf01ccc53\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw" Jun 11 13:19:31.274650 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.274557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/122345f1-ce48-4f5e-9f9a-e6bbf01ccc53-data\") pod \"postgres-69fb4594cf-b78kw\" (UID: \"122345f1-ce48-4f5e-9f9a-e6bbf01ccc53\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw" Jun 11 13:19:31.375322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.375281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlz9p\" (UniqueName: \"kubernetes.io/projected/122345f1-ce48-4f5e-9f9a-e6bbf01ccc53-kube-api-access-wlz9p\") pod \"postgres-69fb4594cf-b78kw\" (UID: \"122345f1-ce48-4f5e-9f9a-e6bbf01ccc53\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw" Jun 11 13:19:31.375518 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.375361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/122345f1-ce48-4f5e-9f9a-e6bbf01ccc53-data\") pod \"postgres-69fb4594cf-b78kw\" (UID: \"122345f1-ce48-4f5e-9f9a-e6bbf01ccc53\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw" Jun 11 13:19:31.375725 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.375709 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/122345f1-ce48-4f5e-9f9a-e6bbf01ccc53-data\") pod \"postgres-69fb4594cf-b78kw\" (UID: \"122345f1-ce48-4f5e-9f9a-e6bbf01ccc53\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw" Jun 11 13:19:31.386906 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.386873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlz9p\" (UniqueName: \"kubernetes.io/projected/122345f1-ce48-4f5e-9f9a-e6bbf01ccc53-kube-api-access-wlz9p\") pod \"postgres-69fb4594cf-b78kw\" (UID: \"122345f1-ce48-4f5e-9f9a-e6bbf01ccc53\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw" Jun 11 13:19:31.533975 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.533941 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw" Jun 11 13:19:31.666238 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:31.666213 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw"] Jun 11 13:19:31.668113 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:19:31.668084 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122345f1_ce48_4f5e_9f9a_e6bbf01ccc53.slice/crio-62a38fcef82704d29d249372f49ae60b23d4a138cf00558d5b7c16b949c4f08c WatchSource:0}: Error finding container 62a38fcef82704d29d249372f49ae60b23d4a138cf00558d5b7c16b949c4f08c: Status 404 returned error can't find the container with id 62a38fcef82704d29d249372f49ae60b23d4a138cf00558d5b7c16b949c4f08c Jun 11 13:19:32.631180 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:32.631147 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw" event={"ID":"122345f1-ce48-4f5e-9f9a-e6bbf01ccc53","Type":"ContainerStarted","Data":"62a38fcef82704d29d249372f49ae60b23d4a138cf00558d5b7c16b949c4f08c"} Jun 11 13:19:34.641983 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:34.641949 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw" event={"ID":"122345f1-ce48-4f5e-9f9a-e6bbf01ccc53","Type":"ContainerStarted","Data":"b9b52fefae270ab4572628f8a6697c545d9290910c83c9c0c6044bda78695ecb"} Jun 11 13:19:34.642406 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:34.642022 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw" Jun 11 13:19:34.659287 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:34.659228 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw" podStartSLOduration=1.15234033 podStartE2EDuration="3.659208734s" totalImagesPullingTime="2.506868404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:19:34.656560472 +0000 UTC m=+544.802190526" watchObservedRunningTime="2026-06-11 13:19:34.659208734 +0000 UTC m=+544.804838789" Jun 11 13:19:40.675179 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:19:40.675149 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-b78kw" Jun 11 13:20:06.229269 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:06.229233 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:20:06.232758 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:06.232742 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 13:20:06.235168 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:06.235138 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 13:20:06.235304 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:06.235161 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jzz5q\"" Jun 11 13:20:06.235304 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:06.235226 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 13:20:06.235304 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:06.235139 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 13:20:06.240169 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:06.240110 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:20:06.298773 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:06.298744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc2r4\" (UniqueName: \"kubernetes.io/projected/af3f299c-37ad-4fcf-b8fb-466220851252-kube-api-access-cc2r4\") pod \"maas-keycloak-0\" (UID: \"af3f299c-37ad-4fcf-b8fb-466220851252\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:20:06.399797 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:06.399761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2r4\" (UniqueName: \"kubernetes.io/projected/af3f299c-37ad-4fcf-b8fb-466220851252-kube-api-access-cc2r4\") pod \"maas-keycloak-0\" (UID: \"af3f299c-37ad-4fcf-b8fb-466220851252\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:20:06.407553 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:06.407525 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc2r4\" (UniqueName: \"kubernetes.io/projected/af3f299c-37ad-4fcf-b8fb-466220851252-kube-api-access-cc2r4\") pod \"maas-keycloak-0\" (UID: \"af3f299c-37ad-4fcf-b8fb-466220851252\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:20:06.543667 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:06.543629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 13:20:06.682324 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:06.682300 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:20:06.684111 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:20:06.684077 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf3f299c_37ad_4fcf_b8fb_466220851252.slice/crio-0fa01f5ee8e6ba12ada8c16f268873d463415abb9b72f5f2829a17584377dd13 WatchSource:0}: Error finding container 0fa01f5ee8e6ba12ada8c16f268873d463415abb9b72f5f2829a17584377dd13: Status 404 returned error can't find the container with id 0fa01f5ee8e6ba12ada8c16f268873d463415abb9b72f5f2829a17584377dd13 Jun 11 13:20:06.786900 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:06.786870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"af3f299c-37ad-4fcf-b8fb-466220851252","Type":"ContainerStarted","Data":"0fa01f5ee8e6ba12ada8c16f268873d463415abb9b72f5f2829a17584377dd13"} Jun 11 13:20:14.829897 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:14.829858 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"af3f299c-37ad-4fcf-b8fb-466220851252","Type":"ContainerStarted","Data":"7b28e0e2bab028274ce11115151380d9f0e739cc4296886a62b85b0348e30f79"} Jun 11 13:20:14.847622 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:14.847569 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.839955296 podStartE2EDuration="8.847553945s" totalImagesPullingTime="8.007598649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:20:14.844809065 +0000 UTC m=+584.990439117" watchObservedRunningTime="2026-06-11 13:20:14.847553945 +0000 UTC m=+584.993183998" Jun 11 13:20:15.544621 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:15.544585 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 13:20:15.546424 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:15.546370 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 11 13:20:16.544574 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:16.544531 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 13:20:16.545066 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:16.545033 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 11 13:20:17.544604 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:17.544555 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 11 13:20:18.545077 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:18.545028 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 11 13:20:19.544564 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:19.544514 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 11 13:20:20.544801 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:20.544752 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 11 13:20:21.544904 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:21.544851 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 11 13:20:22.544999 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:22.544951 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 11 13:20:23.545003 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:23.544957 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 11 13:20:24.544709 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:24.544658 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 11 13:20:25.544964 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:25.544911 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 11 13:20:26.544056 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:26.544004 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 11 13:20:27.544614 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:27.544566 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 11 13:20:28.668567 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:28.668538 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 13:20:28.688044 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:28.687985 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 13:20:30.279751 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:30.279653 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:20:30.285354 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:30.285327 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:20:38.674491 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:38.674432 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 13:20:45.203695 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:45.203658 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c6bdc9778-2dpvq"] Jun 11 13:20:45.206034 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:45.206015 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" Jun 11 13:20:45.208503 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:45.208477 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 13:20:45.208610 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:45.208490 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 13:20:45.208610 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:45.208571 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-t4qnr\"" Jun 11 13:20:45.219177 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:45.219145 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c6bdc9778-2dpvq"] Jun 11 13:20:45.290188 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:45.290158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8l78\" (UniqueName: \"kubernetes.io/projected/a5f8199a-2c82-4628-ba7e-d38c95715256-kube-api-access-z8l78\") pod \"maas-controller-5c6bdc9778-2dpvq\" (UID: \"a5f8199a-2c82-4628-ba7e-d38c95715256\") " pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" Jun 11 13:20:45.290349 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:45.290220 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5f8199a-2c82-4628-ba7e-d38c95715256-webhook-cert\") pod \"maas-controller-5c6bdc9778-2dpvq\" (UID: \"a5f8199a-2c82-4628-ba7e-d38c95715256\") " pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" Jun 11 13:20:45.391445 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:45.391386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8l78\" (UniqueName: \"kubernetes.io/projected/a5f8199a-2c82-4628-ba7e-d38c95715256-kube-api-access-z8l78\") pod \"maas-controller-5c6bdc9778-2dpvq\" (UID: \"a5f8199a-2c82-4628-ba7e-d38c95715256\") " pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" Jun 11 13:20:45.391616 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:45.391489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5f8199a-2c82-4628-ba7e-d38c95715256-webhook-cert\") pod \"maas-controller-5c6bdc9778-2dpvq\" (UID: \"a5f8199a-2c82-4628-ba7e-d38c95715256\") " pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" Jun 11 13:20:45.394019 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:45.393997 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5f8199a-2c82-4628-ba7e-d38c95715256-webhook-cert\") pod \"maas-controller-5c6bdc9778-2dpvq\" (UID: \"a5f8199a-2c82-4628-ba7e-d38c95715256\") " pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" Jun 11 13:20:45.399487 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:45.399461 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8l78\" (UniqueName: \"kubernetes.io/projected/a5f8199a-2c82-4628-ba7e-d38c95715256-kube-api-access-z8l78\") pod \"maas-controller-5c6bdc9778-2dpvq\" (UID: \"a5f8199a-2c82-4628-ba7e-d38c95715256\") " pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" Jun 11 13:20:45.515731 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:45.515706 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" Jun 11 13:20:45.645974 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:45.645950 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c6bdc9778-2dpvq"] Jun 11 13:20:45.648088 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:20:45.648057 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f8199a_2c82_4628_ba7e_d38c95715256.slice/crio-7596f1bbe361df2a6cc0519bf4a1ac54a239feb191c1a529b6dda26a6f7b9297 WatchSource:0}: Error finding container 7596f1bbe361df2a6cc0519bf4a1ac54a239feb191c1a529b6dda26a6f7b9297: Status 404 returned error can't find the container with id 7596f1bbe361df2a6cc0519bf4a1ac54a239feb191c1a529b6dda26a6f7b9297 Jun 11 13:20:46.026649 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:46.026616 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" event={"ID":"a5f8199a-2c82-4628-ba7e-d38c95715256","Type":"ContainerStarted","Data":"7596f1bbe361df2a6cc0519bf4a1ac54a239feb191c1a529b6dda26a6f7b9297"} Jun 11 13:20:49.044193 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:49.044150 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" event={"ID":"a5f8199a-2c82-4628-ba7e-d38c95715256","Type":"ContainerStarted","Data":"c4ae9abfd6b7e35c8a2ab2c05dda20d3225a6c1d5d7bb83298eb31e3a973a960"} Jun 11 13:20:49.044574 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:49.044235 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" Jun 11 13:20:49.061402 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:20:49.061321 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" podStartSLOduration=1.633986291 podStartE2EDuration="4.061306408s" totalImagesPullingTime="2.427320117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:20:49.059649995 +0000 UTC m=+619.205280050" watchObservedRunningTime="2026-06-11 13:20:49.061306408 +0000 UTC m=+619.206936461" Jun 11 13:21:00.053970 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:00.053939 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" Jun 11 13:21:19.409325 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:19.409295 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv"] Jun 11 13:21:19.416580 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:19.416560 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" Jun 11 13:21:19.419171 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:19.419148 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 11 13:21:19.419451 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:19.419435 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-mhjdc\"" Jun 11 13:21:19.425591 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:19.425562 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv"] Jun 11 13:21:19.499314 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:19.499285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9njk\" (UniqueName: \"kubernetes.io/projected/b65f5510-d349-4b06-9a41-4c35dcf06568-kube-api-access-q9njk\") pod \"maas-api-56f87dd76d-wr4pv\" (UID: \"b65f5510-d349-4b06-9a41-4c35dcf06568\") " pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" Jun 11 13:21:19.499540 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:19.499348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b65f5510-d349-4b06-9a41-4c35dcf06568-openshift-service-ca\") pod \"maas-api-56f87dd76d-wr4pv\" (UID: \"b65f5510-d349-4b06-9a41-4c35dcf06568\") " pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" Jun 11 13:21:19.499540 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:19.499368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b65f5510-d349-4b06-9a41-4c35dcf06568-maas-api-tls\") pod \"maas-api-56f87dd76d-wr4pv\" (UID: \"b65f5510-d349-4b06-9a41-4c35dcf06568\") " pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" Jun 11 13:21:19.600489 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:19.600453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b65f5510-d349-4b06-9a41-4c35dcf06568-openshift-service-ca\") pod \"maas-api-56f87dd76d-wr4pv\" (UID: \"b65f5510-d349-4b06-9a41-4c35dcf06568\") " pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" Jun 11 13:21:19.600489 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:19.600494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b65f5510-d349-4b06-9a41-4c35dcf06568-maas-api-tls\") pod \"maas-api-56f87dd76d-wr4pv\" (UID: \"b65f5510-d349-4b06-9a41-4c35dcf06568\") " pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" Jun 11 13:21:19.600685 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:19.600566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9njk\" (UniqueName: \"kubernetes.io/projected/b65f5510-d349-4b06-9a41-4c35dcf06568-kube-api-access-q9njk\") pod \"maas-api-56f87dd76d-wr4pv\" (UID: \"b65f5510-d349-4b06-9a41-4c35dcf06568\") " pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" Jun 11 13:21:19.600723 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:21:19.600674 2576 secret.go:189] Couldn't get secret redhat-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 11 13:21:19.600757 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:21:19.600750 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b65f5510-d349-4b06-9a41-4c35dcf06568-maas-api-tls podName:b65f5510-d349-4b06-9a41-4c35dcf06568 nodeName:}" failed. No retries permitted until 2026-06-11 13:21:20.100732493 +0000 UTC m=+650.246362523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b65f5510-d349-4b06-9a41-4c35dcf06568-maas-api-tls") pod "maas-api-56f87dd76d-wr4pv" (UID: "b65f5510-d349-4b06-9a41-4c35dcf06568") : secret "maas-api-serving-cert" not found Jun 11 13:21:19.601168 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:19.601152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b65f5510-d349-4b06-9a41-4c35dcf06568-openshift-service-ca\") pod \"maas-api-56f87dd76d-wr4pv\" (UID: \"b65f5510-d349-4b06-9a41-4c35dcf06568\") " pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" Jun 11 13:21:19.610628 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:19.610604 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9njk\" (UniqueName: \"kubernetes.io/projected/b65f5510-d349-4b06-9a41-4c35dcf06568-kube-api-access-q9njk\") pod \"maas-api-56f87dd76d-wr4pv\" (UID: \"b65f5510-d349-4b06-9a41-4c35dcf06568\") " pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" Jun 11 13:21:20.034155 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.034117 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-cdwbl"] Jun 11 13:21:20.039194 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.039168 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-cdwbl" Jun 11 13:21:20.041534 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.041510 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 13:21:20.041640 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.041569 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pz79q\"" Jun 11 13:21:20.054314 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.054282 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-cdwbl"] Jun 11 13:21:20.105236 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.105198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsn54\" (UniqueName: \"kubernetes.io/projected/378f4751-fbbb-44a3-bcaf-90f3b7530ddb-kube-api-access-qsn54\") pod \"payload-processing-699b6cd6c-cdwbl\" (UID: \"378f4751-fbbb-44a3-bcaf-90f3b7530ddb\") " pod="openshift-ingress/payload-processing-699b6cd6c-cdwbl" Jun 11 13:21:20.105437 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.105381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b65f5510-d349-4b06-9a41-4c35dcf06568-maas-api-tls\") pod \"maas-api-56f87dd76d-wr4pv\" (UID: \"b65f5510-d349-4b06-9a41-4c35dcf06568\") " pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" Jun 11 13:21:20.108040 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.108013 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b65f5510-d349-4b06-9a41-4c35dcf06568-maas-api-tls\") pod \"maas-api-56f87dd76d-wr4pv\" (UID: \"b65f5510-d349-4b06-9a41-4c35dcf06568\") " pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" Jun 11 13:21:20.205901 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.205865 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsn54\" (UniqueName: \"kubernetes.io/projected/378f4751-fbbb-44a3-bcaf-90f3b7530ddb-kube-api-access-qsn54\") pod \"payload-processing-699b6cd6c-cdwbl\" (UID: \"378f4751-fbbb-44a3-bcaf-90f3b7530ddb\") " pod="openshift-ingress/payload-processing-699b6cd6c-cdwbl" Jun 11 13:21:20.214487 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.214459 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsn54\" (UniqueName: \"kubernetes.io/projected/378f4751-fbbb-44a3-bcaf-90f3b7530ddb-kube-api-access-qsn54\") pod \"payload-processing-699b6cd6c-cdwbl\" (UID: \"378f4751-fbbb-44a3-bcaf-90f3b7530ddb\") " pod="openshift-ingress/payload-processing-699b6cd6c-cdwbl" Jun 11 13:21:20.328286 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.328194 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" Jun 11 13:21:20.359616 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.359585 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-cdwbl" Jun 11 13:21:20.485780 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.485738 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv"] Jun 11 13:21:20.489179 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:21:20.489138 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65f5510_d349_4b06_9a41_4c35dcf06568.slice/crio-12e2df95b4fe0a075aa901fadc7a8790021e2630c6a39bcd1827acc39fed9301 WatchSource:0}: Error finding container 12e2df95b4fe0a075aa901fadc7a8790021e2630c6a39bcd1827acc39fed9301: Status 404 returned error can't find the container with id 12e2df95b4fe0a075aa901fadc7a8790021e2630c6a39bcd1827acc39fed9301 Jun 11 13:21:20.490931 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.490911 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 13:21:20.508771 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:20.508743 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-cdwbl"] Jun 11 13:21:20.510306 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:21:20.510283 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod378f4751_fbbb_44a3_bcaf_90f3b7530ddb.slice/crio-0f686868d33a6d25d9856413a2d9e63aed5db639b6057c82b3461d0193c7d16f WatchSource:0}: Error finding container 0f686868d33a6d25d9856413a2d9e63aed5db639b6057c82b3461d0193c7d16f: Status 404 returned error can't find the container with id 0f686868d33a6d25d9856413a2d9e63aed5db639b6057c82b3461d0193c7d16f Jun 11 13:21:21.196353 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:21.196311 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" event={"ID":"b65f5510-d349-4b06-9a41-4c35dcf06568","Type":"ContainerStarted","Data":"12e2df95b4fe0a075aa901fadc7a8790021e2630c6a39bcd1827acc39fed9301"} Jun 11 13:21:21.198824 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:21.198792 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-cdwbl" event={"ID":"378f4751-fbbb-44a3-bcaf-90f3b7530ddb","Type":"ContainerStarted","Data":"0f686868d33a6d25d9856413a2d9e63aed5db639b6057c82b3461d0193c7d16f"} Jun 11 13:21:24.216298 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:24.216207 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" event={"ID":"b65f5510-d349-4b06-9a41-4c35dcf06568","Type":"ContainerStarted","Data":"75f63efcca9a3c1983733ddde04a35e3fbb6ebf5a80fdc104f65f24c43ee39cd"} Jun 11 13:21:24.216772 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:24.216318 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" Jun 11 13:21:24.217941 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:24.217921 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-cdwbl" event={"ID":"378f4751-fbbb-44a3-bcaf-90f3b7530ddb","Type":"ContainerStarted","Data":"fed7e791d8adde063d604cf9383a58998311ac9d5ac1efb40c03e685c0720e94"} Jun 11 13:21:24.218060 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:24.218028 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-cdwbl" Jun 11 13:21:24.231586 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:24.231544 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" podStartSLOduration=1.917206803 podStartE2EDuration="5.231532176s" totalImagesPullingTime="3.314325373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:21:24.230844126 +0000 UTC m=+654.376474179" watchObservedRunningTime="2026-06-11 13:21:24.231532176 +0000 UTC m=+654.377162228" Jun 11 13:21:24.244936 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:24.244892 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-cdwbl" podStartSLOduration=0.950718511 podStartE2EDuration="4.244878506s" totalImagesPullingTime="3.294159995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:21:24.243759534 +0000 UTC m=+654.389389586" watchObservedRunningTime="2026-06-11 13:21:24.244878506 +0000 UTC m=+654.390508558" Jun 11 13:21:26.571594 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:26.571549 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-4qzwv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 11 13:21:26.572077 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:26.571619 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" podUID="e3a9a35c-ad6b-405e-b7f2-31e58421a643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 11 13:21:28.238842 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:28.238810 2576 generic.go:356] "Generic (PLEG): container finished" podID="e3a9a35c-ad6b-405e-b7f2-31e58421a643" containerID="38d83739309ddc0c0fc3f4318b52f0de51e7bf2140423214520031a8787a5f0f" exitCode=0 Jun 11 13:21:28.239262 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:28.238880 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" event={"ID":"e3a9a35c-ad6b-405e-b7f2-31e58421a643","Type":"ContainerDied","Data":"38d83739309ddc0c0fc3f4318b52f0de51e7bf2140423214520031a8787a5f0f"} Jun 11 13:21:28.239262 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:28.239241 2576 scope.go:117] "RemoveContainer" containerID="38d83739309ddc0c0fc3f4318b52f0de51e7bf2140423214520031a8787a5f0f" Jun 11 13:21:28.240235 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:28.240208 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:21:28.240309 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:28.240273 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:21:28.240309 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:28.240302 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:21:29.245504 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:29.245470 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" event={"ID":"e3a9a35c-ad6b-405e-b7f2-31e58421a643","Type":"ContainerStarted","Data":"79b824ea53a8898031da8d582b9477e711bde5c518164ac6afa9d493cc324da6"} Jun 11 13:21:30.081359 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:30.081317 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:21:30.081563 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:30.081507 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-4qzwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jun 11 13:21:30.081563 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:30.081546 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" podUID="e3a9a35c-ad6b-405e-b7f2-31e58421a643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jun 11 13:21:30.230006 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:30.229976 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-56f87dd76d-wr4pv" Jun 11 13:21:31.081792 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:31.081757 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-4qzwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jun 11 13:21:31.082175 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:31.081812 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" podUID="e3a9a35c-ad6b-405e-b7f2-31e58421a643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jun 11 13:21:32.081430 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:32.081370 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-4qzwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jun 11 13:21:32.081608 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:32.081468 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" podUID="e3a9a35c-ad6b-405e-b7f2-31e58421a643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jun 11 13:21:33.082011 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:33.081969 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-4qzwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jun 11 13:21:33.082525 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:33.082039 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" podUID="e3a9a35c-ad6b-405e-b7f2-31e58421a643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jun 11 13:21:34.085349 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:34.085317 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:21:34.085850 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:34.085705 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:21:34.086550 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:34.086531 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4qzwv" Jun 11 13:21:35.225625 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:21:35.225598 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-cdwbl" Jun 11 13:23:34.324277 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:34.324240 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:23:34.324858 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:34.324472 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" containerID="cri-o://7b28e0e2bab028274ce11115151380d9f0e739cc4296886a62b85b0348e30f79" gracePeriod=30 Jun 11 13:23:35.845365 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:35.845335 2576 generic.go:356] "Generic (PLEG): container finished" podID="af3f299c-37ad-4fcf-b8fb-466220851252" containerID="7b28e0e2bab028274ce11115151380d9f0e739cc4296886a62b85b0348e30f79" exitCode=143 Jun 11 13:23:35.845744 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:35.845434 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"af3f299c-37ad-4fcf-b8fb-466220851252","Type":"ContainerDied","Data":"7b28e0e2bab028274ce11115151380d9f0e739cc4296886a62b85b0348e30f79"} Jun 11 13:23:36.376396 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.376373 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 13:23:36.455335 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.455302 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc2r4\" (UniqueName: \"kubernetes.io/projected/af3f299c-37ad-4fcf-b8fb-466220851252-kube-api-access-cc2r4\") pod \"af3f299c-37ad-4fcf-b8fb-466220851252\" (UID: \"af3f299c-37ad-4fcf-b8fb-466220851252\") " Jun 11 13:23:36.457445 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.457396 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af3f299c-37ad-4fcf-b8fb-466220851252-kube-api-access-cc2r4" (OuterVolumeSpecName: "kube-api-access-cc2r4") pod "af3f299c-37ad-4fcf-b8fb-466220851252" (UID: "af3f299c-37ad-4fcf-b8fb-466220851252"). InnerVolumeSpecName "kube-api-access-cc2r4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:23:36.555983 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.555951 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc2r4\" (UniqueName: \"kubernetes.io/projected/af3f299c-37ad-4fcf-b8fb-466220851252-kube-api-access-cc2r4\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:23:36.851529 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.851454 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 13:23:36.851529 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.851476 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"af3f299c-37ad-4fcf-b8fb-466220851252","Type":"ContainerDied","Data":"0fa01f5ee8e6ba12ada8c16f268873d463415abb9b72f5f2829a17584377dd13"} Jun 11 13:23:36.851986 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.851539 2576 scope.go:117] "RemoveContainer" containerID="7b28e0e2bab028274ce11115151380d9f0e739cc4296886a62b85b0348e30f79" Jun 11 13:23:36.871965 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.871936 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:23:36.873679 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.873658 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:23:36.896469 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.896443 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:23:36.896822 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.896809 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" Jun 11 13:23:36.896872 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.896823 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" Jun 11 13:23:36.896910 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.896890 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" containerName="keycloak" Jun 11 13:23:36.901335 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.901318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 13:23:36.903704 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.903682 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 13:23:36.903808 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.903685 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jzz5q\"" Jun 11 13:23:36.903808 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.903765 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 13:23:36.903808 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.903690 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 13:23:36.903808 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.903790 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 13:23:36.908643 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.908623 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:23:36.958529 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.958495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l976\" (UniqueName: \"kubernetes.io/projected/dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895-kube-api-access-9l976\") pod \"maas-keycloak-0\" (UID: \"dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:23:36.958671 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:36.958552 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895-test-realms\") pod \"maas-keycloak-0\" (UID: \"dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:23:37.059888 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:37.059852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l976\" (UniqueName: \"kubernetes.io/projected/dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895-kube-api-access-9l976\") pod \"maas-keycloak-0\" (UID: \"dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:23:37.060073 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:37.059913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895-test-realms\") pod \"maas-keycloak-0\" (UID: \"dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:23:37.060764 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:37.060742 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895-test-realms\") pod \"maas-keycloak-0\" (UID: \"dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:23:37.068160 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:37.068139 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l976\" (UniqueName: \"kubernetes.io/projected/dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895-kube-api-access-9l976\") pod \"maas-keycloak-0\" (UID: \"dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:23:37.211708 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:37.211622 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 13:23:37.342427 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:37.342358 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:23:37.344762 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:23:37.344732 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa5b3e3_e0fa_4039_ba8f_4c05d66c6895.slice/crio-48efe023dd9f1c15d78a42027607559529c7a0d81f087be981992475b7b89b9a WatchSource:0}: Error finding container 48efe023dd9f1c15d78a42027607559529c7a0d81f087be981992475b7b89b9a: Status 404 returned error can't find the container with id 48efe023dd9f1c15d78a42027607559529c7a0d81f087be981992475b7b89b9a Jun 11 13:23:37.864612 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:37.864559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895","Type":"ContainerStarted","Data":"a94a76d7c8080a0b231e156cf49203b4236e79f84dbc3fff375d56f94eb4cfcc"} Jun 11 13:23:37.865097 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:37.864648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895","Type":"ContainerStarted","Data":"48efe023dd9f1c15d78a42027607559529c7a0d81f087be981992475b7b89b9a"} Jun 11 13:23:37.883488 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:37.883438 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.5544706929999998 podStartE2EDuration="1.883394588s" totalImagesPullingTime="328.923895ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:23:37.881635347 +0000 UTC m=+788.027265401" watchObservedRunningTime="2026-06-11 13:23:37.883394588 +0000 UTC m=+788.029024642" Jun 11 13:23:38.211869 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:38.211837 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 13:23:38.213335 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:38.213303 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 11 13:23:38.280408 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:38.280372 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af3f299c-37ad-4fcf-b8fb-466220851252" path="/var/lib/kubelet/pods/af3f299c-37ad-4fcf-b8fb-466220851252/volumes" Jun 11 13:23:39.213510 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:39.213051 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 11 13:23:40.212507 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:40.212449 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 11 13:23:41.212385 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:41.212327 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 11 13:23:42.212307 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:42.212263 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 11 13:23:43.212527 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:43.212474 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 11 13:23:44.212290 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:44.212235 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 11 13:23:45.213019 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:45.212968 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 11 13:23:46.212830 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:46.212779 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 11 13:23:47.212368 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:47.212326 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 13:23:47.212796 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:47.212711 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 11 13:23:48.212320 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:48.212274 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 11 13:23:49.212755 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:49.212661 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 11 13:23:50.212732 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:50.212695 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 11 13:23:51.321242 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:51.321197 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 13:23:51.336335 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:23:51.336288 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="dfa5b3e3-e0fa-4039-ba8f-4c05d66c6895" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 13:24:01.328519 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:01.328483 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 13:24:33.051344 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.051311 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl"] Jun 11 13:24:33.057004 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.056982 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.059574 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.059549 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 13:24:33.060451 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.060406 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 13:24:33.060575 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.060533 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 13:24:33.060575 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.060535 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bvk66\"" Jun 11 13:24:33.065625 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.065604 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl"] Jun 11 13:24:33.191074 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.191038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad4cc21f-417c-4fe0-9bf2-74443418db6a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.191248 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.191084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad4cc21f-417c-4fe0-9bf2-74443418db6a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.191248 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.191117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpt27\" (UniqueName: \"kubernetes.io/projected/ad4cc21f-417c-4fe0-9bf2-74443418db6a-kube-api-access-vpt27\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.191248 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.191141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad4cc21f-417c-4fe0-9bf2-74443418db6a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.191248 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.191172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ad4cc21f-417c-4fe0-9bf2-74443418db6a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.191397 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.191282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad4cc21f-417c-4fe0-9bf2-74443418db6a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.292018 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.291987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ad4cc21f-417c-4fe0-9bf2-74443418db6a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.292224 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.292068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad4cc21f-417c-4fe0-9bf2-74443418db6a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.292224 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.292120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad4cc21f-417c-4fe0-9bf2-74443418db6a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.292224 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.292161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad4cc21f-417c-4fe0-9bf2-74443418db6a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.292224 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.292190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpt27\" (UniqueName: \"kubernetes.io/projected/ad4cc21f-417c-4fe0-9bf2-74443418db6a-kube-api-access-vpt27\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.292466 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.292223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad4cc21f-417c-4fe0-9bf2-74443418db6a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.292531 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.292461 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ad4cc21f-417c-4fe0-9bf2-74443418db6a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.292587 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.292540 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad4cc21f-417c-4fe0-9bf2-74443418db6a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.292658 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.292634 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad4cc21f-417c-4fe0-9bf2-74443418db6a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.294489 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.294472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad4cc21f-417c-4fe0-9bf2-74443418db6a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.294619 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.294600 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad4cc21f-417c-4fe0-9bf2-74443418db6a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.300444 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.300425 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpt27\" (UniqueName: \"kubernetes.io/projected/ad4cc21f-417c-4fe0-9bf2-74443418db6a-kube-api-access-vpt27\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl\" (UID: \"ad4cc21f-417c-4fe0-9bf2-74443418db6a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.368795 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.368705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:33.515186 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:33.515159 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl"] Jun 11 13:24:33.518042 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:24:33.518014 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4cc21f_417c_4fe0_9bf2_74443418db6a.slice/crio-78a625166e58f4a0e7667c5e9a06d442c3451f3e3988f2059ea8c2eee5a481a5 WatchSource:0}: Error finding container 78a625166e58f4a0e7667c5e9a06d442c3451f3e3988f2059ea8c2eee5a481a5: Status 404 returned error can't find the container with id 78a625166e58f4a0e7667c5e9a06d442c3451f3e3988f2059ea8c2eee5a481a5 Jun 11 13:24:34.180099 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:34.180053 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" event={"ID":"ad4cc21f-417c-4fe0-9bf2-74443418db6a","Type":"ContainerStarted","Data":"78a625166e58f4a0e7667c5e9a06d442c3451f3e3988f2059ea8c2eee5a481a5"} Jun 11 13:24:36.665556 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.665519 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc"] Jun 11 13:24:36.673847 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.673820 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.677277 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.677120 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 13:24:36.677277 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.677232 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc"] Jun 11 13:24:36.724390 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.724353 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.724596 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.724426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.724596 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.724508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.724596 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.724585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.724735 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.724650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs8cg\" (UniqueName: \"kubernetes.io/projected/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-kube-api-access-qs8cg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.724781 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.724733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.825933 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.825893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.826114 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.825970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.826114 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.826012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.826114 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.826047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.826114 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.826101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.826379 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.826153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs8cg\" (UniqueName: \"kubernetes.io/projected/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-kube-api-access-qs8cg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.826452 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.826372 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.826522 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.826485 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.826622 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.826577 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.828802 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.828759 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.829107 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.829078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.835491 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.835443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs8cg\" (UniqueName: \"kubernetes.io/projected/2f9a956c-3f33-4b3d-b5fc-1e2ea218e955-kube-api-access-qs8cg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-46qdc\" (UID: \"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:36.990401 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:36.990309 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:24:37.538116 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:37.538087 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc"] Jun 11 13:24:37.539556 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:24:37.539529 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9a956c_3f33_4b3d_b5fc_1e2ea218e955.slice/crio-6ce715cc61224e2d73aa2ab5dd4a79c44a8e777d4677d61ff63b3e0ce3ed7f96 WatchSource:0}: Error finding container 6ce715cc61224e2d73aa2ab5dd4a79c44a8e777d4677d61ff63b3e0ce3ed7f96: Status 404 returned error can't find the container with id 6ce715cc61224e2d73aa2ab5dd4a79c44a8e777d4677d61ff63b3e0ce3ed7f96 Jun 11 13:24:38.203984 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:38.203936 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" event={"ID":"ad4cc21f-417c-4fe0-9bf2-74443418db6a","Type":"ContainerStarted","Data":"91f5654f34f2cb26730ee240d26e641b38902aa6cf2e134f4e1338993601b567"} Jun 11 13:24:38.205334 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:38.205310 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" event={"ID":"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955","Type":"ContainerStarted","Data":"de1e02a9fc9e91f5610d3c7676853c805dd0f8157245e3247f2950cc025b8747"} Jun 11 13:24:38.205403 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:38.205350 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" event={"ID":"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955","Type":"ContainerStarted","Data":"6ce715cc61224e2d73aa2ab5dd4a79c44a8e777d4677d61ff63b3e0ce3ed7f96"} Jun 11 13:24:39.212065 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:39.212030 2576 generic.go:356] "Generic (PLEG): container finished" podID="ad4cc21f-417c-4fe0-9bf2-74443418db6a" containerID="91f5654f34f2cb26730ee240d26e641b38902aa6cf2e134f4e1338993601b567" exitCode=0 Jun 11 13:24:39.212582 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:39.212077 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" event={"ID":"ad4cc21f-417c-4fe0-9bf2-74443418db6a","Type":"ContainerDied","Data":"91f5654f34f2cb26730ee240d26e641b38902aa6cf2e134f4e1338993601b567"} Jun 11 13:24:41.223352 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:41.223316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" event={"ID":"ad4cc21f-417c-4fe0-9bf2-74443418db6a","Type":"ContainerStarted","Data":"2dda430adcea5cbc483b5419f567bf048d8b019d689a81ddcf105331f0a2a86f"} Jun 11 13:24:41.243891 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:41.243845 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" podStartSLOduration=1.407320928 podStartE2EDuration="8.243829758s" totalImagesPullingTime="5.399979365s" totalInitContainerRuntime="1.436529465s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:24:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:24:41.241780862 +0000 UTC m=+851.387410915" watchObservedRunningTime="2026-06-11 13:24:41.243829758 +0000 UTC m=+851.389459812" Jun 11 13:24:43.369863 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:43.369819 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:43.370238 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:43.369895 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:43.382667 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:43.382640 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:44.248364 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:44.248330 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl" Jun 11 13:24:56.293045 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:56.293012 2576 generic.go:356] "Generic (PLEG): container finished" podID="2f9a956c-3f33-4b3d-b5fc-1e2ea218e955" containerID="de1e02a9fc9e91f5610d3c7676853c805dd0f8157245e3247f2950cc025b8747" exitCode=0 Jun 11 13:24:56.293394 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:56.293077 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" event={"ID":"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955","Type":"ContainerDied","Data":"de1e02a9fc9e91f5610d3c7676853c805dd0f8157245e3247f2950cc025b8747"} Jun 11 13:24:57.299607 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:57.299571 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" event={"ID":"2f9a956c-3f33-4b3d-b5fc-1e2ea218e955","Type":"ContainerStarted","Data":"4cc7f4bcc51140ee661288fe61d1abfdae5c479fe1eb53893eab052890dcbcb2"} Jun 11 13:24:57.318559 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:24:57.318511 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" podStartSLOduration=2.982293247 podStartE2EDuration="21.318495984s" totalImagesPullingTime="277.108083ms" totalInitContainerRuntime="18.059094654s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:24:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:24:57.316837641 +0000 UTC m=+867.462467704" watchObservedRunningTime="2026-06-11 13:24:57.318495984 +0000 UTC m=+867.464126036" Jun 11 13:25:06.990761 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:06.990724 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:25:06.991303 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:06.991044 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:25:07.003514 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:07.003494 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:25:07.361338 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:07.361310 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-46qdc" Jun 11 13:25:18.855448 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:18.855391 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm"] Jun 11 13:25:18.859184 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:18.859165 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:18.862402 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:18.862379 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 13:25:18.868025 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:18.867999 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm"] Jun 11 13:25:18.933497 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:18.933469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38fd8584-5c2f-4295-8e0b-98a5c1546efa-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:18.933632 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:18.933530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38fd8584-5c2f-4295-8e0b-98a5c1546efa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:18.933705 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:18.933625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7px58\" (UniqueName: \"kubernetes.io/projected/38fd8584-5c2f-4295-8e0b-98a5c1546efa-kube-api-access-7px58\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:18.933705 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:18.933678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38fd8584-5c2f-4295-8e0b-98a5c1546efa-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:18.933816 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:18.933797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/38fd8584-5c2f-4295-8e0b-98a5c1546efa-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:18.933871 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:18.933837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38fd8584-5c2f-4295-8e0b-98a5c1546efa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:19.035105 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.035069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38fd8584-5c2f-4295-8e0b-98a5c1546efa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:19.035298 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.035113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7px58\" (UniqueName: \"kubernetes.io/projected/38fd8584-5c2f-4295-8e0b-98a5c1546efa-kube-api-access-7px58\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:19.035298 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.035149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38fd8584-5c2f-4295-8e0b-98a5c1546efa-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:19.035455 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.035326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/38fd8584-5c2f-4295-8e0b-98a5c1546efa-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:19.035455 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.035370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38fd8584-5c2f-4295-8e0b-98a5c1546efa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:19.035455 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.035406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38fd8584-5c2f-4295-8e0b-98a5c1546efa-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:19.035813 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.035786 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38fd8584-5c2f-4295-8e0b-98a5c1546efa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:19.035897 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.035825 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/38fd8584-5c2f-4295-8e0b-98a5c1546efa-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:19.035897 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.035835 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38fd8584-5c2f-4295-8e0b-98a5c1546efa-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:19.037584 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.037564 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38fd8584-5c2f-4295-8e0b-98a5c1546efa-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:19.037843 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.037827 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38fd8584-5c2f-4295-8e0b-98a5c1546efa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:19.042372 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.042353 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7px58\" (UniqueName: \"kubernetes.io/projected/38fd8584-5c2f-4295-8e0b-98a5c1546efa-kube-api-access-7px58\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xrftm\" (UID: \"38fd8584-5c2f-4295-8e0b-98a5c1546efa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:19.188255 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.188135 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:25:19.322717 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.322692 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm"] Jun 11 13:25:19.325314 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:25:19.325289 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38fd8584_5c2f_4295_8e0b_98a5c1546efa.slice/crio-e0db8bd69f078c9f4c1ba26a02f1a58fa8a3a7b05a14edd73cd8b16d8ed302f3 WatchSource:0}: Error finding container e0db8bd69f078c9f4c1ba26a02f1a58fa8a3a7b05a14edd73cd8b16d8ed302f3: Status 404 returned error can't find the container with id e0db8bd69f078c9f4c1ba26a02f1a58fa8a3a7b05a14edd73cd8b16d8ed302f3 Jun 11 13:25:19.407302 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.407268 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" event={"ID":"38fd8584-5c2f-4295-8e0b-98a5c1546efa","Type":"ContainerStarted","Data":"10449c5b458d6a5c7b15ffcd206777c5513b40ee7d6530baddc6e9799e2d917f"} Jun 11 13:25:19.407499 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:19.407312 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" event={"ID":"38fd8584-5c2f-4295-8e0b-98a5c1546efa","Type":"ContainerStarted","Data":"e0db8bd69f078c9f4c1ba26a02f1a58fa8a3a7b05a14edd73cd8b16d8ed302f3"} Jun 11 13:25:30.321137 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:30.321109 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:25:30.321648 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:25:30.321262 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:26:13.674451 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:26:13.674388 2576 generic.go:356] "Generic (PLEG): container finished" podID="38fd8584-5c2f-4295-8e0b-98a5c1546efa" containerID="10449c5b458d6a5c7b15ffcd206777c5513b40ee7d6530baddc6e9799e2d917f" exitCode=0 Jun 11 13:26:13.674451 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:26:13.674453 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" event={"ID":"38fd8584-5c2f-4295-8e0b-98a5c1546efa","Type":"ContainerDied","Data":"10449c5b458d6a5c7b15ffcd206777c5513b40ee7d6530baddc6e9799e2d917f"} Jun 11 13:26:14.680741 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:26:14.680705 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" event={"ID":"38fd8584-5c2f-4295-8e0b-98a5c1546efa","Type":"ContainerStarted","Data":"e0b25fccb530fb61c9f72e1dfc2167b62784b6c674feaf943368fffd378e0b27"} Jun 11 13:26:14.703625 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:26:14.703572 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" podStartSLOduration=2.793748848 podStartE2EDuration="56.703556006s" totalImagesPullingTime="242.225409ms" totalInitContainerRuntime="53.667581749s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:14.701493511 +0000 UTC m=+944.847123565" watchObservedRunningTime="2026-06-11 13:26:14.703556006 +0000 UTC m=+944.849186058" Jun 11 13:26:19.188665 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:26:19.188636 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:26:19.189094 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:26:19.188678 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:26:19.201403 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:26:19.201379 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:26:19.715678 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:26:19.715647 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xrftm" Jun 11 13:27:54.316370 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:54.316330 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c6bdc9778-2dpvq"] Jun 11 13:27:54.317038 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:54.316625 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" podUID="a5f8199a-2c82-4628-ba7e-d38c95715256" containerName="manager" containerID="cri-o://c4ae9abfd6b7e35c8a2ab2c05dda20d3225a6c1d5d7bb83298eb31e3a973a960" gracePeriod=30 Jun 11 13:27:54.574255 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:54.574192 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" Jun 11 13:27:54.620391 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:54.620363 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5f8199a-2c82-4628-ba7e-d38c95715256-webhook-cert\") pod \"a5f8199a-2c82-4628-ba7e-d38c95715256\" (UID: \"a5f8199a-2c82-4628-ba7e-d38c95715256\") " Jun 11 13:27:54.620575 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:54.620471 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8l78\" (UniqueName: \"kubernetes.io/projected/a5f8199a-2c82-4628-ba7e-d38c95715256-kube-api-access-z8l78\") pod \"a5f8199a-2c82-4628-ba7e-d38c95715256\" (UID: \"a5f8199a-2c82-4628-ba7e-d38c95715256\") " Jun 11 13:27:54.622593 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:54.622561 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5f8199a-2c82-4628-ba7e-d38c95715256-kube-api-access-z8l78" (OuterVolumeSpecName: "kube-api-access-z8l78") pod "a5f8199a-2c82-4628-ba7e-d38c95715256" (UID: "a5f8199a-2c82-4628-ba7e-d38c95715256"). InnerVolumeSpecName "kube-api-access-z8l78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:27:54.622715 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:54.622628 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5f8199a-2c82-4628-ba7e-d38c95715256-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a5f8199a-2c82-4628-ba7e-d38c95715256" (UID: "a5f8199a-2c82-4628-ba7e-d38c95715256"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:27:54.722134 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:54.722092 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5f8199a-2c82-4628-ba7e-d38c95715256-webhook-cert\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:27:54.722134 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:54.722131 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8l78\" (UniqueName: \"kubernetes.io/projected/a5f8199a-2c82-4628-ba7e-d38c95715256-kube-api-access-z8l78\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:27:55.175557 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:55.175515 2576 generic.go:356] "Generic (PLEG): container finished" podID="a5f8199a-2c82-4628-ba7e-d38c95715256" containerID="c4ae9abfd6b7e35c8a2ab2c05dda20d3225a6c1d5d7bb83298eb31e3a973a960" exitCode=0 Jun 11 13:27:55.175557 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:55.175556 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" Jun 11 13:27:55.175757 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:55.175598 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" event={"ID":"a5f8199a-2c82-4628-ba7e-d38c95715256","Type":"ContainerDied","Data":"c4ae9abfd6b7e35c8a2ab2c05dda20d3225a6c1d5d7bb83298eb31e3a973a960"} Jun 11 13:27:55.175757 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:55.175651 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6bdc9778-2dpvq" event={"ID":"a5f8199a-2c82-4628-ba7e-d38c95715256","Type":"ContainerDied","Data":"7596f1bbe361df2a6cc0519bf4a1ac54a239feb191c1a529b6dda26a6f7b9297"} Jun 11 13:27:55.175757 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:55.175677 2576 scope.go:117] "RemoveContainer" containerID="c4ae9abfd6b7e35c8a2ab2c05dda20d3225a6c1d5d7bb83298eb31e3a973a960" Jun 11 13:27:55.184948 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:55.184931 2576 scope.go:117] "RemoveContainer" containerID="c4ae9abfd6b7e35c8a2ab2c05dda20d3225a6c1d5d7bb83298eb31e3a973a960" Jun 11 13:27:55.185185 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:27:55.185167 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4ae9abfd6b7e35c8a2ab2c05dda20d3225a6c1d5d7bb83298eb31e3a973a960\": container with ID starting with c4ae9abfd6b7e35c8a2ab2c05dda20d3225a6c1d5d7bb83298eb31e3a973a960 not found: ID does not exist" containerID="c4ae9abfd6b7e35c8a2ab2c05dda20d3225a6c1d5d7bb83298eb31e3a973a960" Jun 11 13:27:55.185236 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:55.185194 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ae9abfd6b7e35c8a2ab2c05dda20d3225a6c1d5d7bb83298eb31e3a973a960"} err="failed to get container status \"c4ae9abfd6b7e35c8a2ab2c05dda20d3225a6c1d5d7bb83298eb31e3a973a960\": rpc error: code = NotFound desc = could not find container \"c4ae9abfd6b7e35c8a2ab2c05dda20d3225a6c1d5d7bb83298eb31e3a973a960\": container with ID starting with c4ae9abfd6b7e35c8a2ab2c05dda20d3225a6c1d5d7bb83298eb31e3a973a960 not found: ID does not exist" Jun 11 13:27:55.197982 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:55.197960 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c6bdc9778-2dpvq"] Jun 11 13:27:55.201698 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:55.201673 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c6bdc9778-2dpvq"] Jun 11 13:27:56.062801 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.062768 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c6bdc9778-fhj4v"] Jun 11 13:27:56.063182 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.063153 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5f8199a-2c82-4628-ba7e-d38c95715256" containerName="manager" Jun 11 13:27:56.063182 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.063164 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5f8199a-2c82-4628-ba7e-d38c95715256" containerName="manager" Jun 11 13:27:56.063248 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.063232 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5f8199a-2c82-4628-ba7e-d38c95715256" containerName="manager" Jun 11 13:27:56.067403 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.067387 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6bdc9778-fhj4v" Jun 11 13:27:56.069897 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.069877 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 13:27:56.071213 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.071191 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 13:27:56.071455 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.071439 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-t4qnr\"" Jun 11 13:27:56.073779 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.073760 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c6bdc9778-fhj4v"] Jun 11 13:27:56.137047 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.137012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h6dw\" (UniqueName: \"kubernetes.io/projected/d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f-kube-api-access-6h6dw\") pod \"maas-controller-5c6bdc9778-fhj4v\" (UID: \"d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f\") " pod="opendatahub/maas-controller-5c6bdc9778-fhj4v" Jun 11 13:27:56.137206 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.137056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f-webhook-cert\") pod \"maas-controller-5c6bdc9778-fhj4v\" (UID: \"d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f\") " pod="opendatahub/maas-controller-5c6bdc9778-fhj4v" Jun 11 13:27:56.237839 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.237813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h6dw\" (UniqueName: \"kubernetes.io/projected/d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f-kube-api-access-6h6dw\") pod \"maas-controller-5c6bdc9778-fhj4v\" (UID: \"d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f\") " pod="opendatahub/maas-controller-5c6bdc9778-fhj4v" Jun 11 13:27:56.238014 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.237850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f-webhook-cert\") pod \"maas-controller-5c6bdc9778-fhj4v\" (UID: \"d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f\") " pod="opendatahub/maas-controller-5c6bdc9778-fhj4v" Jun 11 13:27:56.240296 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.240274 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f-webhook-cert\") pod \"maas-controller-5c6bdc9778-fhj4v\" (UID: \"d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f\") " pod="opendatahub/maas-controller-5c6bdc9778-fhj4v" Jun 11 13:27:56.245614 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.245595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h6dw\" (UniqueName: \"kubernetes.io/projected/d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f-kube-api-access-6h6dw\") pod \"maas-controller-5c6bdc9778-fhj4v\" (UID: \"d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f\") " pod="opendatahub/maas-controller-5c6bdc9778-fhj4v" Jun 11 13:27:56.278261 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.278231 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5f8199a-2c82-4628-ba7e-d38c95715256" path="/var/lib/kubelet/pods/a5f8199a-2c82-4628-ba7e-d38c95715256/volumes" Jun 11 13:27:56.378847 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.378769 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6bdc9778-fhj4v" Jun 11 13:27:56.515337 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.515310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c6bdc9778-fhj4v"] Jun 11 13:27:56.517244 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:27:56.517217 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd209f7a8_ee5b_4c0c_87fe_a7fea8decb3f.slice/crio-728e7a9250ab331a0ab5f96536c885a895d8bf40c0992f9980e0ec7747ac63a2 WatchSource:0}: Error finding container 728e7a9250ab331a0ab5f96536c885a895d8bf40c0992f9980e0ec7747ac63a2: Status 404 returned error can't find the container with id 728e7a9250ab331a0ab5f96536c885a895d8bf40c0992f9980e0ec7747ac63a2 Jun 11 13:27:56.518568 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:56.518547 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 13:27:57.190013 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:57.189974 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6bdc9778-fhj4v" event={"ID":"d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f","Type":"ContainerStarted","Data":"efdf4d8b2807042308b1e2362ebe1c82ca674594e609e6cab8e9b7eace246288"} Jun 11 13:27:57.190371 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:57.190036 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6bdc9778-fhj4v" event={"ID":"d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f","Type":"ContainerStarted","Data":"728e7a9250ab331a0ab5f96536c885a895d8bf40c0992f9980e0ec7747ac63a2"} Jun 11 13:27:57.190371 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:57.190061 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c6bdc9778-fhj4v" Jun 11 13:27:57.207963 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:27:57.207884 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c6bdc9778-fhj4v" podStartSLOduration=0.776660957 podStartE2EDuration="1.207866938s" totalImagesPullingTime="431.205981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:27:57.206193579 +0000 UTC m=+1047.351823632" watchObservedRunningTime="2026-06-11 13:27:57.207866938 +0000 UTC m=+1047.353496991" Jun 11 13:28:08.201083 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:28:08.201049 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c6bdc9778-fhj4v" Jun 11 13:30:30.353123 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:30:30.353095 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:30:30.354155 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:30:30.354136 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:35:30.398217 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:35:30.398191 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:35:30.400337 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:35:30.400314 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:40:30.429807 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:40:30.429776 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:40:30.434802 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:40:30.434780 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:45:30.461686 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:45:30.461608 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:45:30.476006 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:45:30.475975 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:47:37.923652 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:37.923619 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz"] Jun 11 13:47:37.927524 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:37.927499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:37.929831 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:37.929811 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5ca380ca-openshift-default-dockercfg-w4r8j\"" Jun 11 13:47:37.939458 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:37.939436 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz"] Jun 11 13:47:38.049290 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.049256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-token\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.049473 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.049295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istiod-ca-cert\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.049473 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.049319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-podinfo\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.049473 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.049405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-data\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.049473 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.049444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-workload-certs\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.049616 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.049471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdplt\" (UniqueName: \"kubernetes.io/projected/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-kube-api-access-sdplt\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.049616 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.049550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-credential-socket\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.049616 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.049584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-workload-socket\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.049716 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.049660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-envoy\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.151099 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.151056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-envoy\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.151278 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.151126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-token\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.151278 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.151156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istiod-ca-cert\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.151278 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.151183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-podinfo\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.151278 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.151239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-data\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.151278 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.151267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-workload-certs\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.151827 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.151758 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-data\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.151827 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.151793 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-workload-certs\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.152081 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.152014 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdplt\" (UniqueName: \"kubernetes.io/projected/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-kube-api-access-sdplt\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.152160 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.152079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-credential-socket\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.152160 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.152114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-workload-socket\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.152663 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.152529 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-credential-socket\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.152821 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.152629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-workload-socket\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.153040 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.152651 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istiod-ca-cert\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.154060 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.154031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-envoy\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.154764 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.154741 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-podinfo\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.161819 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.161762 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-token\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.161944 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.161920 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdplt\" (UniqueName: \"kubernetes.io/projected/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-kube-api-access-sdplt\") pod \"e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.241322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.241235 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:38.386022 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.385999 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz"] Jun 11 13:47:38.387828 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:47:38.387796 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dfaa7fd_72f8_4355_b4dd_fc10b91abeb1.slice/crio-cdf36160d0299d77de19db2dad10523227f523deed6704ae762204025d44b02b WatchSource:0}: Error finding container cdf36160d0299d77de19db2dad10523227f523deed6704ae762204025d44b02b: Status 404 returned error can't find the container with id cdf36160d0299d77de19db2dad10523227f523deed6704ae762204025d44b02b Jun 11 13:47:38.389994 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.389964 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:47:38.390056 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.390028 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:47:38.390095 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:38.390055 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:47:39.118019 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:39.117983 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" event={"ID":"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1","Type":"ContainerStarted","Data":"7ee4a1b54cc05f59c645bd1126d4282b64fda5282903180b9bf1a5f54fd738a5"} Jun 11 13:47:39.118535 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:39.118042 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" event={"ID":"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1","Type":"ContainerStarted","Data":"cdf36160d0299d77de19db2dad10523227f523deed6704ae762204025d44b02b"} Jun 11 13:47:39.139940 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:39.139879 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" podStartSLOduration=2.139861664 podStartE2EDuration="2.139861664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:47:39.137506303 +0000 UTC m=+2229.283136357" watchObservedRunningTime="2026-06-11 13:47:39.139861664 +0000 UTC m=+2229.285491717" Jun 11 13:47:39.241974 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:39.241937 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:39.256453 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:39.256401 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:40.123045 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:40.123015 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:40.123923 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:40.123904 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:44.654973 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:44.654941 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz"] Jun 11 13:47:44.655494 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:44.655142 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" podUID="7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" containerName="istio-proxy" containerID="cri-o://7ee4a1b54cc05f59c645bd1126d4282b64fda5282903180b9bf1a5f54fd738a5" gracePeriod=30 Jun 11 13:47:49.910034 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:49.910010 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:50.069794 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.069758 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdplt\" (UniqueName: \"kubernetes.io/projected/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-kube-api-access-sdplt\") pod \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " Jun 11 13:47:50.069987 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.069818 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-envoy\") pod \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " Jun 11 13:47:50.069987 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.069858 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-workload-certs\") pod \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " Jun 11 13:47:50.069987 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.069897 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-podinfo\") pod \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " Jun 11 13:47:50.069987 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.069935 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-credential-socket\") pod \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " Jun 11 13:47:50.069987 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.069971 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-workload-socket\") pod \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " Jun 11 13:47:50.070334 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.070012 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-token\") pod \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " Jun 11 13:47:50.070334 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.070041 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istiod-ca-cert\") pod \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " Jun 11 13:47:50.070334 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.070079 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-data\") pod \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\" (UID: \"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1\") " Jun 11 13:47:50.070334 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.070192 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" (UID: "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:47:50.070555 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.070402 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-data" (OuterVolumeSpecName: "istio-data") pod "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" (UID: "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:47:50.070555 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.070346 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" (UID: "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:47:50.070662 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.070568 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-data\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:47:50.070662 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.070586 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-workload-certs\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:47:50.070662 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.070614 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-credential-socket\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:47:50.070662 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.070610 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" (UID: "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:47:50.070920 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.070894 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" (UID: "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:47:50.072420 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.072371 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" (UID: "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:47:50.072528 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.072494 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-kube-api-access-sdplt" (OuterVolumeSpecName: "kube-api-access-sdplt") pod "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" (UID: "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1"). InnerVolumeSpecName "kube-api-access-sdplt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:47:50.072528 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.072495 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" (UID: "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 13:47:50.072653 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.072632 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-token" (OuterVolumeSpecName: "istio-token") pod "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" (UID: "7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:47:50.172098 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.172072 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdplt\" (UniqueName: \"kubernetes.io/projected/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-kube-api-access-sdplt\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:47:50.172098 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.172101 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-envoy\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:47:50.172353 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.172122 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-podinfo\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:47:50.172353 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.172138 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-workload-socket\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:47:50.172353 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.172147 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istio-token\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:47:50.172353 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.172154 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1-istiod-ca-cert\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:47:50.180896 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.180867 2576 generic.go:356] "Generic (PLEG): container finished" podID="7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" containerID="7ee4a1b54cc05f59c645bd1126d4282b64fda5282903180b9bf1a5f54fd738a5" exitCode=0 Jun 11 13:47:50.181011 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.180907 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" event={"ID":"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1","Type":"ContainerDied","Data":"7ee4a1b54cc05f59c645bd1126d4282b64fda5282903180b9bf1a5f54fd738a5"} Jun 11 13:47:50.181011 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.180921 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" Jun 11 13:47:50.181011 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.180960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz" event={"ID":"7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1","Type":"ContainerDied","Data":"cdf36160d0299d77de19db2dad10523227f523deed6704ae762204025d44b02b"} Jun 11 13:47:50.181011 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.180990 2576 scope.go:117] "RemoveContainer" containerID="7ee4a1b54cc05f59c645bd1126d4282b64fda5282903180b9bf1a5f54fd738a5" Jun 11 13:47:50.197959 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.197932 2576 scope.go:117] "RemoveContainer" containerID="7ee4a1b54cc05f59c645bd1126d4282b64fda5282903180b9bf1a5f54fd738a5" Jun 11 13:47:50.198251 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:47:50.198231 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ee4a1b54cc05f59c645bd1126d4282b64fda5282903180b9bf1a5f54fd738a5\": container with ID starting with 7ee4a1b54cc05f59c645bd1126d4282b64fda5282903180b9bf1a5f54fd738a5 not found: ID does not exist" containerID="7ee4a1b54cc05f59c645bd1126d4282b64fda5282903180b9bf1a5f54fd738a5" Jun 11 13:47:50.198322 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.198258 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ee4a1b54cc05f59c645bd1126d4282b64fda5282903180b9bf1a5f54fd738a5"} err="failed to get container status \"7ee4a1b54cc05f59c645bd1126d4282b64fda5282903180b9bf1a5f54fd738a5\": rpc error: code = NotFound desc = could not find container \"7ee4a1b54cc05f59c645bd1126d4282b64fda5282903180b9bf1a5f54fd738a5\": container with ID starting with 7ee4a1b54cc05f59c645bd1126d4282b64fda5282903180b9bf1a5f54fd738a5 not found: ID does not exist" Jun 11 13:47:50.208910 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.208882 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz"] Jun 11 13:47:50.211520 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.211489 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5ca380ca-openshift-default-6b7698cff4-28scz"] Jun 11 13:47:50.278892 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.278860 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" path="/var/lib/kubelet/pods/7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1/volumes" Jun 11 13:47:50.887675 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.887641 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658"] Jun 11 13:47:50.888220 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.888200 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" containerName="istio-proxy" Jun 11 13:47:50.888220 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.888219 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" containerName="istio-proxy" Jun 11 13:47:50.888393 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.888314 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dfaa7fd-72f8-4355-b4dd-fc10b91abeb1" containerName="istio-proxy" Jun 11 13:47:50.893230 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.893205 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:50.895727 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.895707 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-30eed8d9-openshift-default-dockercfg-g2dc4\"" Jun 11 13:47:50.907032 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:50.907011 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658"] Jun 11 13:47:51.080104 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.080067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-envoy\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.080661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.080157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-podinfo\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.080661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.080198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-credential-socket\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.080661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.080238 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-token\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.080661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.080277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-workload-certs\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.080661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.080337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4451ce1-9401-4ecf-ad2c-077757effa84-istiod-ca-cert\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.080661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.080399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlzgx\" (UniqueName: \"kubernetes.io/projected/e4451ce1-9401-4ecf-ad2c-077757effa84-kube-api-access-qlzgx\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.080661 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.080497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-workload-socket\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.081000 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.080678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-data\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.181441 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.181328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-data\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.181441 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.181387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-envoy\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.181782 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.181458 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-podinfo\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.181782 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.181543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-credential-socket\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.181782 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.181578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-token\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.181782 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.181617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-workload-certs\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.181782 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.181650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4451ce1-9401-4ecf-ad2c-077757effa84-istiod-ca-cert\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.181782 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.181683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlzgx\" (UniqueName: \"kubernetes.io/projected/e4451ce1-9401-4ecf-ad2c-077757effa84-kube-api-access-qlzgx\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.181782 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.181718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-workload-socket\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.182174 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.181930 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-data\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.182174 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.182070 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-workload-socket\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.182329 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.182293 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-credential-socket\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.182550 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.182373 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-workload-certs\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.182626 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.182607 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4451ce1-9401-4ecf-ad2c-077757effa84-istiod-ca-cert\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.183907 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.183878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-envoy\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.184152 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.184057 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-podinfo\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.189827 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.189804 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlzgx\" (UniqueName: \"kubernetes.io/projected/e4451ce1-9401-4ecf-ad2c-077757effa84-kube-api-access-qlzgx\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.190298 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.190277 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-token\") pod \"e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.206685 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.206657 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:51.350791 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.350760 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658"] Jun 11 13:47:51.352150 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:47:51.352120 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4451ce1_9401_4ecf_ad2c_077757effa84.slice/crio-d748e7a292ab1c81aca0678a164111f81f4b6eaeba845583b2c1f7dff59ec836 WatchSource:0}: Error finding container d748e7a292ab1c81aca0678a164111f81f4b6eaeba845583b2c1f7dff59ec836: Status 404 returned error can't find the container with id d748e7a292ab1c81aca0678a164111f81f4b6eaeba845583b2c1f7dff59ec836 Jun 11 13:47:51.354785 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.354750 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:47:51.354890 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.354830 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:47:51.354890 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:51.354873 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 13:47:52.193334 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:52.193295 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" event={"ID":"e4451ce1-9401-4ecf-ad2c-077757effa84","Type":"ContainerStarted","Data":"010b92097c1d80c48e685ddef08da592c090be8398989938697a5489a2a26151"} Jun 11 13:47:52.193820 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:52.193353 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" event={"ID":"e4451ce1-9401-4ecf-ad2c-077757effa84","Type":"ContainerStarted","Data":"d748e7a292ab1c81aca0678a164111f81f4b6eaeba845583b2c1f7dff59ec836"} Jun 11 13:47:52.207121 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:52.207093 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:52.212116 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:52.212095 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:52.214837 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:52.214794 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" podStartSLOduration=2.214779784 podStartE2EDuration="2.214779784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:47:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:47:52.213015627 +0000 UTC m=+2242.358645681" watchObservedRunningTime="2026-06-11 13:47:52.214779784 +0000 UTC m=+2242.360409837" Jun 11 13:47:53.199003 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:53.198964 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:53.200102 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:53.200079 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:47:58.451859 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:58.451820 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658"] Jun 11 13:47:58.452279 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:47:58.452006 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" podUID="e4451ce1-9401-4ecf-ad2c-077757effa84" containerName="istio-proxy" containerID="cri-o://010b92097c1d80c48e685ddef08da592c090be8398989938697a5489a2a26151" gracePeriod=30 Jun 11 13:48:03.701172 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.701146 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:48:03.793047 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793017 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-token\") pod \"e4451ce1-9401-4ecf-ad2c-077757effa84\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " Jun 11 13:48:03.793047 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793049 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4451ce1-9401-4ecf-ad2c-077757effa84-istiod-ca-cert\") pod \"e4451ce1-9401-4ecf-ad2c-077757effa84\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " Jun 11 13:48:03.793264 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793071 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-workload-certs\") pod \"e4451ce1-9401-4ecf-ad2c-077757effa84\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " Jun 11 13:48:03.793264 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793200 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-data\") pod \"e4451ce1-9401-4ecf-ad2c-077757effa84\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " Jun 11 13:48:03.793264 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793236 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-envoy\") pod \"e4451ce1-9401-4ecf-ad2c-077757effa84\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " Jun 11 13:48:03.793514 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793276 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlzgx\" (UniqueName: \"kubernetes.io/projected/e4451ce1-9401-4ecf-ad2c-077757effa84-kube-api-access-qlzgx\") pod \"e4451ce1-9401-4ecf-ad2c-077757effa84\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " Jun 11 13:48:03.793514 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793316 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-credential-socket\") pod \"e4451ce1-9401-4ecf-ad2c-077757effa84\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " Jun 11 13:48:03.793514 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793368 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e4451ce1-9401-4ecf-ad2c-077757effa84" (UID: "e4451ce1-9401-4ecf-ad2c-077757effa84"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:48:03.793514 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793492 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-workload-socket\") pod \"e4451ce1-9401-4ecf-ad2c-077757effa84\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " Jun 11 13:48:03.793716 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793524 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4451ce1-9401-4ecf-ad2c-077757effa84-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e4451ce1-9401-4ecf-ad2c-077757effa84" (UID: "e4451ce1-9401-4ecf-ad2c-077757effa84"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:48:03.793716 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793541 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-podinfo\") pod \"e4451ce1-9401-4ecf-ad2c-077757effa84\" (UID: \"e4451ce1-9401-4ecf-ad2c-077757effa84\") " Jun 11 13:48:03.793716 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793548 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-data" (OuterVolumeSpecName: "istio-data") pod "e4451ce1-9401-4ecf-ad2c-077757effa84" (UID: "e4451ce1-9401-4ecf-ad2c-077757effa84"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:48:03.793716 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793640 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e4451ce1-9401-4ecf-ad2c-077757effa84" (UID: "e4451ce1-9401-4ecf-ad2c-077757effa84"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:48:03.793922 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793752 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e4451ce1-9401-4ecf-ad2c-077757effa84" (UID: "e4451ce1-9401-4ecf-ad2c-077757effa84"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:48:03.793922 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793908 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-workload-socket\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:48:03.794035 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793933 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4451ce1-9401-4ecf-ad2c-077757effa84-istiod-ca-cert\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:48:03.794035 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793948 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-workload-certs\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:48:03.794035 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793960 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-data\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:48:03.794035 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.793972 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-credential-socket\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:48:03.795460 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.795400 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e4451ce1-9401-4ecf-ad2c-077757effa84" (UID: "e4451ce1-9401-4ecf-ad2c-077757effa84"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:48:03.795686 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.795662 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e4451ce1-9401-4ecf-ad2c-077757effa84" (UID: "e4451ce1-9401-4ecf-ad2c-077757effa84"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 13:48:03.795759 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.795672 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-token" (OuterVolumeSpecName: "istio-token") pod "e4451ce1-9401-4ecf-ad2c-077757effa84" (UID: "e4451ce1-9401-4ecf-ad2c-077757effa84"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:48:03.795759 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.795729 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4451ce1-9401-4ecf-ad2c-077757effa84-kube-api-access-qlzgx" (OuterVolumeSpecName: "kube-api-access-qlzgx") pod "e4451ce1-9401-4ecf-ad2c-077757effa84" (UID: "e4451ce1-9401-4ecf-ad2c-077757effa84"). InnerVolumeSpecName "kube-api-access-qlzgx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:48:03.894839 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.894800 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-podinfo\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:48:03.894839 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.894832 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-token\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:48:03.894839 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.894841 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4451ce1-9401-4ecf-ad2c-077757effa84-istio-envoy\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:48:03.895085 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:03.894851 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlzgx\" (UniqueName: \"kubernetes.io/projected/e4451ce1-9401-4ecf-ad2c-077757effa84-kube-api-access-qlzgx\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\"" Jun 11 13:48:04.255716 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:04.255629 2576 generic.go:356] "Generic (PLEG): container finished" podID="e4451ce1-9401-4ecf-ad2c-077757effa84" containerID="010b92097c1d80c48e685ddef08da592c090be8398989938697a5489a2a26151" exitCode=0 Jun 11 13:48:04.255716 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:04.255672 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" Jun 11 13:48:04.255716 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:04.255679 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" event={"ID":"e4451ce1-9401-4ecf-ad2c-077757effa84","Type":"ContainerDied","Data":"010b92097c1d80c48e685ddef08da592c090be8398989938697a5489a2a26151"} Jun 11 13:48:04.255970 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:04.255726 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658" event={"ID":"e4451ce1-9401-4ecf-ad2c-077757effa84","Type":"ContainerDied","Data":"d748e7a292ab1c81aca0678a164111f81f4b6eaeba845583b2c1f7dff59ec836"} Jun 11 13:48:04.255970 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:04.255750 2576 scope.go:117] "RemoveContainer" containerID="010b92097c1d80c48e685ddef08da592c090be8398989938697a5489a2a26151" Jun 11 13:48:04.267967 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:04.267904 2576 scope.go:117] "RemoveContainer" containerID="010b92097c1d80c48e685ddef08da592c090be8398989938697a5489a2a26151" Jun 11 13:48:04.268480 ip-10-0-140-41 kubenswrapper[2576]: E0611 13:48:04.268456 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"010b92097c1d80c48e685ddef08da592c090be8398989938697a5489a2a26151\": container with ID starting with 010b92097c1d80c48e685ddef08da592c090be8398989938697a5489a2a26151 not found: ID does not exist" containerID="010b92097c1d80c48e685ddef08da592c090be8398989938697a5489a2a26151" Jun 11 13:48:04.268581 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:04.268490 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"010b92097c1d80c48e685ddef08da592c090be8398989938697a5489a2a26151"} err="failed to get container status \"010b92097c1d80c48e685ddef08da592c090be8398989938697a5489a2a26151\": rpc error: code = NotFound desc = could not find container \"010b92097c1d80c48e685ddef08da592c090be8398989938697a5489a2a26151\": container with ID starting with 010b92097c1d80c48e685ddef08da592c090be8398989938697a5489a2a26151 not found: ID does not exist" Jun 11 13:48:04.278626 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:04.278596 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658"] Jun 11 13:48:04.284501 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:04.284479 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-30eed8d9-openshift-default-84f6ffd99d-gp658"] Jun 11 13:48:06.278460 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:06.278405 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4451ce1-9401-4ecf-ad2c-077757effa84" path="/var/lib/kubelet/pods/e4451ce1-9401-4ecf-ad2c-077757effa84/volumes" Jun 11 13:48:15.460058 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:15.460016 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-68c659989f-jdd28_74d294b8-6b90-4741-8191-edc92b7bcf59/nginx/0.log" Jun 11 13:48:15.829076 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:15.829046 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c6bdc9778-fhj4v_d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f/manager/0.log" Jun 11 13:48:16.426404 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:16.426369 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cdf5bf854-d5njx_072e65a5-4af8-4770-bac6-79c6af347ad1/manager/0.log" Jun 11 13:48:16.440234 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:16.440204 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cdf5bf854-d5njx_072e65a5-4af8-4770-bac6-79c6af347ad1/copy-manifests/0.log" Jun 11 13:48:17.816402 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:17.816358 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4ms5l_6f1e1fd6-8f78-4f10-b7c5-5a4d8de7d56f/manager/0.log" Jun 11 13:48:18.136082 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:18.135995 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qdtsz_afba3ae7-d5be-4bb8-8eb6-6be7fbecb248/registry-server/0.log" Jun 11 13:48:18.814543 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:18.814511 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795brzwv_e95a1ca3-7ad6-411d-87ba-14e6182e7f98/istio-proxy/0.log" Jun 11 13:48:19.265181 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:19.265152 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4qzwv_e3a9a35c-ad6b-405e-b7f2-31e58421a643/istio-proxy/1.log" Jun 11 13:48:19.496219 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:19.496188 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-cdwbl_378f4751-fbbb-44a3-bcaf-90f3b7530ddb/payload-processing/0.log" Jun 11 13:48:19.610647 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:19.610565 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c9684f6b5-5zf4s_d91f7339-49e2-44d8-ae6c-240977329067/router/0.log" Jun 11 13:48:19.950293 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:19.950198 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl_ad4cc21f-417c-4fe0-9bf2-74443418db6a/storage-initializer/0.log" Jun 11 13:48:19.956883 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:19.956854 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-hjjtl_ad4cc21f-417c-4fe0-9bf2-74443418db6a/main/0.log" Jun 11 13:48:20.065491 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:20.065460 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-46qdc_2f9a956c-3f33-4b3d-b5fc-1e2ea218e955/storage-initializer/0.log" Jun 11 13:48:20.072002 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:20.071980 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-46qdc_2f9a956c-3f33-4b3d-b5fc-1e2ea218e955/main/0.log" Jun 11 13:48:20.530546 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:20.530508 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-xrftm_38fd8584-5c2f-4295-8e0b-98a5c1546efa/storage-initializer/0.log" Jun 11 13:48:20.537221 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:20.537192 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-xrftm_38fd8584-5c2f-4295-8e0b-98a5c1546efa/main/0.log" Jun 11 13:48:27.625992 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:27.625962 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vtjvx_b1a8a2a9-d3a7-4b18-bb2c-871c7f2edd4b/global-pull-secret-syncer/0.log" Jun 11 13:48:27.750423 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:27.750378 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vd4rj_55cd422e-237b-45ad-8b5d-102dc265673d/konnectivity-agent/0.log" Jun 11 13:48:27.770269 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:27.770240 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-41.ec2.internal_5277c1df015f74c1121f1ce824c96ba2/haproxy/0.log" Jun 11 13:48:32.701318 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:32.701232 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4ms5l_6f1e1fd6-8f78-4f10-b7c5-5a4d8de7d56f/manager/0.log" Jun 11 13:48:32.805848 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:32.805815 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qdtsz_afba3ae7-d5be-4bb8-8eb6-6be7fbecb248/registry-server/0.log" Jun 11 13:48:34.817651 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:34.817560 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-v6m5j_2169af99-8f87-450c-8aff-772ef0a5e25f/cluster-monitoring-operator/0.log" Jun 11 13:48:34.844720 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:34.844691 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-twdbf_5b7a438e-bc51-4208-84d5-487f2b5e06e2/kube-state-metrics/0.log" Jun 11 13:48:34.868620 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:34.868599 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-twdbf_5b7a438e-bc51-4208-84d5-487f2b5e06e2/kube-rbac-proxy-main/0.log" Jun 11 13:48:34.896681 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:34.896660 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-twdbf_5b7a438e-bc51-4208-84d5-487f2b5e06e2/kube-rbac-proxy-self/0.log" Jun 11 13:48:34.980689 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:34.980660 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6njpb_f37909ca-785e-4f2a-bb65-e90d572687a0/node-exporter/0.log" Jun 11 13:48:35.002429 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:35.002380 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6njpb_f37909ca-785e-4f2a-bb65-e90d572687a0/kube-rbac-proxy/0.log" Jun 11 13:48:35.027212 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:35.027187 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6njpb_f37909ca-785e-4f2a-bb65-e90d572687a0/init-textfile/0.log" Jun 11 13:48:35.312889 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:35.312862 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feca4095-83f3-473c-bf59-6e9f09544a0e/prometheus/0.log" Jun 11 13:48:35.339787 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:35.339762 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feca4095-83f3-473c-bf59-6e9f09544a0e/config-reloader/0.log" Jun 11 13:48:35.361129 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:35.361085 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feca4095-83f3-473c-bf59-6e9f09544a0e/thanos-sidecar/0.log" Jun 11 13:48:35.382873 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:35.382854 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feca4095-83f3-473c-bf59-6e9f09544a0e/kube-rbac-proxy-web/0.log" Jun 11 13:48:35.409745 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:35.409681 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feca4095-83f3-473c-bf59-6e9f09544a0e/kube-rbac-proxy/0.log" Jun 11 13:48:35.435128 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:35.435105 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feca4095-83f3-473c-bf59-6e9f09544a0e/kube-rbac-proxy-thanos/0.log" Jun 11 13:48:35.464288 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:35.464260 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feca4095-83f3-473c-bf59-6e9f09544a0e/init-config-reloader/0.log" Jun 11 13:48:37.175019 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:37.174995 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-ll78t_e3020589-3d6c-4245-ad43-e3d40bf8794c/networking-console-plugin/0.log" Jun 11 13:48:37.818159 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:37.818134 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/1.log" Jun 11 13:48:37.823600 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:37.823582 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-46945_09dcfe78-fdf2-4535-b96f-da069e0a0135/console-operator/2.log" Jun 11 13:48:39.164082 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.164051 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-gn9wq_6f36142e-73f8-4e51-b0aa-bd9daadad20e/volume-data-source-validator/0.log" Jun 11 13:48:39.765775 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.765740 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c"] Jun 11 13:48:39.766175 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.766161 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4451ce1-9401-4ecf-ad2c-077757effa84" containerName="istio-proxy" Jun 11 13:48:39.766225 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.766178 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4451ce1-9401-4ecf-ad2c-077757effa84" containerName="istio-proxy" Jun 11 13:48:39.766350 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.766336 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4451ce1-9401-4ecf-ad2c-077757effa84" containerName="istio-proxy" Jun 11 13:48:39.769878 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.769856 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.772216 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.772198 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5gk42\"/\"default-dockercfg-jfczr\"" Jun 11 13:48:39.773122 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.773104 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5gk42\"/\"kube-root-ca.crt\"" Jun 11 13:48:39.773204 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.773134 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5gk42\"/\"openshift-service-ca.crt\"" Jun 11 13:48:39.775907 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.775886 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c"] Jun 11 13:48:39.851667 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.851634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ea33c40-5620-4f37-b0b4-3bb62c025c12-lib-modules\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.851824 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.851676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4ea33c40-5620-4f37-b0b4-3bb62c025c12-proc\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.851824 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.851748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4ea33c40-5620-4f37-b0b4-3bb62c025c12-podres\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.851824 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.851767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkcct\" (UniqueName: \"kubernetes.io/projected/4ea33c40-5620-4f37-b0b4-3bb62c025c12-kube-api-access-lkcct\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.851970 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.851823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ea33c40-5620-4f37-b0b4-3bb62c025c12-sys\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.953088 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.953049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4ea33c40-5620-4f37-b0b4-3bb62c025c12-podres\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.953272 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.953095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkcct\" (UniqueName: \"kubernetes.io/projected/4ea33c40-5620-4f37-b0b4-3bb62c025c12-kube-api-access-lkcct\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.953272 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.953211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ea33c40-5620-4f37-b0b4-3bb62c025c12-sys\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.953272 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.953225 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4ea33c40-5620-4f37-b0b4-3bb62c025c12-podres\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.953495 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.953290 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ea33c40-5620-4f37-b0b4-3bb62c025c12-sys\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.953495 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.953313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ea33c40-5620-4f37-b0b4-3bb62c025c12-lib-modules\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.953495 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.953357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4ea33c40-5620-4f37-b0b4-3bb62c025c12-proc\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.953495 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.953474 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ea33c40-5620-4f37-b0b4-3bb62c025c12-lib-modules\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.953495 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.953484 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4ea33c40-5620-4f37-b0b4-3bb62c025c12-proc\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:39.961532 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:39.961501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkcct\" (UniqueName: \"kubernetes.io/projected/4ea33c40-5620-4f37-b0b4-3bb62c025c12-kube-api-access-lkcct\") pod \"perf-node-gather-daemonset-rmz2c\" (UID: \"4ea33c40-5620-4f37-b0b4-3bb62c025c12\") " pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:40.081369 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:40.081291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:40.236659 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:40.236630 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c"] Jun 11 13:48:40.238373 ip-10-0-140-41 kubenswrapper[2576]: W0611 13:48:40.238338 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4ea33c40_5620_4f37_b0b4_3bb62c025c12.slice/crio-17775c51301094f12aa1c8e48ae340e806ddb2efb00bce6e20f5a815332121ca WatchSource:0}: Error finding container 17775c51301094f12aa1c8e48ae340e806ddb2efb00bce6e20f5a815332121ca: Status 404 returned error can't find the container with id 17775c51301094f12aa1c8e48ae340e806ddb2efb00bce6e20f5a815332121ca Jun 11 13:48:40.431970 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:40.431940 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" event={"ID":"4ea33c40-5620-4f37-b0b4-3bb62c025c12","Type":"ContainerStarted","Data":"18cffa6a93ffc6b556fe504e3a15dc3a0fe91072676039ae531bcea962996b05"} Jun 11 13:48:40.432125 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:40.431988 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" event={"ID":"4ea33c40-5620-4f37-b0b4-3bb62c025c12","Type":"ContainerStarted","Data":"17775c51301094f12aa1c8e48ae340e806ddb2efb00bce6e20f5a815332121ca"} Jun 11 13:48:40.432125 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:40.432016 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:40.448125 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:40.448057 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" podStartSLOduration=1.448041857 podStartE2EDuration="1.448041857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:48:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:48:40.446517625 +0000 UTC m=+2290.592147680" watchObservedRunningTime="2026-06-11 13:48:40.448041857 +0000 UTC m=+2290.593671909" Jun 11 13:48:40.492741 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:40.492718 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hp96k_c570fbf0-ca38-4662-975f-7600c15a6844/dns/0.log" Jun 11 13:48:40.515816 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:40.515795 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hp96k_c570fbf0-ca38-4662-975f-7600c15a6844/kube-rbac-proxy/0.log" Jun 11 13:48:40.645995 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:40.645917 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxl6s_0d4968e5-3b3f-4f22-81b7-5d584801260d/dns-node-resolver/0.log" Jun 11 13:48:41.257062 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:41.257033 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g8rr2_9f4f82d6-9818-4618-ab71-902e0f62f5fc/node-ca/0.log" Jun 11 13:48:42.245521 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:42.245488 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795brzwv_e95a1ca3-7ad6-411d-87ba-14e6182e7f98/istio-proxy/0.log" Jun 11 13:48:42.423450 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:42.423399 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4qzwv_e3a9a35c-ad6b-405e-b7f2-31e58421a643/istio-proxy/0.log" Jun 11 13:48:42.454870 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:42.454839 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4qzwv_e3a9a35c-ad6b-405e-b7f2-31e58421a643/istio-proxy/1.log" Jun 11 13:48:42.548367 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:42.548338 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-cdwbl_378f4751-fbbb-44a3-bcaf-90f3b7530ddb/payload-processing/0.log" Jun 11 13:48:42.569059 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:42.569036 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c9684f6b5-5zf4s_d91f7339-49e2-44d8-ae6c-240977329067/router/0.log" Jun 11 13:48:43.238690 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:43.238659 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-whxvf_3781575c-9cc6-45f5-9e7d-cbded40bcff5/serve-healthcheck-canary/0.log" Jun 11 13:48:43.772518 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:43.772488 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-gbbdl_5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4/insights-operator/0.log" Jun 11 13:48:43.773007 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:43.772987 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-gbbdl_5a8206f8-335d-4c9e-bbad-fc7aa45b0dd4/insights-operator/1.log" Jun 11 13:48:43.793125 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:43.793100 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g86xr_90b76fba-bbce-41cc-a172-96256e7a30b2/kube-rbac-proxy/0.log" Jun 11 13:48:43.813530 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:43.813500 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g86xr_90b76fba-bbce-41cc-a172-96256e7a30b2/exporter/0.log" Jun 11 13:48:43.835382 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:43.835358 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g86xr_90b76fba-bbce-41cc-a172-96256e7a30b2/extractor/0.log" Jun 11 13:48:46.153092 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:46.153063 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-68c659989f-jdd28_74d294b8-6b90-4741-8191-edc92b7bcf59/nginx/0.log" Jun 11 13:48:46.352528 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:46.352499 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c6bdc9778-fhj4v_d209f7a8-ee5b-4c0c-87fe-a7fea8decb3f/manager/0.log" Jun 11 13:48:46.446390 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:46.446322 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5gk42/perf-node-gather-daemonset-rmz2c" Jun 11 13:48:46.629510 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:46.629482 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cdf5bf854-d5njx_072e65a5-4af8-4770-bac6-79c6af347ad1/manager/0.log" Jun 11 13:48:46.647634 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:46.647609 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cdf5bf854-d5njx_072e65a5-4af8-4770-bac6-79c6af347ad1/copy-manifests/0.log" Jun 11 13:48:48.104190 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:48.104158 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d5c7595f8-lqjpb_3206aff6-f680-4892-8b6e-f26df8216094/manager/0.log" Jun 11 13:48:53.371262 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:53.371229 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795brzwv_e95a1ca3-7ad6-411d-87ba-14e6182e7f98/istio-proxy/0.log" Jun 11 13:48:53.579211 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:53.579180 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4qzwv_e3a9a35c-ad6b-405e-b7f2-31e58421a643/istio-proxy/0.log" Jun 11 13:48:53.610591 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:53.610561 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4qzwv_e3a9a35c-ad6b-405e-b7f2-31e58421a643/istio-proxy/1.log" Jun 11 13:48:53.690172 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:53.690101 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-cdwbl_378f4751-fbbb-44a3-bcaf-90f3b7530ddb/payload-processing/0.log" Jun 11 13:48:53.703879 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:53.703852 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c9684f6b5-5zf4s_d91f7339-49e2-44d8-ae6c-240977329067/router/0.log" Jun 11 13:48:53.975996 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:53.975918 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-q5lq4_19b7d659-a74d-4032-b931-a6998e537317/kube-storage-version-migrator-operator/1.log" Jun 11 13:48:53.976816 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:53.976800 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-q5lq4_19b7d659-a74d-4032-b931-a6998e537317/kube-storage-version-migrator-operator/0.log" Jun 11 13:48:54.765905 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:54.765876 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795brzwv_e95a1ca3-7ad6-411d-87ba-14e6182e7f98/istio-proxy/0.log" Jun 11 13:48:54.909184 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:54.909149 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4qzwv_e3a9a35c-ad6b-405e-b7f2-31e58421a643/istio-proxy/0.log" Jun 11 13:48:54.938021 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:54.937990 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4qzwv_e3a9a35c-ad6b-405e-b7f2-31e58421a643/istio-proxy/1.log" Jun 11 13:48:55.012768 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:55.012743 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-cdwbl_378f4751-fbbb-44a3-bcaf-90f3b7530ddb/payload-processing/0.log" Jun 11 13:48:55.028778 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:55.028710 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c9684f6b5-5zf4s_d91f7339-49e2-44d8-ae6c-240977329067/router/0.log" Jun 11 13:48:55.283662 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:55.283586 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-27s94_0845cbb7-4753-461f-9d5f-1f165b89237d/kube-multus/0.log" Jun 11 13:48:55.306211 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:55.306188 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9txx_9bd5ecac-bf25-4ba9-a147-cfa1a3bed078/kube-multus-additional-cni-plugins/0.log" Jun 11 13:48:55.326873 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:55.326845 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9txx_9bd5ecac-bf25-4ba9-a147-cfa1a3bed078/egress-router-binary-copy/0.log" Jun 11 13:48:55.346752 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:55.346726 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9txx_9bd5ecac-bf25-4ba9-a147-cfa1a3bed078/cni-plugins/0.log" Jun 11 13:48:55.366811 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:55.366789 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9txx_9bd5ecac-bf25-4ba9-a147-cfa1a3bed078/bond-cni-plugin/0.log" Jun 11 13:48:55.386399 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:55.386374 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9txx_9bd5ecac-bf25-4ba9-a147-cfa1a3bed078/routeoverride-cni/0.log" Jun 11 13:48:55.408354 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:55.408338 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9txx_9bd5ecac-bf25-4ba9-a147-cfa1a3bed078/whereabouts-cni-bincopy/0.log" Jun 11 13:48:55.434360 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:55.434333 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9txx_9bd5ecac-bf25-4ba9-a147-cfa1a3bed078/whereabouts-cni/0.log" Jun 11 13:48:55.847543 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:55.847508 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dxrv4_a521071a-24e5-4c21-9121-d72a6e4fcdb8/network-metrics-daemon/0.log" Jun 11 13:48:55.866672 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:55.866602 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dxrv4_a521071a-24e5-4c21-9121-d72a6e4fcdb8/kube-rbac-proxy/0.log" Jun 11 13:48:56.590797 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:56.590762 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795brzwv_e95a1ca3-7ad6-411d-87ba-14e6182e7f98/istio-proxy/0.log" Jun 11 13:48:56.733595 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:56.733555 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4qzwv_e3a9a35c-ad6b-405e-b7f2-31e58421a643/istio-proxy/0.log" Jun 11 13:48:56.761945 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:56.761915 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4qzwv_e3a9a35c-ad6b-405e-b7f2-31e58421a643/istio-proxy/1.log" Jun 11 13:48:56.837158 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:56.837129 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-cdwbl_378f4751-fbbb-44a3-bcaf-90f3b7530ddb/payload-processing/0.log" Jun 11 13:48:56.850644 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:56.850581 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c9684f6b5-5zf4s_d91f7339-49e2-44d8-ae6c-240977329067/router/0.log" Jun 11 13:48:56.934274 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:56.934249 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8cz6_b29e98c3-90cb-42ea-86a3-91849e998e5b/ovn-controller/0.log" Jun 11 13:48:56.953364 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:56.953344 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8cz6_b29e98c3-90cb-42ea-86a3-91849e998e5b/ovn-acl-logging/0.log" Jun 11 13:48:56.976839 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:56.976822 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8cz6_b29e98c3-90cb-42ea-86a3-91849e998e5b/kube-rbac-proxy-node/0.log" Jun 11 13:48:56.996898 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:56.996880 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8cz6_b29e98c3-90cb-42ea-86a3-91849e998e5b/kube-rbac-proxy-ovn-metrics/0.log" Jun 11 13:48:57.015779 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:57.015759 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8cz6_b29e98c3-90cb-42ea-86a3-91849e998e5b/northd/0.log" Jun 11 13:48:57.036110 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:57.036093 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8cz6_b29e98c3-90cb-42ea-86a3-91849e998e5b/nbdb/0.log" Jun 11 13:48:57.056554 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:57.056519 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8cz6_b29e98c3-90cb-42ea-86a3-91849e998e5b/sbdb/0.log" Jun 11 13:48:57.102479 ip-10-0-140-41 kubenswrapper[2576]: I0611 13:48:57.102369 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8cz6_b29e98c3-90cb-42ea-86a3-91849e998e5b/ovnkube-controller/0.log"