Jun 11 14:50:20.639295 ip-10-0-135-91 systemd[1]: Starting Kubernetes Kubelet... Jun 11 14:50:21.094048 ip-10-0-135-91 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:50:21.094048 ip-10-0-135-91 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 14:50:21.094048 ip-10-0-135-91 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:50:21.094048 ip-10-0-135-91 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 14:50:21.094048 ip-10-0-135-91 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:50:21.094048 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.990289 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 14:50:21.094048 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995719 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:50:21.094048 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995734 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:50:21.094048 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995745 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:50:21.094048 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995752 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:50:21.094048 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995757 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:50:21.094048 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995762 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:50:21.094048 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995766 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:50:21.094048 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995770 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:50:21.059385 ip-10-0-135-91 systemd[1]: Started Kubernetes Kubelet. Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995774 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995779 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995783 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995787 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995792 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995796 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995800 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995809 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995814 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995818 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995823 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995827 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995831 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995840 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995845 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995849 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995854 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995860 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995866 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:50:21.095709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995877 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995882 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995886 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995892 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995896 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995903 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995908 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995912 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995916 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995920 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995924 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995929 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995940 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995947 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995951 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995956 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995960 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995965 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995969 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:50:21.096770 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995973 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995978 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995982 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995987 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.995991 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996001 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996018 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996022 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996027 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996032 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996036 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996040 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996047 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996051 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996055 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996059 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996064 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996073 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996077 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996081 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:50:21.098483 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996086 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996090 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996095 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996099 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996103 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996108 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996113 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996117 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996122 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996126 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996135 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996138 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996143 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996147 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996151 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996155 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996160 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996164 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996168 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996172 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:50:21.099553 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996176 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996185 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996194 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996199 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996204 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996208 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996212 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996217 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996221 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996226 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996230 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996234 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.996239 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997256 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997267 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997271 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997274 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997277 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997280 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997283 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:50:21.101980 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997287 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997290 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997292 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997295 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997297 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997300 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997303 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997306 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997308 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997311 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997314 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997316 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997319 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997322 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997325 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997327 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997330 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997333 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997335 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997338 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:50:21.102653 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997340 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997343 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997345 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997348 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997351 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997354 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997357 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997360 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997362 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997365 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997367 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997370 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997372 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997375 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997377 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997380 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997382 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997385 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997387 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997390 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:50:21.105327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997392 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997395 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997398 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997400 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997402 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997405 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997407 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997410 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997412 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997417 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997421 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997424 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997426 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997429 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997431 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997434 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997437 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997440 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997443 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:50:21.106587 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997446 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997448 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997451 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997453 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997456 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997460 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997465 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997468 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997472 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997475 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997478 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997480 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997483 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997485 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997488 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997491 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997493 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997497 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997500 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:50:21.249734 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997502 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997505 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997507 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997510 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997512 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997515 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997518 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997520 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997523 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997526 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997530 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997534 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997537 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997540 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997918 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997923 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997926 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997930 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997933 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997936 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:50:21.261555 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997938 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997941 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997944 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997946 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997948 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997951 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997953 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997956 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997958 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997961 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997964 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997967 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997969 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997972 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997975 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997978 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997981 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997983 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997986 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997988 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:50:21.263343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997991 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997994 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997997 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.997999 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998018 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998022 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998025 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998027 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998030 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998033 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998035 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998038 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998040 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998043 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998046 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998049 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998051 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998054 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998056 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998059 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:50:21.264161 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998061 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998064 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998066 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998069 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998072 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998075 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998078 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998082 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998085 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998087 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998090 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998093 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998095 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998098 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998103 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998107 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998110 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998115 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998119 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998125 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:50:21.264841 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998128 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998131 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998133 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998137 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998139 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998142 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998144 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998147 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998149 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998152 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998155 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998157 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998161 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998165 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998169 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998172 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998175 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998178 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998181 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:50:21.265505 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998184 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998186 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998189 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998191 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998194 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998196 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998199 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998202 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998204 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998206 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998211 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998216 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998219 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998222 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998294 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998301 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998308 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998313 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998317 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998320 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 14:50:21.266112 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998324 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998328 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998331 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998334 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998338 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998341 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998344 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998347 2574 flags.go:64] FLAG: --cgroup-root="" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998349 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998352 2574 flags.go:64] FLAG: --client-ca-file="" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998356 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998359 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998363 2574 flags.go:64] FLAG: --cluster-domain="" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998366 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998369 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998372 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998375 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998379 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998382 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998385 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998388 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998391 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998393 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998398 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 14:50:21.266787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998402 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998404 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998409 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998412 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998414 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998417 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998420 2574 flags.go:64] FLAG: --enable-server="true" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998423 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998427 2574 flags.go:64] FLAG: --event-burst="100" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998431 2574 flags.go:64] FLAG: --event-qps="50" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998434 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998436 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998439 2574 flags.go:64] FLAG: --eviction-hard="" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998443 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998446 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998449 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998452 2574 flags.go:64] FLAG: --eviction-soft="" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998454 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998457 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998460 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998467 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998469 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998472 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998475 2574 flags.go:64] FLAG: --feature-gates="" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998479 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 14:50:21.267448 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998482 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998485 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998488 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998491 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998494 2574 flags.go:64] FLAG: --help="false" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998497 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998501 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998504 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998507 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998510 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998514 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998517 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998519 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998522 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998525 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998528 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998531 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998534 2574 flags.go:64] FLAG: --kube-reserved="" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998536 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998539 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998542 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998545 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998548 2574 flags.go:64] FLAG: --lock-file="" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998550 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 14:50:21.268120 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998553 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998556 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998562 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998567 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998570 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998573 2574 flags.go:64] FLAG: --logging-format="text" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998575 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998579 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998582 2574 flags.go:64] FLAG: --manifest-url="" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998584 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998589 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998591 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998595 2574 flags.go:64] FLAG: --max-pods="110" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998598 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998602 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998605 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998608 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998611 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998614 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998617 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998624 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998626 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998629 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 14:50:21.268732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998632 2574 flags.go:64] FLAG: --pod-cidr="" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998635 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998641 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998643 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998646 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998649 2574 flags.go:64] FLAG: --port="10250" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998652 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998655 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09336cb28630e9d94" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998658 2574 flags.go:64] FLAG: --qos-reserved="" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998661 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998664 2574 flags.go:64] FLAG: --register-node="true" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998667 2574 flags.go:64] FLAG: --register-with-taints="" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998670 2574 flags.go:64] FLAG: --registry-burst="10" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998676 2574 flags.go:64] FLAG: --registry-qps="5" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998679 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998682 2574 flags.go:64] FLAG: --reserved-memory="" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998685 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998688 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998691 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998694 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998697 2574 flags.go:64] FLAG: --runonce="false" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998699 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998702 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998707 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998710 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 14:50:21.269337 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998713 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998715 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998718 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998721 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998724 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998727 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998730 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998733 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998736 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998739 2574 flags.go:64] FLAG: --system-cgroups="" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998741 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998747 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998750 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998752 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998756 2574 flags.go:64] FLAG: --tls-min-version="" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998759 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998762 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998765 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998768 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998770 2574 flags.go:64] FLAG: --v="2" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998776 2574 flags.go:64] FLAG: --version="false" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998780 2574 flags.go:64] FLAG: --vmodule="" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998784 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.998787 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998904 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:50:21.269965 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998908 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998911 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998915 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998917 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998920 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998924 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998927 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998930 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998932 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998935 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998938 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998940 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998943 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998945 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998948 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998950 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998953 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998955 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998958 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:50:21.270592 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998961 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998965 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998969 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998972 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998975 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998979 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998982 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998985 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998989 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998992 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998996 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.998999 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999015 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999019 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999022 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999025 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999027 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999030 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999035 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:50:21.271088 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999038 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999040 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999043 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999045 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999048 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999050 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999053 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999055 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999058 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999061 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999063 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999066 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999069 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999071 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999074 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999077 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999080 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999082 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999085 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999088 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:50:21.271560 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999090 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999094 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999097 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999099 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999102 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999105 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999107 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999110 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999112 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999115 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999117 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999122 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999124 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999127 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999129 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999132 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999134 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999137 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999139 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999142 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:50:21.272100 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999144 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999147 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999149 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999152 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999156 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999160 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999162 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999165 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999168 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999171 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999173 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999175 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999178 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999182 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999185 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999187 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999190 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999193 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999195 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:50:21.272599 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:20.999198 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:20.999744 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.006666 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.006789 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.006819 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.006825 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006889 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006894 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006898 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006901 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006904 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006906 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006909 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006912 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006915 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:50:21.273096 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006918 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006921 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006924 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006926 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006929 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006932 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006934 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006937 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006940 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006943 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006946 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006948 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006951 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006954 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006957 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006960 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006963 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006965 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006968 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006971 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:50:21.273558 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006975 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006977 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006980 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006983 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006985 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006988 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006990 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006993 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006995 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.006998 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007001 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007018 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007021 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007023 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007026 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007029 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007031 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007034 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007037 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007039 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:50:21.274076 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007042 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007044 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007047 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007050 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007052 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007055 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007058 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007061 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007064 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007066 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007069 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007072 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007076 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007081 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007086 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007089 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007092 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007095 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007098 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:50:21.274568 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007101 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007104 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007107 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007109 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007112 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007114 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007117 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007121 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007124 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007127 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007129 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007132 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007135 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007137 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007140 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007143 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007146 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007151 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007154 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:50:21.275275 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007158 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007167 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007170 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007172 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007175 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007177 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007180 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007183 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007187 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007189 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007192 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007195 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.007200 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007308 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007312 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:50:21.275966 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007315 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007318 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007320 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007323 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007325 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007328 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007330 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007333 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007336 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007338 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007341 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007343 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007346 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007348 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007351 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007356 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007358 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007361 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007363 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007367 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:50:21.276556 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007370 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007372 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007375 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007377 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007380 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007383 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007386 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007388 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007391 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007395 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007398 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007401 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007404 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007408 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007411 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007415 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007418 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007420 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007423 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:50:21.277201 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007426 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007429 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007432 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007434 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007437 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007439 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007442 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007445 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007448 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007451 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007454 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007456 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007460 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007463 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007465 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007469 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007472 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007475 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007477 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:50:21.277702 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007480 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007483 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007486 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007488 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007491 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007493 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007496 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007498 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007501 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007503 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007506 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007508 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007511 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007513 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007516 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007518 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007521 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007523 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007526 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007529 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:50:21.278237 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007531 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007535 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007537 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007540 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007542 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007546 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007548 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007551 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007553 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007556 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007559 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007562 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007564 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007567 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007570 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007572 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007575 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007577 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:50:21.278729 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:21.007580 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:50:21.279248 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.007585 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:50:21.279248 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.007691 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 14:50:21.279248 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.009572 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 14:50:21.279248 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.010743 2574 server.go:1019] "Starting client certificate rotation" Jun 11 14:50:21.279248 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.011967 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 14:50:21.279248 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.012016 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 14:50:21.279248 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.012784 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 14:50:21.279248 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.016383 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 14:50:21.279248 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.030155 2574 log.go:25] "Validated CRI v1 runtime API" Jun 11 14:50:21.279248 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.032474 2574 log.go:25] "Validated CRI v1 image API" Jun 11 14:50:21.279248 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.035509 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 14:50:21.279248 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.037597 2574 fs.go:135] Filesystem UUIDs: map[63b746c7-de34-47ce-8352-324aa85ff0a4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 81ed595f-fad1-419f-90a1-cffc55e2dee9:/dev/nvme0n1p4] Jun 11 14:50:21.279573 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.037613 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 14:50:21.279616 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.042630 2574 manager.go:216] Machine: {Timestamp:2026-06-11 14:50:21.041544044 +0000 UTC m=+0.299795447 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099467 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec289827b015c7a84fdbe00a0bbde679 SystemUUID:ec289827-b015-c7a8-4fdb-e00a0bbde679 BootID:d9de8204-b2d5-4d4a-8f98-82a4bae1011c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3d:da:18:4b:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3d:da:18:4b:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:6a:7c:a9:bb:06 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 14:50:21.279616 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.042724 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 14:50:21.279616 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.042830 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 14:50:21.279616 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.045128 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 14:50:21.279616 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.045158 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-91.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 14:50:21.279616 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.045837 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 14:50:21.279616 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.045847 2574 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 14:50:21.279616 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.045855 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.046446 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.047364 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.049730 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.049850 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.049885 2574 kubelet.go:486] "Attempting to sync node with API server" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.049898 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.049916 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.049949 2574 kubelet.go:398] "Adding apiserver pod source" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.049959 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.050306 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.050321 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.052277 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.053848 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.053879 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.054181 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.054517 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.054531 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.054540 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.054549 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.054565 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.054573 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.054582 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.054588 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.054594 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.054600 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.054609 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.054617 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.055479 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.055487 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.058668 2574 server.go:1268] "Started kubelet" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.059035 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.061123 2574 server.go:310] "Adding debug handlers to kubelet server" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.062946 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.063428 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.064264 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n2wpv" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.065673 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.067144 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-91.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.067173 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 14:50:21.279884 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.067142 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.070698 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.071023 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.071038 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.071194 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-91.ec2.internal\" not found" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.070315 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-91.ec2.internal.18b80e575fe26974 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-91.ec2.internal,UID:ip-10-0-135-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-91.ec2.internal,},FirstTimestamp:2026-06-11 14:50:21.058648436 +0000 UTC m=+0.316899818,LastTimestamp:2026-06-11 14:50:21.058648436 +0000 UTC m=+0.316899818,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-91.ec2.internal,}" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.071759 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.071800 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.071816 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.071873 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n2wpv" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.072069 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.072078 2574 reconciler.go:29] "Reconciler: start to sync state" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.072546 2574 factory.go:55] Registering systemd factory Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.072568 2574 factory.go:223] Registration of the systemd container factory successfully Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.072781 2574 factory.go:153] Registering CRI-O factory Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.072794 2574 factory.go:223] Registration of the crio container factory successfully Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.072843 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.072875 2574 factory.go:103] Registering Raw factory Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.072892 2574 manager.go:1196] Started watching for new ooms in manager Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.073302 2574 manager.go:349] Starting recovery of all containers Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.079246 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.081927 2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-91.ec2.internal\" not found" node="ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.082722 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.084468 2574 manager.go:354] Recovery completed Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.090361 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.092558 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.092586 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.092603 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.093082 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.093095 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.093083 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.093110 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.093792 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.093822 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.093837 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.094104 2574 policy_none.go:49] "None policy: Start" Jun 11 14:50:21.281119 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.094117 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.094127 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.095021 2574 policy_none.go:47] "Start" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.141895 2574 manager.go:337] "Starting Device Plugin manager" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.141981 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.141994 2574 server.go:87] "Starting device plugin registration server" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.142227 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.142242 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.142324 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.142414 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.142424 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.143218 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.143274 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-91.ec2.internal\" not found" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.161170 2574 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2612 into the system container \"/system.slice\": " Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.175103 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.175136 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.175154 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.175208 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.176953 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.242699 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.245750 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.245781 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.245793 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.245824 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.253060 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.253079 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-91.ec2.internal\": node \"ip-10-0-135-91.ec2.internal\" not found" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.262563 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-91.ec2.internal\" not found" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.275564 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-91.ec2.internal"] Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.275624 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.277801 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.277826 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.277836 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.278988 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.279101 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.279150 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.279649 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.279670 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:50:21.282409 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.279684 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:50:21.283378 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.279817 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:50:21.283378 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.279841 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:50:21.283378 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.279853 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:50:21.283378 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.280729 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.283378 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.280757 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:50:21.283378 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.281463 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:50:21.283378 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.281487 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:50:21.283378 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.281496 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:50:21.316685 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.316664 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-91.ec2.internal\" not found" node="ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.324359 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.324342 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-91.ec2.internal\" not found" node="ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.362920 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.362844 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-91.ec2.internal\" not found" Jun 11 14:50:21.373570 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.373548 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe2e7933575dc010206caac2bcc7daeb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal\" (UID: \"fe2e7933575dc010206caac2bcc7daeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.373628 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.373575 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe2e7933575dc010206caac2bcc7daeb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal\" (UID: \"fe2e7933575dc010206caac2bcc7daeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.373628 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.373593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/499b78f6b57b020e19855dcaf8481477-config\") pod \"kube-apiserver-proxy-ip-10-0-135-91.ec2.internal\" (UID: \"499b78f6b57b020e19855dcaf8481477\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.463689 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.463652 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-91.ec2.internal\" not found" Jun 11 14:50:21.473985 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.473958 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe2e7933575dc010206caac2bcc7daeb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal\" (UID: \"fe2e7933575dc010206caac2bcc7daeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.474059 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.474000 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe2e7933575dc010206caac2bcc7daeb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal\" (UID: \"fe2e7933575dc010206caac2bcc7daeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.474101 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.474066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe2e7933575dc010206caac2bcc7daeb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal\" (UID: \"fe2e7933575dc010206caac2bcc7daeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.474101 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.474080 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe2e7933575dc010206caac2bcc7daeb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal\" (UID: \"fe2e7933575dc010206caac2bcc7daeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.474192 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.474137 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/499b78f6b57b020e19855dcaf8481477-config\") pod \"kube-apiserver-proxy-ip-10-0-135-91.ec2.internal\" (UID: \"499b78f6b57b020e19855dcaf8481477\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.474237 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.474200 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/499b78f6b57b020e19855dcaf8481477-config\") pod \"kube-apiserver-proxy-ip-10-0-135-91.ec2.internal\" (UID: \"499b78f6b57b020e19855dcaf8481477\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.564417 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.564376 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-91.ec2.internal\" not found" Jun 11 14:50:21.619940 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.619877 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.628354 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.628330 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.664792 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.664766 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-91.ec2.internal\" not found" Jun 11 14:50:21.765260 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.765234 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-91.ec2.internal\" not found" Jun 11 14:50:21.865823 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:21.865789 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-91.ec2.internal\" not found" Jun 11 14:50:21.918383 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.918311 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:50:21.971891 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.971866 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.981560 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.981541 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 14:50:21.983068 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.983055 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal" Jun 11 14:50:21.991993 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:21.991976 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 14:50:22.012157 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.012126 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 14:50:22.012261 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.012241 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 14:50:22.012312 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.012241 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 14:50:22.012312 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.012262 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 14:50:22.051393 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.051371 2574 apiserver.go:52] "Watching apiserver" Jun 11 14:50:22.067953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.067925 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 14:50:22.068935 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.068910 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-p9j5j","kube-system/konnectivity-agent-nrjxq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm","openshift-cluster-node-tuning-operator/tuned-qg6xg","openshift-image-registry/node-ca-d2dgr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal","openshift-multus/multus-additional-cni-plugins-skznz","openshift-multus/multus-sgfjr","openshift-network-diagnostics/network-check-target-z2shj","kube-system/global-pull-secret-syncer-w48cb","kube-system/kube-apiserver-proxy-ip-10-0-135-91.ec2.internal","openshift-dns/node-resolver-wgzcn","openshift-multus/network-metrics-daemon-q68m6","openshift-network-operator/iptables-alerter-f77d4"] Jun 11 14:50:22.071183 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.071166 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 14:50:22.071510 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.071493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.073923 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.073878 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 14:45:21 +0000 UTC" deadline="2027-11-28 09:13:29.13135428 +0000 UTC" Jun 11 14:50:22.074076 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.074050 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12834h23m7.057311909s" Jun 11 14:50:22.074340 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.074319 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nrjxq" Jun 11 14:50:22.074471 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.074453 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 14:50:22.074471 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.074472 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8kk7g\"" Jun 11 14:50:22.075569 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.075523 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 14:50:22.075569 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.075545 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 14:50:22.075569 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.075560 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 14:50:22.075746 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.075561 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 14:50:22.075746 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.075615 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 14:50:22.076694 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.076677 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.077061 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077044 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 14:50:22.077171 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077095 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6ztg4\"" Jun 11 14:50:22.077171 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077104 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-systemd-units\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077171 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077133 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-run-netns\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077171 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077159 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-run-systemd\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-run-openvswitch\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077207 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-run-ovn\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077231 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077258 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f20bd10-741c-44e0-96a4-16da9d9b73e5-env-overrides\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f20bd10-741c-44e0-96a4-16da9d9b73e5-ovn-node-metrics-cert\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-etc-openvswitch\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077362 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 14:50:22.077407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077369 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-node-log\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077820 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077412 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-log-socket\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077820 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f20bd10-741c-44e0-96a4-16da9d9b73e5-ovnkube-script-lib\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077820 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66gjb\" (UniqueName: \"kubernetes.io/projected/8f20bd10-741c-44e0-96a4-16da9d9b73e5-kube-api-access-66gjb\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077820 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077492 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57919709-f632-4be9-b9c0-3ec7c5996df9-agent-certs\") pod \"konnectivity-agent-nrjxq\" (UID: \"57919709-f632-4be9-b9c0-3ec7c5996df9\") " pod="kube-system/konnectivity-agent-nrjxq" Jun 11 14:50:22.077820 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077514 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-run-ovn-kubernetes\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077820 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57919709-f632-4be9-b9c0-3ec7c5996df9-konnectivity-ca\") pod \"konnectivity-agent-nrjxq\" (UID: \"57919709-f632-4be9-b9c0-3ec7c5996df9\") " pod="kube-system/konnectivity-agent-nrjxq" Jun 11 14:50:22.077820 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077552 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-kubelet\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077820 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077565 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-slash\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077820 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-var-lib-openvswitch\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077820 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077635 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-cni-bin\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077820 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077654 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-cni-netd\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.077820 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.077667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f20bd10-741c-44e0-96a4-16da9d9b73e5-ovnkube-config\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.079141 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.079125 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 14:50:22.079244 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.079192 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 14:50:22.079380 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.079362 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 14:50:22.079553 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.079538 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.080055 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.080040 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p7hzw\"" Jun 11 14:50:22.081877 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.081859 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pq7jj\"" Jun 11 14:50:22.081877 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.081873 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 14:50:22.082100 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.081879 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:50:22.082152 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.082110 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d2dgr" Jun 11 14:50:22.082189 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.082149 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 14:50:22.084460 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.084444 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 14:50:22.084585 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.084502 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 14:50:22.084585 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.084553 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 14:50:22.084732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.084606 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m9f2x\"" Jun 11 14:50:22.084910 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.084897 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.087189 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.087164 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 14:50:22.087283 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.087221 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 14:50:22.087484 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.087450 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 14:50:22.087710 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.087492 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2r9f5\"" Jun 11 14:50:22.087710 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.087661 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.087710 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.087693 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 14:50:22.088655 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.088641 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 14:50:22.090078 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.090062 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:22.090160 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.090123 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:22.091331 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.091314 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 14:50:22.091419 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.091318 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7nt46\"" Jun 11 14:50:22.093280 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.093263 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:22.093385 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.093365 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:22.096021 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.095995 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wgzcn" Jun 11 14:50:22.098658 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.098631 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 14:50:22.098767 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.098697 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 14:50:22.098836 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.098773 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-twht9\"" Jun 11 14:50:22.099063 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.099047 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:22.099139 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.099110 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:22.101568 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.101552 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f77d4" Jun 11 14:50:22.102998 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.102974 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9l7nf" Jun 11 14:50:22.104158 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.104134 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 14:50:22.104233 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.104167 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 14:50:22.104281 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.104266 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5m6k9\"" Jun 11 14:50:22.104386 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.104370 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:50:22.110207 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.110189 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9l7nf" Jun 11 14:50:22.172830 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.172813 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 14:50:22.178368 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178349 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-run\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.178458 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178378 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f20bd10-741c-44e0-96a4-16da9d9b73e5-ovnkube-script-lib\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.178458 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-run-netns\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.178458 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178411 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-device-dir\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.178458 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178447 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.178580 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178485 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-run-netns\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.178580 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178472 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-multus-cni-dir\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.178580 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-cni-binary-copy\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.178580 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178554 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-etc-openvswitch\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.178580 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178570 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-cnibin\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.178718 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-run-netns\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.178718 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178603 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-etc-kubernetes\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.178718 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178616 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-sys-fs\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.178718 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178621 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-etc-openvswitch\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.178718 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-multus-socket-dir-parent\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.178718 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178669 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/069fde0c-1565-431f-9bde-6982d30b6b9c-iptables-alerter-script\") pod \"iptables-alerter-f77d4\" (UID: \"069fde0c-1565-431f-9bde-6982d30b6b9c\") " pod="openshift-network-operator/iptables-alerter-f77d4" Jun 11 14:50:22.178718 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178687 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-sys\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.178718 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-tuned\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.178947 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178724 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gthft\" (UniqueName: \"kubernetes.io/projected/44831467-c2ee-4ab8-867a-efd56ab5c9a3-kube-api-access-gthft\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.178947 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-var-lib-cni-multus\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.178947 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dlsq\" (UniqueName: \"kubernetes.io/projected/069fde0c-1565-431f-9bde-6982d30b6b9c-kube-api-access-2dlsq\") pod \"iptables-alerter-f77d4\" (UID: \"069fde0c-1565-431f-9bde-6982d30b6b9c\") " pod="openshift-network-operator/iptables-alerter-f77d4" Jun 11 14:50:22.178947 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-systemd-units\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.178947 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-run-systemd\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.178947 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178893 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-run-systemd\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.178947 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178905 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-run-openvswitch\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.178947 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178913 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-systemd-units\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.178947 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178940 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f20bd10-741c-44e0-96a4-16da9d9b73e5-ovnkube-script-lib\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.179374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178942 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f20bd10-741c-44e0-96a4-16da9d9b73e5-env-overrides\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.179374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.178972 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-run-openvswitch\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.179374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179044 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:22.179374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179068 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-run-multus-certs\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.179374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179085 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpj4m\" (UniqueName: \"kubernetes.io/projected/d6feb162-f5a6-4c90-b19a-829f3057794b-kube-api-access-qpj4m\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:22.179374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179115 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-node-log\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.179374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179137 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57919709-f632-4be9-b9c0-3ec7c5996df9-agent-certs\") pod \"konnectivity-agent-nrjxq\" (UID: \"57919709-f632-4be9-b9c0-3ec7c5996df9\") " pod="kube-system/konnectivity-agent-nrjxq" Jun 11 14:50:22.179374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179173 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-node-log\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.179374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179180 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/400743e8-75f6-41ed-a7d6-28b75105c435-tmp-dir\") pod \"node-resolver-wgzcn\" (UID: \"400743e8-75f6-41ed-a7d6-28b75105c435\") " pod="openshift-dns/node-resolver-wgzcn" Jun 11 14:50:22.179374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179270 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-systemd\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.179374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179292 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-host\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.179374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.179374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179333 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-multus-conf-dir\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.179374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179354 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f20bd10-741c-44e0-96a4-16da9d9b73e5-env-overrides\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.179954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-run-ovn-kubernetes\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.179954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179418 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-run-ovn-kubernetes\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.179954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179435 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 14:50:22.179954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179455 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msccq\" (UniqueName: \"kubernetes.io/projected/400743e8-75f6-41ed-a7d6-28b75105c435-kube-api-access-msccq\") pod \"node-resolver-wgzcn\" (UID: \"400743e8-75f6-41ed-a7d6-28b75105c435\") " pod="openshift-dns/node-resolver-wgzcn" Jun 11 14:50:22.179954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-socket-dir\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.179954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179513 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-cni-bin\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.179954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179539 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-cni-bin\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.179954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-cni-netd\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.179954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179716 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mgd9\" (UniqueName: \"kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9\") pod \"network-check-target-z2shj\" (UID: \"e942aa64-b57c-480b-b7a2-3541149a026e\") " pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:22.179954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179731 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1adc9c7a-52c0-4ecb-840d-d21120723856-kubelet-config\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:22.179954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179752 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.179954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-run-k8s-cni-cncf-io\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.179954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179600 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-cni-netd\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.179954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179799 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-var-lib-kubelet\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.180608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179828 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f20bd10-741c-44e0-96a4-16da9d9b73e5-ovn-node-metrics-cert\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.180608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179846 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1adc9c7a-52c0-4ecb-840d-d21120723856-dbus\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:22.180608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-kubernetes\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.180608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-sysctl-conf\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.180608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179904 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-hostroot\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.180608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179926 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqzsx\" (UniqueName: \"kubernetes.io/projected/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-kube-api-access-mqzsx\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.180608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179958 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:22.180608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.179984 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/069fde0c-1565-431f-9bde-6982d30b6b9c-host-slash\") pod \"iptables-alerter-f77d4\" (UID: \"069fde0c-1565-431f-9bde-6982d30b6b9c\") " pod="openshift-network-operator/iptables-alerter-f77d4" Jun 11 14:50:22.180608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180046 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-log-socket\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.180608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180118 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-log-socket\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.180608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180149 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f6330dcf-d467-4d44-890c-e4b689e5d451-serviceca\") pod \"node-ca-d2dgr\" (UID: \"f6330dcf-d467-4d44-890c-e4b689e5d451\") " pod="openshift-image-registry/node-ca-d2dgr" Jun 11 14:50:22.180608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180210 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57919709-f632-4be9-b9c0-3ec7c5996df9-konnectivity-ca\") pod \"konnectivity-agent-nrjxq\" (UID: \"57919709-f632-4be9-b9c0-3ec7c5996df9\") " pod="kube-system/konnectivity-agent-nrjxq" Jun 11 14:50:22.180608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-etc-selinux\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.180608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180270 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5k4z\" (UniqueName: \"kubernetes.io/projected/f6330dcf-d467-4d44-890c-e4b689e5d451-kube-api-access-g5k4z\") pod \"node-ca-d2dgr\" (UID: \"f6330dcf-d467-4d44-890c-e4b689e5d451\") " pod="openshift-image-registry/node-ca-d2dgr" Jun 11 14:50:22.181225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180377 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-cnibin\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.181225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180402 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-kubelet\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.181225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180418 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-slash\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.181225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180436 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-var-lib-openvswitch\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.181225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-modprobe-d\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.181225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180473 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-kubelet\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.181225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180481 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44831467-c2ee-4ab8-867a-efd56ab5c9a3-tmp\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.181225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-system-cni-dir\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.181225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180479 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-slash\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.181225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180513 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-var-lib-openvswitch\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.181225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180537 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66gjb\" (UniqueName: \"kubernetes.io/projected/8f20bd10-741c-44e0-96a4-16da9d9b73e5-kube-api-access-66gjb\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.181225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180556 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-run-ovn\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.181225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.181225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180599 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-sysctl-d\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.181620 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-var-lib-kubelet\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.181620 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180622 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-run-ovn\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.181620 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180649 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.181620 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180651 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f20bd10-741c-44e0-96a4-16da9d9b73e5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.181620 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvw44\" (UniqueName: \"kubernetes.io/projected/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-kube-api-access-qvw44\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.181620 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180690 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-var-lib-cni-bin\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.181620 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180730 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6330dcf-d467-4d44-890c-e4b689e5d451-host\") pod \"node-ca-d2dgr\" (UID: \"f6330dcf-d467-4d44-890c-e4b689e5d451\") " pod="openshift-image-registry/node-ca-d2dgr" Jun 11 14:50:22.181620 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-multus-daemon-config\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.181620 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180790 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xznzz\" (UniqueName: \"kubernetes.io/projected/c53f8461-c4b7-4231-a1f6-7e697eeb4902-kube-api-access-xznzz\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.181620 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180809 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/400743e8-75f6-41ed-a7d6-28b75105c435-hosts-file\") pod \"node-resolver-wgzcn\" (UID: \"400743e8-75f6-41ed-a7d6-28b75105c435\") " pod="openshift-dns/node-resolver-wgzcn" Jun 11 14:50:22.181620 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180829 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-sysconfig\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.181620 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-lib-modules\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.181620 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180826 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57919709-f632-4be9-b9c0-3ec7c5996df9-konnectivity-ca\") pod \"konnectivity-agent-nrjxq\" (UID: \"57919709-f632-4be9-b9c0-3ec7c5996df9\") " pod="kube-system/konnectivity-agent-nrjxq" Jun 11 14:50:22.181620 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-system-cni-dir\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.182066 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180932 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-registration-dir\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.182066 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.180981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f20bd10-741c-44e0-96a4-16da9d9b73e5-ovnkube-config\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.182066 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.181025 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.182066 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.181049 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-os-release\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.182066 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.181075 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-os-release\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.182066 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.181379 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f20bd10-741c-44e0-96a4-16da9d9b73e5-ovnkube-config\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.182425 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.182408 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f20bd10-741c-44e0-96a4-16da9d9b73e5-ovn-node-metrics-cert\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.182526 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.182510 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57919709-f632-4be9-b9c0-3ec7c5996df9-agent-certs\") pod \"konnectivity-agent-nrjxq\" (UID: \"57919709-f632-4be9-b9c0-3ec7c5996df9\") " pod="kube-system/konnectivity-agent-nrjxq" Jun 11 14:50:22.187906 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.187887 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66gjb\" (UniqueName: \"kubernetes.io/projected/8f20bd10-741c-44e0-96a4-16da9d9b73e5-kube-api-access-66gjb\") pod \"ovnkube-node-p9j5j\" (UID: \"8f20bd10-741c-44e0-96a4-16da9d9b73e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.243336 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:22.242102 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499b78f6b57b020e19855dcaf8481477.slice/crio-eb4523aab57363b41a54ff60b246caa110af775fae3de2655461200253c81f6f WatchSource:0}: Error finding container eb4523aab57363b41a54ff60b246caa110af775fae3de2655461200253c81f6f: Status 404 returned error can't find the container with id eb4523aab57363b41a54ff60b246caa110af775fae3de2655461200253c81f6f Jun 11 14:50:22.244583 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:22.244557 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe2e7933575dc010206caac2bcc7daeb.slice/crio-6af0127fc8e915278c8e6804b1f2945b1f063c9584f106d39202b95ec145911f WatchSource:0}: Error finding container 6af0127fc8e915278c8e6804b1f2945b1f063c9584f106d39202b95ec145911f: Status 404 returned error can't find the container with id 6af0127fc8e915278c8e6804b1f2945b1f063c9584f106d39202b95ec145911f Jun 11 14:50:22.249331 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.249317 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:50:22.281339 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281305 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpj4m\" (UniqueName: \"kubernetes.io/projected/d6feb162-f5a6-4c90-b19a-829f3057794b-kube-api-access-qpj4m\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:22.281467 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281347 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/400743e8-75f6-41ed-a7d6-28b75105c435-tmp-dir\") pod \"node-resolver-wgzcn\" (UID: \"400743e8-75f6-41ed-a7d6-28b75105c435\") " pod="openshift-dns/node-resolver-wgzcn" Jun 11 14:50:22.281467 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281367 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-systemd\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.281467 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281381 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-host\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.281467 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281416 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.281467 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281439 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-multus-conf-dir\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.281467 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msccq\" (UniqueName: \"kubernetes.io/projected/400743e8-75f6-41ed-a7d6-28b75105c435-kube-api-access-msccq\") pod \"node-resolver-wgzcn\" (UID: \"400743e8-75f6-41ed-a7d6-28b75105c435\") " pod="openshift-dns/node-resolver-wgzcn" Jun 11 14:50:22.281759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281487 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-socket-dir\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.281759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281490 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-host\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.281759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281511 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mgd9\" (UniqueName: \"kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9\") pod \"network-check-target-z2shj\" (UID: \"e942aa64-b57c-480b-b7a2-3541149a026e\") " pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:22.281759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281490 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-systemd\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.281759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281552 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-multus-conf-dir\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.281759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281581 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1adc9c7a-52c0-4ecb-840d-d21120723856-kubelet-config\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:22.281759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.281759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281644 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-run-k8s-cni-cncf-io\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.281759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-var-lib-kubelet\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.281759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1adc9c7a-52c0-4ecb-840d-d21120723856-dbus\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:22.281759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281720 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-kubernetes\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.281759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281726 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/400743e8-75f6-41ed-a7d6-28b75105c435-tmp-dir\") pod \"node-resolver-wgzcn\" (UID: \"400743e8-75f6-41ed-a7d6-28b75105c435\") " pod="openshift-dns/node-resolver-wgzcn" Jun 11 14:50:22.281759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-sysctl-conf\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281770 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-hostroot\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281782 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-var-lib-kubelet\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281742 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-socket-dir\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281797 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-kubernetes\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqzsx\" (UniqueName: \"kubernetes.io/projected/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-kube-api-access-mqzsx\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281825 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-run-k8s-cni-cncf-io\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281848 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-hostroot\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281864 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1adc9c7a-52c0-4ecb-840d-d21120723856-dbus\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281852 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281906 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/069fde0c-1565-431f-9bde-6982d30b6b9c-host-slash\") pod \"iptables-alerter-f77d4\" (UID: \"069fde0c-1565-431f-9bde-6982d30b6b9c\") " pod="openshift-network-operator/iptables-alerter-f77d4" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281919 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-sysctl-conf\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281849 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1adc9c7a-52c0-4ecb-840d-d21120723856-kubelet-config\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f6330dcf-d467-4d44-890c-e4b689e5d451-serviceca\") pod \"node-ca-d2dgr\" (UID: \"f6330dcf-d467-4d44-890c-e4b689e5d451\") " pod="openshift-image-registry/node-ca-d2dgr" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281804 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.282329 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281960 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-etc-selinux\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.282997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.281971 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/069fde0c-1565-431f-9bde-6982d30b6b9c-host-slash\") pod \"iptables-alerter-f77d4\" (UID: \"069fde0c-1565-431f-9bde-6982d30b6b9c\") " pod="openshift-network-operator/iptables-alerter-f77d4" Jun 11 14:50:22.282997 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.281997 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:22.282997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282028 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-etc-selinux\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.282997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5k4z\" (UniqueName: \"kubernetes.io/projected/f6330dcf-d467-4d44-890c-e4b689e5d451-kube-api-access-g5k4z\") pod \"node-ca-d2dgr\" (UID: \"f6330dcf-d467-4d44-890c-e4b689e5d451\") " pod="openshift-image-registry/node-ca-d2dgr" Jun 11 14:50:22.282997 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.282077 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs podName:d6feb162-f5a6-4c90-b19a-829f3057794b nodeName:}" failed. No retries permitted until 2026-06-11 14:50:22.782057102 +0000 UTC m=+2.040308491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs") pod "network-metrics-daemon-q68m6" (UID: "d6feb162-f5a6-4c90-b19a-829f3057794b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:22.282997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-cnibin\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.282997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-modprobe-d\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.282997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282149 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-cnibin\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.282997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282165 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44831467-c2ee-4ab8-867a-efd56ab5c9a3-tmp\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.282997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282180 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.282997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282208 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-system-cni-dir\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.282997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282243 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-sysctl-d\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.282997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282268 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-var-lib-kubelet\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.282997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282277 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-system-cni-dir\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282293 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282297 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-modprobe-d\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282320 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvw44\" (UniqueName: \"kubernetes.io/projected/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-kube-api-access-qvw44\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282331 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-var-lib-kubelet\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282344 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-var-lib-cni-bin\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282346 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-sysctl-d\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282375 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6330dcf-d467-4d44-890c-e4b689e5d451-host\") pod \"node-ca-d2dgr\" (UID: \"f6330dcf-d467-4d44-890c-e4b689e5d451\") " pod="openshift-image-registry/node-ca-d2dgr" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282391 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-var-lib-cni-bin\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282348 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f6330dcf-d467-4d44-890c-e4b689e5d451-serviceca\") pod \"node-ca-d2dgr\" (UID: \"f6330dcf-d467-4d44-890c-e4b689e5d451\") " pod="openshift-image-registry/node-ca-d2dgr" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-multus-daemon-config\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282434 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6330dcf-d467-4d44-890c-e4b689e5d451-host\") pod \"node-ca-d2dgr\" (UID: \"f6330dcf-d467-4d44-890c-e4b689e5d451\") " pod="openshift-image-registry/node-ca-d2dgr" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xznzz\" (UniqueName: \"kubernetes.io/projected/c53f8461-c4b7-4231-a1f6-7e697eeb4902-kube-api-access-xznzz\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282462 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/400743e8-75f6-41ed-a7d6-28b75105c435-hosts-file\") pod \"node-resolver-wgzcn\" (UID: \"400743e8-75f6-41ed-a7d6-28b75105c435\") " pod="openshift-dns/node-resolver-wgzcn" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-sysconfig\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.283674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282508 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-lib-modules\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282533 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-system-cni-dir\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282547 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/400743e8-75f6-41ed-a7d6-28b75105c435-hosts-file\") pod \"node-resolver-wgzcn\" (UID: \"400743e8-75f6-41ed-a7d6-28b75105c435\") " pod="openshift-dns/node-resolver-wgzcn" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-registration-dir\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282599 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-os-release\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282631 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-lib-modules\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282643 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-system-cni-dir\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282551 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-sysconfig\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282601 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-registration-dir\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-os-release\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-run\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282687 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282714 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-os-release\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282714 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-os-release\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-device-dir\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282753 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-run\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282754 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282786 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282796 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-device-dir\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282818 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-multus-cni-dir\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282842 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-cni-binary-copy\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282869 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-cnibin\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282901 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-run-netns\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282912 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-multus-cni-dir\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282925 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-etc-kubernetes\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282940 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-cnibin\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282950 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-sys-fs\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282914 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-multus-daemon-config\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282952 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-run-netns\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282962 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-etc-kubernetes\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.282991 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-multus-socket-dir-parent\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283001 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c53f8461-c4b7-4231-a1f6-7e697eeb4902-sys-fs\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.284953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/069fde0c-1565-431f-9bde-6982d30b6b9c-iptables-alerter-script\") pod \"iptables-alerter-f77d4\" (UID: \"069fde0c-1565-431f-9bde-6982d30b6b9c\") " pod="openshift-network-operator/iptables-alerter-f77d4" Jun 11 14:50:22.284953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283055 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-multus-socket-dir-parent\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283059 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-sys\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.284953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283094 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-tuned\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.284953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283099 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44831467-c2ee-4ab8-867a-efd56ab5c9a3-sys\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.284953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283121 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gthft\" (UniqueName: \"kubernetes.io/projected/44831467-c2ee-4ab8-867a-efd56ab5c9a3-kube-api-access-gthft\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.284953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283272 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.284953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283327 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-cni-binary-copy\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-var-lib-cni-multus\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dlsq\" (UniqueName: \"kubernetes.io/projected/069fde0c-1565-431f-9bde-6982d30b6b9c-kube-api-access-2dlsq\") pod \"iptables-alerter-f77d4\" (UID: \"069fde0c-1565-431f-9bde-6982d30b6b9c\") " pod="openshift-network-operator/iptables-alerter-f77d4" Jun 11 14:50:22.284953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283419 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-var-lib-cni-multus\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.284953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283443 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:22.285418 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-run-multus-certs\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.285418 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283518 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-host-run-multus-certs\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.285418 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.283581 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:22.285418 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.283621 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret podName:1adc9c7a-52c0-4ecb-840d-d21120723856 nodeName:}" failed. No retries permitted until 2026-06-11 14:50:22.783608574 +0000 UTC m=+2.041859955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret") pod "global-pull-secret-syncer-w48cb" (UID: "1adc9c7a-52c0-4ecb-840d-d21120723856") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:22.285418 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.283617 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/069fde0c-1565-431f-9bde-6982d30b6b9c-iptables-alerter-script\") pod \"iptables-alerter-f77d4\" (UID: \"069fde0c-1565-431f-9bde-6982d30b6b9c\") " pod="openshift-network-operator/iptables-alerter-f77d4" Jun 11 14:50:22.285418 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.285137 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44831467-c2ee-4ab8-867a-efd56ab5c9a3-tmp\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.285418 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.285233 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44831467-c2ee-4ab8-867a-efd56ab5c9a3-etc-tuned\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.291992 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.291966 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msccq\" (UniqueName: \"kubernetes.io/projected/400743e8-75f6-41ed-a7d6-28b75105c435-kube-api-access-msccq\") pod \"node-resolver-wgzcn\" (UID: \"400743e8-75f6-41ed-a7d6-28b75105c435\") " pod="openshift-dns/node-resolver-wgzcn" Jun 11 14:50:22.292224 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.292206 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpj4m\" (UniqueName: \"kubernetes.io/projected/d6feb162-f5a6-4c90-b19a-829f3057794b-kube-api-access-qpj4m\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:22.296038 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.296000 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:50:22.296038 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.296031 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:50:22.296038 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.296041 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4mgd9 for pod openshift-network-diagnostics/network-check-target-z2shj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:22.296223 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.296087 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9 podName:e942aa64-b57c-480b-b7a2-3541149a026e nodeName:}" failed. No retries permitted until 2026-06-11 14:50:22.796072883 +0000 UTC m=+2.054324287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4mgd9" (UniqueName: "kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9") pod "network-check-target-z2shj" (UID: "e942aa64-b57c-480b-b7a2-3541149a026e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:22.297677 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.297657 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqzsx\" (UniqueName: \"kubernetes.io/projected/ca9ef755-34a9-4bb6-8d5a-2b19abb89860-kube-api-access-mqzsx\") pod \"multus-sgfjr\" (UID: \"ca9ef755-34a9-4bb6-8d5a-2b19abb89860\") " pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.318737 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.318712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dlsq\" (UniqueName: \"kubernetes.io/projected/069fde0c-1565-431f-9bde-6982d30b6b9c-kube-api-access-2dlsq\") pod \"iptables-alerter-f77d4\" (UID: \"069fde0c-1565-431f-9bde-6982d30b6b9c\") " pod="openshift-network-operator/iptables-alerter-f77d4" Jun 11 14:50:22.318875 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.318859 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvw44\" (UniqueName: \"kubernetes.io/projected/5f4cfe08-2925-42b4-9c7d-43a438ec56ea-kube-api-access-qvw44\") pod \"multus-additional-cni-plugins-skznz\" (UID: \"5f4cfe08-2925-42b4-9c7d-43a438ec56ea\") " pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.319391 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.319370 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5k4z\" (UniqueName: \"kubernetes.io/projected/f6330dcf-d467-4d44-890c-e4b689e5d451-kube-api-access-g5k4z\") pod \"node-ca-d2dgr\" (UID: \"f6330dcf-d467-4d44-890c-e4b689e5d451\") " pod="openshift-image-registry/node-ca-d2dgr" Jun 11 14:50:22.319875 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.319856 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gthft\" (UniqueName: \"kubernetes.io/projected/44831467-c2ee-4ab8-867a-efd56ab5c9a3-kube-api-access-gthft\") pod \"tuned-qg6xg\" (UID: \"44831467-c2ee-4ab8-867a-efd56ab5c9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.319932 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.319861 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xznzz\" (UniqueName: \"kubernetes.io/projected/c53f8461-c4b7-4231-a1f6-7e697eeb4902-kube-api-access-xznzz\") pod \"aws-ebs-csi-driver-node-nncjm\" (UID: \"c53f8461-c4b7-4231-a1f6-7e697eeb4902\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.393031 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.392982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:22.402490 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:22.402467 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f20bd10_741c_44e0_96a4_16da9d9b73e5.slice/crio-93cec4c2851174656a4947f871a50fa840484f56e97191b57ad2396f9d56724c WatchSource:0}: Error finding container 93cec4c2851174656a4947f871a50fa840484f56e97191b57ad2396f9d56724c: Status 404 returned error can't find the container with id 93cec4c2851174656a4947f871a50fa840484f56e97191b57ad2396f9d56724c Jun 11 14:50:22.408720 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.408701 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nrjxq" Jun 11 14:50:22.414424 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.414405 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" Jun 11 14:50:22.416327 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:22.416299 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57919709_f632_4be9_b9c0_3ec7c5996df9.slice/crio-8e69affc50c3999cd2a23b052d9b34a817ffbfcedde501f1457acc466ba9b7aa WatchSource:0}: Error finding container 8e69affc50c3999cd2a23b052d9b34a817ffbfcedde501f1457acc466ba9b7aa: Status 404 returned error can't find the container with id 8e69affc50c3999cd2a23b052d9b34a817ffbfcedde501f1457acc466ba9b7aa Jun 11 14:50:22.422579 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:22.422558 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc53f8461_c4b7_4231_a1f6_7e697eeb4902.slice/crio-1c083d7e0391e278d99453e99770c6f22535ec68a302a129ba3593f48d3e1f5d WatchSource:0}: Error finding container 1c083d7e0391e278d99453e99770c6f22535ec68a302a129ba3593f48d3e1f5d: Status 404 returned error can't find the container with id 1c083d7e0391e278d99453e99770c6f22535ec68a302a129ba3593f48d3e1f5d Jun 11 14:50:22.432857 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.432839 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" Jun 11 14:50:22.440621 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:22.440602 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44831467_c2ee_4ab8_867a_efd56ab5c9a3.slice/crio-f9fdd6ac8991961ebc877d2ba9e9d73a5bc289cba9e613a9d6cc3fac76f1139b WatchSource:0}: Error finding container f9fdd6ac8991961ebc877d2ba9e9d73a5bc289cba9e613a9d6cc3fac76f1139b: Status 404 returned error can't find the container with id f9fdd6ac8991961ebc877d2ba9e9d73a5bc289cba9e613a9d6cc3fac76f1139b Jun 11 14:50:22.453651 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.453637 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d2dgr" Jun 11 14:50:22.461951 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:22.461930 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6330dcf_d467_4d44_890c_e4b689e5d451.slice/crio-2d849e06c30cf7715e5f67a7f552db6b3fd52781310ef069e72dfbc16d4f29fa WatchSource:0}: Error finding container 2d849e06c30cf7715e5f67a7f552db6b3fd52781310ef069e72dfbc16d4f29fa: Status 404 returned error can't find the container with id 2d849e06c30cf7715e5f67a7f552db6b3fd52781310ef069e72dfbc16d4f29fa Jun 11 14:50:22.470642 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.470623 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-skznz" Jun 11 14:50:22.480081 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:22.480058 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4cfe08_2925_42b4_9c7d_43a438ec56ea.slice/crio-bd1623d66ee84404b6716f5b899794a2448850a72a8ef759e85663383240e487 WatchSource:0}: Error finding container bd1623d66ee84404b6716f5b899794a2448850a72a8ef759e85663383240e487: Status 404 returned error can't find the container with id bd1623d66ee84404b6716f5b899794a2448850a72a8ef759e85663383240e487 Jun 11 14:50:22.484798 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.484780 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:50:22.490982 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.490966 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sgfjr" Jun 11 14:50:22.496723 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.496708 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wgzcn" Jun 11 14:50:22.498887 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:22.498864 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9ef755_34a9_4bb6_8d5a_2b19abb89860.slice/crio-e00312337a0f5d28b8d7941bac5945645c3772352133c72af011d4be9cd54a4a WatchSource:0}: Error finding container e00312337a0f5d28b8d7941bac5945645c3772352133c72af011d4be9cd54a4a: Status 404 returned error can't find the container with id e00312337a0f5d28b8d7941bac5945645c3772352133c72af011d4be9cd54a4a Jun 11 14:50:22.500213 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.500196 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f77d4" Jun 11 14:50:22.504946 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:22.504929 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400743e8_75f6_41ed_a7d6_28b75105c435.slice/crio-a77c19ef698aa62731e9527d264c1595de0d3f681a0fc9ec2cc318655ec73397 WatchSource:0}: Error finding container a77c19ef698aa62731e9527d264c1595de0d3f681a0fc9ec2cc318655ec73397: Status 404 returned error can't find the container with id a77c19ef698aa62731e9527d264c1595de0d3f681a0fc9ec2cc318655ec73397 Jun 11 14:50:22.508509 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:22.508489 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069fde0c_1565_431f_9bde_6982d30b6b9c.slice/crio-21a24e4c06a6aebdd8ab001ef527476c59e7e893108a542caf9afbf858e55fb6 WatchSource:0}: Error finding container 21a24e4c06a6aebdd8ab001ef527476c59e7e893108a542caf9afbf858e55fb6: Status 404 returned error can't find the container with id 21a24e4c06a6aebdd8ab001ef527476c59e7e893108a542caf9afbf858e55fb6 Jun 11 14:50:22.787472 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.787387 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:22.787630 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.787479 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:22.787630 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.787612 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:22.787740 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.787676 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret podName:1adc9c7a-52c0-4ecb-840d-d21120723856 nodeName:}" failed. No retries permitted until 2026-06-11 14:50:23.787650528 +0000 UTC m=+3.045901914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret") pod "global-pull-secret-syncer-w48cb" (UID: "1adc9c7a-52c0-4ecb-840d-d21120723856") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:22.788102 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.788085 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:22.788197 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.788134 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs podName:d6feb162-f5a6-4c90-b19a-829f3057794b nodeName:}" failed. No retries permitted until 2026-06-11 14:50:23.788119925 +0000 UTC m=+3.046371300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs") pod "network-metrics-daemon-q68m6" (UID: "d6feb162-f5a6-4c90-b19a-829f3057794b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:22.888813 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:22.888774 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mgd9\" (UniqueName: \"kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9\") pod \"network-check-target-z2shj\" (UID: \"e942aa64-b57c-480b-b7a2-3541149a026e\") " pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:22.888978 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.888957 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:50:22.888978 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.888976 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:50:22.889105 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.888988 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4mgd9 for pod openshift-network-diagnostics/network-check-target-z2shj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:22.889105 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:22.889064 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9 podName:e942aa64-b57c-480b-b7a2-3541149a026e nodeName:}" failed. No retries permitted until 2026-06-11 14:50:23.889047623 +0000 UTC m=+3.147299004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mgd9" (UniqueName: "kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9") pod "network-check-target-z2shj" (UID: "e942aa64-b57c-480b-b7a2-3541149a026e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:23.114057 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.114017 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:45:22 +0000 UTC" deadline="2028-03-29 01:43:15.415682854 +0000 UTC" Jun 11 14:50:23.114057 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.114052 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15754h52m52.301635949s" Jun 11 14:50:23.182871 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.182257 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:23.182871 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:23.182415 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:23.202570 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.202487 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" event={"ID":"c53f8461-c4b7-4231-a1f6-7e697eeb4902","Type":"ContainerStarted","Data":"1c083d7e0391e278d99453e99770c6f22535ec68a302a129ba3593f48d3e1f5d"} Jun 11 14:50:23.214168 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.214133 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" event={"ID":"8f20bd10-741c-44e0-96a4-16da9d9b73e5","Type":"ContainerStarted","Data":"93cec4c2851174656a4947f871a50fa840484f56e97191b57ad2396f9d56724c"} Jun 11 14:50:23.235962 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.235865 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-91.ec2.internal" event={"ID":"499b78f6b57b020e19855dcaf8481477","Type":"ContainerStarted","Data":"eb4523aab57363b41a54ff60b246caa110af775fae3de2655461200253c81f6f"} Jun 11 14:50:23.254335 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.254299 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f77d4" event={"ID":"069fde0c-1565-431f-9bde-6982d30b6b9c","Type":"ContainerStarted","Data":"21a24e4c06a6aebdd8ab001ef527476c59e7e893108a542caf9afbf858e55fb6"} Jun 11 14:50:23.264965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.264905 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wgzcn" event={"ID":"400743e8-75f6-41ed-a7d6-28b75105c435","Type":"ContainerStarted","Data":"a77c19ef698aa62731e9527d264c1595de0d3f681a0fc9ec2cc318655ec73397"} Jun 11 14:50:23.272883 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.272857 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sgfjr" event={"ID":"ca9ef755-34a9-4bb6-8d5a-2b19abb89860","Type":"ContainerStarted","Data":"e00312337a0f5d28b8d7941bac5945645c3772352133c72af011d4be9cd54a4a"} Jun 11 14:50:23.286067 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.286034 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skznz" event={"ID":"5f4cfe08-2925-42b4-9c7d-43a438ec56ea","Type":"ContainerStarted","Data":"bd1623d66ee84404b6716f5b899794a2448850a72a8ef759e85663383240e487"} Jun 11 14:50:23.297650 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.297554 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:50:23.299276 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.299105 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nrjxq" event={"ID":"57919709-f632-4be9-b9c0-3ec7c5996df9","Type":"ContainerStarted","Data":"8e69affc50c3999cd2a23b052d9b34a817ffbfcedde501f1457acc466ba9b7aa"} Jun 11 14:50:23.328589 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.328555 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal" event={"ID":"fe2e7933575dc010206caac2bcc7daeb","Type":"ContainerStarted","Data":"6af0127fc8e915278c8e6804b1f2945b1f063c9584f106d39202b95ec145911f"} Jun 11 14:50:23.339855 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.339822 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d2dgr" event={"ID":"f6330dcf-d467-4d44-890c-e4b689e5d451","Type":"ContainerStarted","Data":"2d849e06c30cf7715e5f67a7f552db6b3fd52781310ef069e72dfbc16d4f29fa"} Jun 11 14:50:23.345096 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.345067 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:50:23.353714 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.353644 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" event={"ID":"44831467-c2ee-4ab8-867a-efd56ab5c9a3","Type":"ContainerStarted","Data":"f9fdd6ac8991961ebc877d2ba9e9d73a5bc289cba9e613a9d6cc3fac76f1139b"} Jun 11 14:50:23.797069 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.796975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:23.797230 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.797080 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:23.797303 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:23.797232 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:23.797303 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:23.797297 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs podName:d6feb162-f5a6-4c90-b19a-829f3057794b nodeName:}" failed. No retries permitted until 2026-06-11 14:50:25.79727769 +0000 UTC m=+5.055529085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs") pod "network-metrics-daemon-q68m6" (UID: "d6feb162-f5a6-4c90-b19a-829f3057794b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:23.797707 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:23.797685 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:23.797784 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:23.797746 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret podName:1adc9c7a-52c0-4ecb-840d-d21120723856 nodeName:}" failed. No retries permitted until 2026-06-11 14:50:25.797731247 +0000 UTC m=+5.055982623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret") pod "global-pull-secret-syncer-w48cb" (UID: "1adc9c7a-52c0-4ecb-840d-d21120723856") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:23.897907 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:23.897871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mgd9\" (UniqueName: \"kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9\") pod \"network-check-target-z2shj\" (UID: \"e942aa64-b57c-480b-b7a2-3541149a026e\") " pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:23.898128 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:23.898109 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:50:23.898263 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:23.898135 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:50:23.898263 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:23.898148 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4mgd9 for pod openshift-network-diagnostics/network-check-target-z2shj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:23.898263 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:23.898210 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9 podName:e942aa64-b57c-480b-b7a2-3541149a026e nodeName:}" failed. No retries permitted until 2026-06-11 14:50:25.898190359 +0000 UTC m=+5.156441733 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mgd9" (UniqueName: "kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9") pod "network-check-target-z2shj" (UID: "e942aa64-b57c-480b-b7a2-3541149a026e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:24.114890 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:24.114772 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:45:22 +0000 UTC" deadline="2028-02-11 23:34:51.782332454 +0000 UTC" Jun 11 14:50:24.114890 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:24.114868 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14648h44m27.667469041s" Jun 11 14:50:24.176418 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:24.176387 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:24.176594 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:24.176530 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:24.176658 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:24.176617 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:24.176710 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:24.176694 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:24.913734 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:24.913690 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:50:25.179112 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:25.178551 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:25.179112 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:25.178671 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:25.817377 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:25.817343 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:25.817558 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:25.817425 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:25.817661 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:25.817573 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:25.817661 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:25.817631 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs podName:d6feb162-f5a6-4c90-b19a-829f3057794b nodeName:}" failed. No retries permitted until 2026-06-11 14:50:29.817612033 +0000 UTC m=+9.075863407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs") pod "network-metrics-daemon-q68m6" (UID: "d6feb162-f5a6-4c90-b19a-829f3057794b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:25.818054 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:25.818032 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:25.818179 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:25.818091 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret podName:1adc9c7a-52c0-4ecb-840d-d21120723856 nodeName:}" failed. No retries permitted until 2026-06-11 14:50:29.818074262 +0000 UTC m=+9.076325647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret") pod "global-pull-secret-syncer-w48cb" (UID: "1adc9c7a-52c0-4ecb-840d-d21120723856") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:25.918604 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:25.918484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mgd9\" (UniqueName: \"kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9\") pod \"network-check-target-z2shj\" (UID: \"e942aa64-b57c-480b-b7a2-3541149a026e\") " pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:25.918775 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:25.918683 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:50:25.918775 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:25.918708 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:50:25.918775 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:25.918721 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4mgd9 for pod openshift-network-diagnostics/network-check-target-z2shj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:25.918955 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:25.918784 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9 podName:e942aa64-b57c-480b-b7a2-3541149a026e nodeName:}" failed. No retries permitted until 2026-06-11 14:50:29.918764544 +0000 UTC m=+9.177015919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mgd9" (UniqueName: "kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9") pod "network-check-target-z2shj" (UID: "e942aa64-b57c-480b-b7a2-3541149a026e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:26.176235 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:26.175664 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:26.176235 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:26.175674 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:26.176235 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:26.175829 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:26.176235 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:26.175851 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:27.176153 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:27.176100 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:27.176575 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:27.176246 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:28.176408 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:28.176366 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:28.176844 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:28.176419 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:28.176844 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:28.176522 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:28.176844 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:28.176709 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:29.176211 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:29.176175 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:29.176399 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:29.176303 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:29.852481 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:29.852413 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:29.852481 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:29.852487 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:29.852976 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:29.852610 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:29.852976 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:29.852610 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:29.852976 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:29.852678 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs podName:d6feb162-f5a6-4c90-b19a-829f3057794b nodeName:}" failed. No retries permitted until 2026-06-11 14:50:37.852657776 +0000 UTC m=+17.110909148 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs") pod "network-metrics-daemon-q68m6" (UID: "d6feb162-f5a6-4c90-b19a-829f3057794b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:29.852976 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:29.852699 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret podName:1adc9c7a-52c0-4ecb-840d-d21120723856 nodeName:}" failed. No retries permitted until 2026-06-11 14:50:37.852687497 +0000 UTC m=+17.110938872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret") pod "global-pull-secret-syncer-w48cb" (UID: "1adc9c7a-52c0-4ecb-840d-d21120723856") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:29.952958 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:29.952919 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mgd9\" (UniqueName: \"kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9\") pod \"network-check-target-z2shj\" (UID: \"e942aa64-b57c-480b-b7a2-3541149a026e\") " pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:29.953149 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:29.953134 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:50:29.953216 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:29.953160 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:50:29.953216 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:29.953175 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4mgd9 for pod openshift-network-diagnostics/network-check-target-z2shj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:29.953311 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:29.953237 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9 podName:e942aa64-b57c-480b-b7a2-3541149a026e nodeName:}" failed. No retries permitted until 2026-06-11 14:50:37.953218117 +0000 UTC m=+17.211469500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mgd9" (UniqueName: "kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9") pod "network-check-target-z2shj" (UID: "e942aa64-b57c-480b-b7a2-3541149a026e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:30.176016 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:30.175886 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:30.176016 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:30.175888 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:30.176257 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:30.176062 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:30.176257 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:30.176130 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:31.177072 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:31.177036 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:31.177624 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:31.177145 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:32.176322 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:32.176285 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:32.176484 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:32.176286 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:32.176484 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:32.176403 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:32.176608 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:32.176506 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:33.175707 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:33.175545 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:33.176063 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:33.175813 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:34.175468 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:34.175437 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:34.175624 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:34.175563 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:34.175624 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:34.175613 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:34.175751 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:34.175703 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:35.176392 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:35.176358 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:35.176802 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:35.176490 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:36.175749 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:36.175714 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:36.175749 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:36.175753 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:36.175988 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:36.175843 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:36.176079 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:36.176020 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:37.176453 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:37.176415 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:37.176912 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:37.176547 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:37.913608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:37.913573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:37.913811 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:37.913708 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:37.913811 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:37.913746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:37.913811 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:37.913783 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret podName:1adc9c7a-52c0-4ecb-840d-d21120723856 nodeName:}" failed. No retries permitted until 2026-06-11 14:50:53.91376404 +0000 UTC m=+33.172015422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret") pod "global-pull-secret-syncer-w48cb" (UID: "1adc9c7a-52c0-4ecb-840d-d21120723856") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:37.913987 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:37.913845 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:37.913987 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:37.913896 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs podName:d6feb162-f5a6-4c90-b19a-829f3057794b nodeName:}" failed. No retries permitted until 2026-06-11 14:50:53.913882821 +0000 UTC m=+33.172134209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs") pod "network-metrics-daemon-q68m6" (UID: "d6feb162-f5a6-4c90-b19a-829f3057794b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:38.014613 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:38.014575 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mgd9\" (UniqueName: \"kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9\") pod \"network-check-target-z2shj\" (UID: \"e942aa64-b57c-480b-b7a2-3541149a026e\") " pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:38.014787 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:38.014758 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:50:38.014787 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:38.014787 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:50:38.014903 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:38.014800 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4mgd9 for pod openshift-network-diagnostics/network-check-target-z2shj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:38.014903 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:38.014865 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9 podName:e942aa64-b57c-480b-b7a2-3541149a026e nodeName:}" failed. No retries permitted until 2026-06-11 14:50:54.014846188 +0000 UTC m=+33.273097574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mgd9" (UniqueName: "kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9") pod "network-check-target-z2shj" (UID: "e942aa64-b57c-480b-b7a2-3541149a026e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:38.175735 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:38.175651 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:38.175884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:38.175655 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:38.175884 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:38.175804 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:38.176002 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:38.175897 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:39.175599 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:39.175559 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:39.176092 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:39.175700 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:40.176110 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:40.176069 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:40.176589 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:40.176069 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:40.176589 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:40.176218 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:40.176589 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:40.176303 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:41.176859 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:41.176824 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:41.177259 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:41.176972 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:42.175783 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:42.175737 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:42.176059 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:42.175855 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:42.176059 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:42.175920 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:42.176164 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:42.176069 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:43.175694 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:43.175660 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:43.176368 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:43.175799 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:43.406503 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:43.406475 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 14:50:43.407295 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:43.406993 2574 generic.go:356] "Generic (PLEG): container finished" podID="8f20bd10-741c-44e0-96a4-16da9d9b73e5" containerID="39f1f15f46c00a0ac183de545f85da4822dab86ae19b0ca8e0b54b7d27dafdde" exitCode=1 Jun 11 14:50:43.407295 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:43.407114 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" event={"ID":"8f20bd10-741c-44e0-96a4-16da9d9b73e5","Type":"ContainerDied","Data":"39f1f15f46c00a0ac183de545f85da4822dab86ae19b0ca8e0b54b7d27dafdde"} Jun 11 14:50:43.407295 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:43.407239 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" event={"ID":"8f20bd10-741c-44e0-96a4-16da9d9b73e5","Type":"ContainerStarted","Data":"39d263c26e78e5e12f255fb98d1e28df75c6a0c7df101b870e36fc589db18df3"} Jun 11 14:50:43.409561 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:43.409532 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-91.ec2.internal" event={"ID":"499b78f6b57b020e19855dcaf8481477","Type":"ContainerStarted","Data":"4a7e093ed1b89384dd14f2b298ec97bd2b8d76224955a9feac3afdbcd5da8ac6"} Jun 11 14:50:43.411227 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:43.411202 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sgfjr" event={"ID":"ca9ef755-34a9-4bb6-8d5a-2b19abb89860","Type":"ContainerStarted","Data":"36b62d60984416f264663d0633af16eb3e82a77d5657c95ab3f3f128942b09f5"} Jun 11 14:50:43.412586 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:43.412565 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" event={"ID":"44831467-c2ee-4ab8-867a-efd56ab5c9a3","Type":"ContainerStarted","Data":"9612c95c2c96007456db8f443a03a3eb011a087922cc187b5d476b2c5f61866a"} Jun 11 14:50:43.423237 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:43.423186 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-91.ec2.internal" podStartSLOduration=22.423172615 podStartE2EDuration="22.423172615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:43.422668253 +0000 UTC m=+22.680919645" watchObservedRunningTime="2026-06-11 14:50:43.423172615 +0000 UTC m=+22.681424005" Jun 11 14:50:43.439234 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:43.439191 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sgfjr" podStartSLOduration=2.150688843 podStartE2EDuration="22.439175489s" totalImagesPullingTime="20.288486646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:43.438489404 +0000 UTC m=+22.696740818" watchObservedRunningTime="2026-06-11 14:50:43.439175489 +0000 UTC m=+22.697426894" Jun 11 14:50:43.454083 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:43.454039 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qg6xg" podStartSLOduration=2.143038213 podStartE2EDuration="22.45402386s" totalImagesPullingTime="20.310985647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:43.453807756 +0000 UTC m=+22.712059148" watchObservedRunningTime="2026-06-11 14:50:43.45402386 +0000 UTC m=+22.712275242" Jun 11 14:50:44.175730 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.175490 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:44.176404 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.175547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:44.176404 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:44.175795 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:44.176404 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:44.175827 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:44.417194 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.417161 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nrjxq" event={"ID":"57919709-f632-4be9-b9c0-3ec7c5996df9","Type":"ContainerStarted","Data":"dfe0bde74917798444ca54863ac25667350cf3366aaca8e4a701208d4265823c"} Jun 11 14:50:44.419950 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.419916 2574 generic.go:356] "Generic (PLEG): container finished" podID="fe2e7933575dc010206caac2bcc7daeb" containerID="7ec55c4dd4e34b50f705b6957002736ef7b2e205c9835d08e10ea66e8943a9e8" exitCode=0 Jun 11 14:50:44.420121 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.420048 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal" event={"ID":"fe2e7933575dc010206caac2bcc7daeb","Type":"ContainerDied","Data":"7ec55c4dd4e34b50f705b6957002736ef7b2e205c9835d08e10ea66e8943a9e8"} Jun 11 14:50:44.423277 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.423241 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d2dgr" event={"ID":"f6330dcf-d467-4d44-890c-e4b689e5d451","Type":"ContainerStarted","Data":"95c001dd44766852c46a218ec62ced8b52cdb59b3202743fcefcc36eea34a916"} Jun 11 14:50:44.424884 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.424858 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" event={"ID":"c53f8461-c4b7-4231-a1f6-7e697eeb4902","Type":"ContainerStarted","Data":"e5dafef01cb93151d80070358db1e9dd76b5484dce50628e8e2ee362fbc88715"} Jun 11 14:50:44.427979 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.427932 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 14:50:44.428422 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.428399 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" event={"ID":"8f20bd10-741c-44e0-96a4-16da9d9b73e5","Type":"ContainerStarted","Data":"327a93adb8781867e450362e2ec57b0775e1660faa75588e6ea494f0a5247ba0"} Jun 11 14:50:44.428523 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.428471 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" event={"ID":"8f20bd10-741c-44e0-96a4-16da9d9b73e5","Type":"ContainerStarted","Data":"bb3781e95c0157bc448ed9603a8f41d22507c059f27629a446f8db7ddfe309f0"} Jun 11 14:50:44.428624 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.428537 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" event={"ID":"8f20bd10-741c-44e0-96a4-16da9d9b73e5","Type":"ContainerStarted","Data":"109e2fcb8a6b0e0b1e1c32d6e0d18210eafc0e1a3826025008a8fa1b880bbc3e"} Jun 11 14:50:44.428624 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.428585 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" event={"ID":"8f20bd10-741c-44e0-96a4-16da9d9b73e5","Type":"ContainerStarted","Data":"f8fd4290b7c6d10fd42c72db1bd65ed37259ebf828ca8de8069e8e10a37ba4b9"} Jun 11 14:50:44.430099 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.429812 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f77d4" event={"ID":"069fde0c-1565-431f-9bde-6982d30b6b9c","Type":"ContainerStarted","Data":"90a1b08b1c0b54292e4bb6d813c75f2589d1ae276ea1a9f9c92f621808ccf186"} Jun 11 14:50:44.431315 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.431288 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wgzcn" event={"ID":"400743e8-75f6-41ed-a7d6-28b75105c435","Type":"ContainerStarted","Data":"975023b3b9e7829f9e6640360d69061cebbc9fc966809d6f92219de08a00b199"} Jun 11 14:50:44.433058 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.432999 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nrjxq" podStartSLOduration=7.075088044 podStartE2EDuration="23.432983939s" totalImagesPullingTime="16.357895895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:44.432703336 +0000 UTC m=+23.690954727" watchObservedRunningTime="2026-06-11 14:50:44.432983939 +0000 UTC m=+23.691235343" Jun 11 14:50:44.433606 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.433584 2574 generic.go:356] "Generic (PLEG): container finished" podID="5f4cfe08-2925-42b4-9c7d-43a438ec56ea" containerID="899b19016a09c209a6547ad51e067f48ad9d5b3533e5c48904d7f62be0e839f5" exitCode=0 Jun 11 14:50:44.433688 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.433629 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skznz" event={"ID":"5f4cfe08-2925-42b4-9c7d-43a438ec56ea","Type":"ContainerDied","Data":"899b19016a09c209a6547ad51e067f48ad9d5b3533e5c48904d7f62be0e839f5"} Jun 11 14:50:44.445933 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.445889 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d2dgr" podStartSLOduration=3.283717067 podStartE2EDuration="23.445872909s" totalImagesPullingTime="20.162155842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:44.445605326 +0000 UTC m=+23.703856718" watchObservedRunningTime="2026-06-11 14:50:44.445872909 +0000 UTC m=+23.704124301" Jun 11 14:50:44.472414 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.472359 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f77d4" podStartSLOduration=3.357047223 podStartE2EDuration="23.472339073s" totalImagesPullingTime="20.11529185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:44.458412582 +0000 UTC m=+23.716663973" watchObservedRunningTime="2026-06-11 14:50:44.472339073 +0000 UTC m=+23.730590465" Jun 11 14:50:44.487053 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:44.486988 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wgzcn" podStartSLOduration=3.368242874 podStartE2EDuration="23.486969105s" totalImagesPullingTime="20.118726231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:44.486111459 +0000 UTC m=+23.744362851" watchObservedRunningTime="2026-06-11 14:50:44.486969105 +0000 UTC m=+23.745220498" Jun 11 14:50:45.161438 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:45.161417 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 14:50:45.175892 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:45.175866 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:45.176271 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:45.176016 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:45.438864 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:45.438628 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal" event={"ID":"fe2e7933575dc010206caac2bcc7daeb","Type":"ContainerStarted","Data":"0f06c0a7fba27eed0e64b8a4754ba4d4e788bb21349338321f972b737179206e"} Jun 11 14:50:45.440766 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:45.440710 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" event={"ID":"c53f8461-c4b7-4231-a1f6-7e697eeb4902","Type":"ContainerStarted","Data":"ca3fe62ba4536974dc24c992bde91772b91bba66f031e03d5925ab9c28f23b2f"} Jun 11 14:50:45.454797 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:45.454737 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-91.ec2.internal" podStartSLOduration=24.454715444 podStartE2EDuration="24.454715444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:45.45386573 +0000 UTC m=+24.712117123" watchObservedRunningTime="2026-06-11 14:50:45.454715444 +0000 UTC m=+24.712966836" Jun 11 14:50:46.159659 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:46.159545 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T14:50:45.161434677Z","UUID":"e6a0be74-7651-4519-b602-ff0869079986","Handler":null,"Name":"","Endpoint":""} Jun 11 14:50:46.161179 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:46.161157 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 14:50:46.161290 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:46.161199 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 14:50:46.176079 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:46.176042 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:46.176571 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:46.176157 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:46.176655 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:46.176624 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:46.176747 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:46.176723 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:46.446317 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:46.446296 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 14:50:46.446717 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:46.446671 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" event={"ID":"8f20bd10-741c-44e0-96a4-16da9d9b73e5","Type":"ContainerStarted","Data":"c320da536b3918d04a6e2929883f1271edcffd742c1846f02347f04b57947546"} Jun 11 14:50:47.175563 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:47.175530 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:47.175755 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:47.175656 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:47.451362 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:47.451320 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" event={"ID":"c53f8461-c4b7-4231-a1f6-7e697eeb4902","Type":"ContainerStarted","Data":"3925698a5e207de4760922e68941da7f5327196cf3a51633f65770aadd09013a"} Jun 11 14:50:47.467444 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:47.467394 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nncjm" podStartSLOduration=3.883113667 podStartE2EDuration="26.467379849s" totalImagesPullingTime="22.584266182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:47.467077927 +0000 UTC m=+26.725329328" watchObservedRunningTime="2026-06-11 14:50:47.467379849 +0000 UTC m=+26.725631240" Jun 11 14:50:48.175773 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:48.175730 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:48.175773 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:48.175767 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:48.176022 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:48.175881 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:48.176071 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:48.175994 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:49.175894 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:49.175693 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:49.176337 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:49.175981 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:49.312626 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:49.312556 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nrjxq" Jun 11 14:50:49.313218 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:49.313200 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nrjxq" Jun 11 14:50:49.457530 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:49.457502 2574 generic.go:356] "Generic (PLEG): container finished" podID="5f4cfe08-2925-42b4-9c7d-43a438ec56ea" containerID="b4827f333cf1d62d0645037cf22c35a3e2c1518b8f952e33a1f1032fafbe2aa4" exitCode=0 Jun 11 14:50:49.457682 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:49.457555 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skznz" event={"ID":"5f4cfe08-2925-42b4-9c7d-43a438ec56ea","Type":"ContainerDied","Data":"b4827f333cf1d62d0645037cf22c35a3e2c1518b8f952e33a1f1032fafbe2aa4"} Jun 11 14:50:49.461226 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:49.461206 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 14:50:49.461640 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:49.461620 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" event={"ID":"8f20bd10-741c-44e0-96a4-16da9d9b73e5","Type":"ContainerStarted","Data":"2a882f35354da30351c755c351ef91bf0d865a654fcc444b46a1698697041ab9"} Jun 11 14:50:49.461892 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:49.461871 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:49.461948 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:49.461939 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:49.462118 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:49.462101 2574 scope.go:117] "RemoveContainer" containerID="39f1f15f46c00a0ac183de545f85da4822dab86ae19b0ca8e0b54b7d27dafdde" Jun 11 14:50:49.477974 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:49.477953 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:50.175560 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.175517 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:50.175823 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.175525 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:50.175823 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:50.175653 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:50.175823 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:50.175694 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:50.469331 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.469297 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 14:50:50.469781 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.469750 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" event={"ID":"8f20bd10-741c-44e0-96a4-16da9d9b73e5","Type":"ContainerStarted","Data":"7cd3f13b9eb0a3ccd1890483fa75d2d0216e0636487a544b3188f0463636caed"} Jun 11 14:50:50.469947 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.469932 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:50.488049 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.487608 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:50:50.496384 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.496332 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" podStartSLOduration=8.750766747 podStartE2EDuration="29.49631537s" totalImagesPullingTime="20.745548623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:50.494595742 +0000 UTC m=+29.752847161" watchObservedRunningTime="2026-06-11 14:50:50.49631537 +0000 UTC m=+29.754566763" Jun 11 14:50:50.754913 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.754813 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z2shj"] Jun 11 14:50:50.755104 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.754949 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:50.755104 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:50.755072 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:50.755609 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.755593 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w48cb"] Jun 11 14:50:50.755686 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.755676 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:50.755765 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:50.755747 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:50.766398 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.766376 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q68m6"] Jun 11 14:50:50.766494 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.766467 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:50.766565 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:50.766548 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:50.923185 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.923154 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nrjxq" Jun 11 14:50:50.923350 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.923270 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 14:50:50.923783 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:50.923756 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nrjxq" Jun 11 14:50:51.473542 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:51.473506 2574 generic.go:356] "Generic (PLEG): container finished" podID="5f4cfe08-2925-42b4-9c7d-43a438ec56ea" containerID="7842940c94596503d899236d88519a4ae685d1b3a8638977fe9745c8b8b55448" exitCode=0 Jun 11 14:50:51.474221 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:51.473590 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skznz" event={"ID":"5f4cfe08-2925-42b4-9c7d-43a438ec56ea","Type":"ContainerDied","Data":"7842940c94596503d899236d88519a4ae685d1b3a8638977fe9745c8b8b55448"} Jun 11 14:50:52.176144 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:52.176116 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:52.176298 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:52.176116 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:52.176298 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:52.176216 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:52.176298 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:52.176116 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:52.176452 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:52.176293 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:52.176452 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:52.176361 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:53.482522 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:53.482494 2574 generic.go:356] "Generic (PLEG): container finished" podID="5f4cfe08-2925-42b4-9c7d-43a438ec56ea" containerID="585864e25fb7b5b715f0319f1c49fd5da1c6a3596573475c7511721c20413c75" exitCode=0 Jun 11 14:50:53.483070 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:53.482552 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skznz" event={"ID":"5f4cfe08-2925-42b4-9c7d-43a438ec56ea","Type":"ContainerDied","Data":"585864e25fb7b5b715f0319f1c49fd5da1c6a3596573475c7511721c20413c75"} Jun 11 14:50:53.935393 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:53.935357 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:53.935563 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:53.935420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:53.935563 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:53.935503 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:53.935563 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:53.935519 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:53.935698 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:53.935580 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret podName:1adc9c7a-52c0-4ecb-840d-d21120723856 nodeName:}" failed. No retries permitted until 2026-06-11 14:51:25.935559761 +0000 UTC m=+65.193811147 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret") pod "global-pull-secret-syncer-w48cb" (UID: "1adc9c7a-52c0-4ecb-840d-d21120723856") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:53.935698 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:53.935599 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs podName:d6feb162-f5a6-4c90-b19a-829f3057794b nodeName:}" failed. No retries permitted until 2026-06-11 14:51:25.935589339 +0000 UTC m=+65.193840713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs") pod "network-metrics-daemon-q68m6" (UID: "d6feb162-f5a6-4c90-b19a-829f3057794b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:54.036716 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:54.036684 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mgd9\" (UniqueName: \"kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9\") pod \"network-check-target-z2shj\" (UID: \"e942aa64-b57c-480b-b7a2-3541149a026e\") " pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:54.036898 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:54.036865 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:50:54.036898 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:54.036886 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:50:54.036987 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:54.036900 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4mgd9 for pod openshift-network-diagnostics/network-check-target-z2shj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:54.036987 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:54.036970 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9 podName:e942aa64-b57c-480b-b7a2-3541149a026e nodeName:}" failed. No retries permitted until 2026-06-11 14:51:26.036952302 +0000 UTC m=+65.295203679 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mgd9" (UniqueName: "kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9") pod "network-check-target-z2shj" (UID: "e942aa64-b57c-480b-b7a2-3541149a026e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:54.176141 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:54.176110 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:54.176309 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:54.176234 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:54.176374 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:54.176355 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:50:54.176432 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:54.176237 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:54.176478 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:54.176229 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w48cb" podUID="1adc9c7a-52c0-4ecb-840d-d21120723856" Jun 11 14:50:54.176478 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:54.176442 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2shj" podUID="e942aa64-b57c-480b-b7a2-3541149a026e" Jun 11 14:50:56.105163 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.104930 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-91.ec2.internal" event="NodeReady" Jun 11 14:50:56.105607 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.105308 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 14:50:56.147832 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.147797 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fdxrx"] Jun 11 14:50:56.153212 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.153188 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h8lr6"] Jun 11 14:50:56.153358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.153327 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:56.156050 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.156020 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 14:50:56.156177 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.156025 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5zf7p\"" Jun 11 14:50:56.156177 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.156086 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 14:50:56.156721 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.156697 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h8lr6" Jun 11 14:50:56.159717 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.159695 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fdxrx"] Jun 11 14:50:56.160240 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.160078 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 14:50:56.160240 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.160089 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zgb64\"" Jun 11 14:50:56.160741 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.160361 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 14:50:56.160741 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.160361 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 14:50:56.162558 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.162538 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h8lr6"] Jun 11 14:50:56.176146 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.176119 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:50:56.176245 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.176214 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:50:56.176300 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.176249 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:50:56.178733 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.178713 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fhnff\"" Jun 11 14:50:56.179105 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.179081 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 14:50:56.179475 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.179456 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 14:50:56.179573 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.179475 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 14:50:56.179573 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.179531 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rtqf6\"" Jun 11 14:50:56.179573 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.179463 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 14:50:56.252950 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.252881 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:56.252950 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.252919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb805cfa-5506-449e-810f-cbc624679eaa-tmp-dir\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:56.252950 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.252945 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps7w2\" (UniqueName: \"kubernetes.io/projected/cb805cfa-5506-449e-810f-cbc624679eaa-kube-api-access-ps7w2\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:56.253221 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.253057 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdw7w\" (UniqueName: \"kubernetes.io/projected/321e1681-bcb6-413d-8d63-c64aacd4e352-kube-api-access-tdw7w\") pod \"ingress-canary-h8lr6\" (UID: \"321e1681-bcb6-413d-8d63-c64aacd4e352\") " pod="openshift-ingress-canary/ingress-canary-h8lr6" Jun 11 14:50:56.253221 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.253119 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cb805cfa-5506-449e-810f-cbc624679eaa-config-volume\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:56.253221 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.253145 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/321e1681-bcb6-413d-8d63-c64aacd4e352-cert\") pod \"ingress-canary-h8lr6\" (UID: \"321e1681-bcb6-413d-8d63-c64aacd4e352\") " pod="openshift-ingress-canary/ingress-canary-h8lr6" Jun 11 14:50:56.353742 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.353701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdw7w\" (UniqueName: \"kubernetes.io/projected/321e1681-bcb6-413d-8d63-c64aacd4e352-kube-api-access-tdw7w\") pod \"ingress-canary-h8lr6\" (UID: \"321e1681-bcb6-413d-8d63-c64aacd4e352\") " pod="openshift-ingress-canary/ingress-canary-h8lr6" Jun 11 14:50:56.353926 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.353784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cb805cfa-5506-449e-810f-cbc624679eaa-config-volume\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:56.353926 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.353811 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/321e1681-bcb6-413d-8d63-c64aacd4e352-cert\") pod \"ingress-canary-h8lr6\" (UID: \"321e1681-bcb6-413d-8d63-c64aacd4e352\") " pod="openshift-ingress-canary/ingress-canary-h8lr6" Jun 11 14:50:56.354066 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.353928 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:56.354066 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.353966 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb805cfa-5506-449e-810f-cbc624679eaa-tmp-dir\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:56.354066 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.353989 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps7w2\" (UniqueName: \"kubernetes.io/projected/cb805cfa-5506-449e-810f-cbc624679eaa-kube-api-access-ps7w2\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:56.354223 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:56.354078 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:50:56.354223 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:56.354160 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls podName:cb805cfa-5506-449e-810f-cbc624679eaa nodeName:}" failed. No retries permitted until 2026-06-11 14:50:56.854141458 +0000 UTC m=+36.112392831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls") pod "dns-default-fdxrx" (UID: "cb805cfa-5506-449e-810f-cbc624679eaa") : secret "dns-default-metrics-tls" not found Jun 11 14:50:56.354331 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.354298 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb805cfa-5506-449e-810f-cbc624679eaa-tmp-dir\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:56.354514 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.354495 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cb805cfa-5506-449e-810f-cbc624679eaa-config-volume\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:56.358534 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.358474 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/321e1681-bcb6-413d-8d63-c64aacd4e352-cert\") pod \"ingress-canary-h8lr6\" (UID: \"321e1681-bcb6-413d-8d63-c64aacd4e352\") " pod="openshift-ingress-canary/ingress-canary-h8lr6" Jun 11 14:50:56.363421 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.363393 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdw7w\" (UniqueName: \"kubernetes.io/projected/321e1681-bcb6-413d-8d63-c64aacd4e352-kube-api-access-tdw7w\") pod \"ingress-canary-h8lr6\" (UID: \"321e1681-bcb6-413d-8d63-c64aacd4e352\") " pod="openshift-ingress-canary/ingress-canary-h8lr6" Jun 11 14:50:56.363584 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.363499 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps7w2\" (UniqueName: \"kubernetes.io/projected/cb805cfa-5506-449e-810f-cbc624679eaa-kube-api-access-ps7w2\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:56.473173 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.473141 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h8lr6" Jun 11 14:50:56.857526 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:56.857495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:56.857721 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:56.857633 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:50:56.857721 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:56.857702 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls podName:cb805cfa-5506-449e-810f-cbc624679eaa nodeName:}" failed. No retries permitted until 2026-06-11 14:50:57.857682354 +0000 UTC m=+37.115933736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls") pod "dns-default-fdxrx" (UID: "cb805cfa-5506-449e-810f-cbc624679eaa") : secret "dns-default-metrics-tls" not found Jun 11 14:50:57.540889 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:57.540858 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h8lr6"] Jun 11 14:50:57.543923 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:50:57.543896 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod321e1681_bcb6_413d_8d63_c64aacd4e352.slice/crio-e68ce9d2b738a253edfcb0bc050427e2093dc5ea0c664f428522b3fca53d78e7 WatchSource:0}: Error finding container e68ce9d2b738a253edfcb0bc050427e2093dc5ea0c664f428522b3fca53d78e7: Status 404 returned error can't find the container with id e68ce9d2b738a253edfcb0bc050427e2093dc5ea0c664f428522b3fca53d78e7 Jun 11 14:50:57.864918 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:57.864871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:57.865116 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:57.865058 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:50:57.865157 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:57.865136 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls podName:cb805cfa-5506-449e-810f-cbc624679eaa nodeName:}" failed. No retries permitted until 2026-06-11 14:50:59.865120446 +0000 UTC m=+39.123371820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls") pod "dns-default-fdxrx" (UID: "cb805cfa-5506-449e-810f-cbc624679eaa") : secret "dns-default-metrics-tls" not found Jun 11 14:50:58.501414 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:58.501168 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h8lr6" event={"ID":"321e1681-bcb6-413d-8d63-c64aacd4e352","Type":"ContainerStarted","Data":"e68ce9d2b738a253edfcb0bc050427e2093dc5ea0c664f428522b3fca53d78e7"} Jun 11 14:50:58.504498 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:58.504467 2574 generic.go:356] "Generic (PLEG): container finished" podID="5f4cfe08-2925-42b4-9c7d-43a438ec56ea" containerID="816c9524dc0370be667929bd3d999067173212d947b7804003a7a70a378d65a3" exitCode=0 Jun 11 14:50:58.504707 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:58.504512 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skznz" event={"ID":"5f4cfe08-2925-42b4-9c7d-43a438ec56ea","Type":"ContainerDied","Data":"816c9524dc0370be667929bd3d999067173212d947b7804003a7a70a378d65a3"} Jun 11 14:50:59.509784 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:59.509757 2574 generic.go:356] "Generic (PLEG): container finished" podID="5f4cfe08-2925-42b4-9c7d-43a438ec56ea" containerID="8d00c664474fe53034bc83ff5b469ab4b0d0253699c77c540ed998097071fa71" exitCode=0 Jun 11 14:50:59.510253 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:59.509820 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skznz" event={"ID":"5f4cfe08-2925-42b4-9c7d-43a438ec56ea","Type":"ContainerDied","Data":"8d00c664474fe53034bc83ff5b469ab4b0d0253699c77c540ed998097071fa71"} Jun 11 14:50:59.880947 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:50:59.880865 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:50:59.881092 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:59.881044 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:50:59.881137 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:50:59.881108 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls podName:cb805cfa-5506-449e-810f-cbc624679eaa nodeName:}" failed. No retries permitted until 2026-06-11 14:51:03.881092852 +0000 UTC m=+43.139344220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls") pod "dns-default-fdxrx" (UID: "cb805cfa-5506-449e-810f-cbc624679eaa") : secret "dns-default-metrics-tls" not found Jun 11 14:51:00.513938 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:00.513899 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h8lr6" event={"ID":"321e1681-bcb6-413d-8d63-c64aacd4e352","Type":"ContainerStarted","Data":"94df2ee02c480bedd13fd14b128f3ecbe569c4d4f2b7732b706ce4c88a26a714"} Jun 11 14:51:00.517263 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:00.517241 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skznz" event={"ID":"5f4cfe08-2925-42b4-9c7d-43a438ec56ea","Type":"ContainerStarted","Data":"d3b26ae00f309f691fe909787ec0832f9268ecfe65ca3de35cc2771ea8fd50dc"} Jun 11 14:51:00.528592 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:00.528552 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h8lr6" podStartSLOduration=2.615613412 podStartE2EDuration="4.528537067s" totalImagesPullingTime="1.912923655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:51:00.527727947 +0000 UTC m=+39.785979338" watchObservedRunningTime="2026-06-11 14:51:00.528537067 +0000 UTC m=+39.786788497" Jun 11 14:51:00.552313 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:00.552267 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-skznz" podStartSLOduration=8.887749068 podStartE2EDuration="39.55225238s" totalImagesPullingTime="30.664503312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:51:00.551222247 +0000 UTC m=+39.809473654" watchObservedRunningTime="2026-06-11 14:51:00.55225238 +0000 UTC m=+39.810503768" Jun 11 14:51:03.911153 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:03.911108 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:51:03.911503 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:51:03.911230 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:51:03.911503 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:51:03.911298 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls podName:cb805cfa-5506-449e-810f-cbc624679eaa nodeName:}" failed. No retries permitted until 2026-06-11 14:51:11.911280464 +0000 UTC m=+51.169531836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls") pod "dns-default-fdxrx" (UID: "cb805cfa-5506-449e-810f-cbc624679eaa") : secret "dns-default-metrics-tls" not found Jun 11 14:51:10.594330 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.594291 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd"] Jun 11 14:51:10.607481 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.607453 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m"] Jun 11 14:51:10.607635 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.607570 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" Jun 11 14:51:10.610467 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.610282 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 14:51:10.610467 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.610304 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 14:51:10.610467 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.610323 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 14:51:10.610659 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.610557 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 14:51:10.610767 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.610750 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-s7mcv\"" Jun 11 14:51:10.621616 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.621595 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd"] Jun 11 14:51:10.621725 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.621629 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m"] Jun 11 14:51:10.621725 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.621724 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.624330 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.624311 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 14:51:10.624330 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.624319 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 14:51:10.624492 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.624315 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 14:51:10.624492 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.624315 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 14:51:10.757048 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.756992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c96k\" (UniqueName: \"kubernetes.io/projected/89fe3b3c-23a8-4d75-9878-fba7694a965d-kube-api-access-8c96k\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.757207 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.757078 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5qf7\" (UniqueName: \"kubernetes.io/projected/8e5b1a48-a780-4b80-aab8-35e963db4959-kube-api-access-z5qf7\") pod \"managed-serviceaccount-addon-agent-69cc8ccd78-7svdd\" (UID: \"8e5b1a48-a780-4b80-aab8-35e963db4959\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" Jun 11 14:51:10.757207 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.757112 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/89fe3b3c-23a8-4d75-9878-fba7694a965d-hub\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.757207 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.757128 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/89fe3b3c-23a8-4d75-9878-fba7694a965d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.757207 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.757149 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/89fe3b3c-23a8-4d75-9878-fba7694a965d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.757207 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.757191 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8e5b1a48-a780-4b80-aab8-35e963db4959-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69cc8ccd78-7svdd\" (UID: \"8e5b1a48-a780-4b80-aab8-35e963db4959\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" Jun 11 14:51:10.757370 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.757264 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/89fe3b3c-23a8-4d75-9878-fba7694a965d-ca\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.757370 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.757283 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89fe3b3c-23a8-4d75-9878-fba7694a965d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.857796 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.857704 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c96k\" (UniqueName: \"kubernetes.io/projected/89fe3b3c-23a8-4d75-9878-fba7694a965d-kube-api-access-8c96k\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.857941 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.857845 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5qf7\" (UniqueName: \"kubernetes.io/projected/8e5b1a48-a780-4b80-aab8-35e963db4959-kube-api-access-z5qf7\") pod \"managed-serviceaccount-addon-agent-69cc8ccd78-7svdd\" (UID: \"8e5b1a48-a780-4b80-aab8-35e963db4959\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" Jun 11 14:51:10.857941 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.857868 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/89fe3b3c-23a8-4d75-9878-fba7694a965d-hub\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.857941 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.857889 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/89fe3b3c-23a8-4d75-9878-fba7694a965d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.857941 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.857919 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/89fe3b3c-23a8-4d75-9878-fba7694a965d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.858153 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.858075 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8e5b1a48-a780-4b80-aab8-35e963db4959-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69cc8ccd78-7svdd\" (UID: \"8e5b1a48-a780-4b80-aab8-35e963db4959\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" Jun 11 14:51:10.858216 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.858175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/89fe3b3c-23a8-4d75-9878-fba7694a965d-ca\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.858216 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.858208 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89fe3b3c-23a8-4d75-9878-fba7694a965d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.858781 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.858752 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/89fe3b3c-23a8-4d75-9878-fba7694a965d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.861743 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.861712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/89fe3b3c-23a8-4d75-9878-fba7694a965d-ca\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.861821 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.861739 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/89fe3b3c-23a8-4d75-9878-fba7694a965d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.861821 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.861812 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8e5b1a48-a780-4b80-aab8-35e963db4959-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69cc8ccd78-7svdd\" (UID: \"8e5b1a48-a780-4b80-aab8-35e963db4959\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" Jun 11 14:51:10.861928 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.861819 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/89fe3b3c-23a8-4d75-9878-fba7694a965d-hub\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.861964 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.861950 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89fe3b3c-23a8-4d75-9878-fba7694a965d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.865190 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.865172 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5qf7\" (UniqueName: \"kubernetes.io/projected/8e5b1a48-a780-4b80-aab8-35e963db4959-kube-api-access-z5qf7\") pod \"managed-serviceaccount-addon-agent-69cc8ccd78-7svdd\" (UID: \"8e5b1a48-a780-4b80-aab8-35e963db4959\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" Jun 11 14:51:10.865358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.865341 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c96k\" (UniqueName: \"kubernetes.io/projected/89fe3b3c-23a8-4d75-9878-fba7694a965d-kube-api-access-8c96k\") pod \"cluster-proxy-proxy-agent-6b599897f7-nrt4m\" (UID: \"89fe3b3c-23a8-4d75-9878-fba7694a965d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:10.928375 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.928341 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" Jun 11 14:51:10.937513 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:10.937488 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:51:11.078039 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:11.077992 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd"] Jun 11 14:51:11.098928 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:11.098901 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m"] Jun 11 14:51:11.101346 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:51:11.101325 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89fe3b3c_23a8_4d75_9878_fba7694a965d.slice/crio-1823297cc01dd7a1fc18ab414a04ac4a7139ec3e9f3a7ebe7b29d2f6bc5f12de WatchSource:0}: Error finding container 1823297cc01dd7a1fc18ab414a04ac4a7139ec3e9f3a7ebe7b29d2f6bc5f12de: Status 404 returned error can't find the container with id 1823297cc01dd7a1fc18ab414a04ac4a7139ec3e9f3a7ebe7b29d2f6bc5f12de Jun 11 14:51:11.543163 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:11.543128 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" event={"ID":"89fe3b3c-23a8-4d75-9878-fba7694a965d","Type":"ContainerStarted","Data":"1823297cc01dd7a1fc18ab414a04ac4a7139ec3e9f3a7ebe7b29d2f6bc5f12de"} Jun 11 14:51:11.544124 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:11.544097 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" event={"ID":"8e5b1a48-a780-4b80-aab8-35e963db4959","Type":"ContainerStarted","Data":"6795b80140b55a6cfdef3b8ff3b893ef3bf410624afbe050e7a1d9bb9c588cfe"} Jun 11 14:51:11.966921 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:11.966337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:51:11.966921 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:51:11.966485 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:51:11.966921 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:51:11.966562 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls podName:cb805cfa-5506-449e-810f-cbc624679eaa nodeName:}" failed. No retries permitted until 2026-06-11 14:51:27.966543385 +0000 UTC m=+67.224794774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls") pod "dns-default-fdxrx" (UID: "cb805cfa-5506-449e-810f-cbc624679eaa") : secret "dns-default-metrics-tls" not found Jun 11 14:51:16.558218 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:16.558176 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" event={"ID":"89fe3b3c-23a8-4d75-9878-fba7694a965d","Type":"ContainerStarted","Data":"62921b916d50610a796a0e956ee4b0e91eba7621377d8b5523eb8a168125734b"} Jun 11 14:51:16.558617 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:16.558233 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" event={"ID":"89fe3b3c-23a8-4d75-9878-fba7694a965d","Type":"ContainerStarted","Data":"a91de383dac890882e4555094410b1e59fb8e2f657f21783a2d4f844597d08d2"} Jun 11 14:51:16.558617 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:16.558255 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" event={"ID":"89fe3b3c-23a8-4d75-9878-fba7694a965d","Type":"ContainerStarted","Data":"fc8b0765fa4acc3879afbc57f24db77732b1e87d2ef1b720a4dd092feae20990"} Jun 11 14:51:16.559638 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:16.559614 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" event={"ID":"8e5b1a48-a780-4b80-aab8-35e963db4959","Type":"ContainerStarted","Data":"31a063eb75f2979e95418ea70010b671a8601bea22fcce5cd06ab0e72cb3fbbf"} Jun 11 14:51:16.576557 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:16.576516 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" podStartSLOduration=1.906348001 podStartE2EDuration="6.576490363s" totalImagesPullingTime="4.670142362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:51:16.575476897 +0000 UTC m=+55.833728289" watchObservedRunningTime="2026-06-11 14:51:16.576490363 +0000 UTC m=+55.834741745" Jun 11 14:51:16.590580 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:16.590542 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" podStartSLOduration=1.913315127 podStartE2EDuration="6.590527848s" totalImagesPullingTime="4.677212721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:51:16.589441368 +0000 UTC m=+55.847692759" watchObservedRunningTime="2026-06-11 14:51:16.590527848 +0000 UTC m=+55.848779240" Jun 11 14:51:22.495487 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:22.495453 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9j5j" Jun 11 14:51:25.987779 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:25.987744 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:51:25.988186 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:25.987797 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:51:25.990736 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:25.990720 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 14:51:25.990810 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:25.990719 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 14:51:25.998122 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:51:25.998101 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 14:51:25.998223 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:51:25.998188 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs podName:d6feb162-f5a6-4c90-b19a-829f3057794b nodeName:}" failed. No retries permitted until 2026-06-11 14:52:29.998164706 +0000 UTC m=+129.256416081 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs") pod "network-metrics-daemon-q68m6" (UID: "d6feb162-f5a6-4c90-b19a-829f3057794b") : secret "metrics-daemon-secret" not found Jun 11 14:51:26.000224 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:26.000206 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1adc9c7a-52c0-4ecb-840d-d21120723856-original-pull-secret\") pod \"global-pull-secret-syncer-w48cb\" (UID: \"1adc9c7a-52c0-4ecb-840d-d21120723856\") " pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:51:26.088877 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:26.088841 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mgd9\" (UniqueName: \"kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9\") pod \"network-check-target-z2shj\" (UID: \"e942aa64-b57c-480b-b7a2-3541149a026e\") " pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:51:26.091656 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:26.091633 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 14:51:26.102591 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:26.102567 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 14:51:26.112931 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:26.112910 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mgd9\" (UniqueName: \"kubernetes.io/projected/e942aa64-b57c-480b-b7a2-3541149a026e-kube-api-access-4mgd9\") pod \"network-check-target-z2shj\" (UID: \"e942aa64-b57c-480b-b7a2-3541149a026e\") " pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:51:26.186600 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:26.186565 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w48cb" Jun 11 14:51:26.202167 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:26.202145 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rtqf6\"" Jun 11 14:51:26.209635 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:26.209613 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:51:26.315921 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:26.315821 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w48cb"] Jun 11 14:51:26.318634 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:51:26.318609 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1adc9c7a_52c0_4ecb_840d_d21120723856.slice/crio-eab552b97c75572c4336e1aabad9dd33813d7ea8e87fe30662d8f92d42c0e69c WatchSource:0}: Error finding container eab552b97c75572c4336e1aabad9dd33813d7ea8e87fe30662d8f92d42c0e69c: Status 404 returned error can't find the container with id eab552b97c75572c4336e1aabad9dd33813d7ea8e87fe30662d8f92d42c0e69c Jun 11 14:51:26.345867 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:26.345838 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z2shj"] Jun 11 14:51:26.350343 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:51:26.350318 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode942aa64_b57c_480b_b7a2_3541149a026e.slice/crio-8d5bd25876216812cc7ce233b21bdf51c14896e2f0daa6ae65a49342e14ff07b WatchSource:0}: Error finding container 8d5bd25876216812cc7ce233b21bdf51c14896e2f0daa6ae65a49342e14ff07b: Status 404 returned error can't find the container with id 8d5bd25876216812cc7ce233b21bdf51c14896e2f0daa6ae65a49342e14ff07b Jun 11 14:51:26.585562 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:26.585467 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z2shj" event={"ID":"e942aa64-b57c-480b-b7a2-3541149a026e","Type":"ContainerStarted","Data":"8d5bd25876216812cc7ce233b21bdf51c14896e2f0daa6ae65a49342e14ff07b"} Jun 11 14:51:26.589757 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:26.589727 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w48cb" event={"ID":"1adc9c7a-52c0-4ecb-840d-d21120723856","Type":"ContainerStarted","Data":"eab552b97c75572c4336e1aabad9dd33813d7ea8e87fe30662d8f92d42c0e69c"} Jun 11 14:51:28.005221 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:28.005182 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:51:28.005665 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:51:28.005326 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:51:28.005665 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:51:28.005389 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls podName:cb805cfa-5506-449e-810f-cbc624679eaa nodeName:}" failed. No retries permitted until 2026-06-11 14:52:00.005368509 +0000 UTC m=+99.263619898 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls") pod "dns-default-fdxrx" (UID: "cb805cfa-5506-449e-810f-cbc624679eaa") : secret "dns-default-metrics-tls" not found Jun 11 14:51:31.606572 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:31.606535 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z2shj" event={"ID":"e942aa64-b57c-480b-b7a2-3541149a026e","Type":"ContainerStarted","Data":"6c02244502b4519a31f1fbc27f715dd78411276b8c2f5a40c599dd8f42244f87"} Jun 11 14:51:31.607057 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:31.606648 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:51:31.608074 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:31.608048 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w48cb" event={"ID":"1adc9c7a-52c0-4ecb-840d-d21120723856","Type":"ContainerStarted","Data":"60c1cb0f8efd5f06aba5fa25a52875069b214703c1775accf60e5e1b937f59e7"} Jun 11 14:51:31.624332 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:31.624292 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z2shj" podStartSLOduration=65.949310512 podStartE2EDuration="1m10.624281974s" totalImagesPullingTime="4.674971462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:51:31.622846111 +0000 UTC m=+70.881097501" watchObservedRunningTime="2026-06-11 14:51:31.624281974 +0000 UTC m=+70.882533365" Jun 11 14:51:31.640147 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:51:31.640113 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w48cb" podStartSLOduration=65.921138301 podStartE2EDuration="1m10.640089562s" totalImagesPullingTime="4.718951261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:51:31.639956506 +0000 UTC m=+70.898207897" watchObservedRunningTime="2026-06-11 14:51:31.640089562 +0000 UTC m=+70.898340952" Jun 11 14:52:00.029641 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:52:00.029507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:52:00.029641 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:52:00.029634 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:52:00.030239 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:52:00.029713 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls podName:cb805cfa-5506-449e-810f-cbc624679eaa nodeName:}" failed. No retries permitted until 2026-06-11 14:53:04.029698846 +0000 UTC m=+163.287950215 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls") pod "dns-default-fdxrx" (UID: "cb805cfa-5506-449e-810f-cbc624679eaa") : secret "dns-default-metrics-tls" not found Jun 11 14:52:02.613350 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:52:02.613321 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z2shj" Jun 11 14:52:30.049815 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:52:30.049774 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:52:30.050336 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:52:30.049884 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 14:52:30.050336 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:52:30.049938 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs podName:d6feb162-f5a6-4c90-b19a-829f3057794b nodeName:}" failed. No retries permitted until 2026-06-11 14:54:32.049923619 +0000 UTC m=+251.308174988 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs") pod "network-metrics-daemon-q68m6" (UID: "d6feb162-f5a6-4c90-b19a-829f3057794b") : secret "metrics-daemon-secret" not found Jun 11 14:52:59.167757 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:52:59.167714 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fdxrx" podUID="cb805cfa-5506-449e-810f-cbc624679eaa" Jun 11 14:52:59.194122 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:52:59.194088 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q68m6" podUID="d6feb162-f5a6-4c90-b19a-829f3057794b" Jun 11 14:52:59.861127 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:52:59.861095 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fdxrx" Jun 11 14:53:04.080333 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:04.080274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:53:04.080744 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:53:04.080428 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:53:04.080744 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:53:04.080518 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls podName:cb805cfa-5506-449e-810f-cbc624679eaa nodeName:}" failed. No retries permitted until 2026-06-11 14:55:06.0804998 +0000 UTC m=+285.338751173 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls") pod "dns-default-fdxrx" (UID: "cb805cfa-5506-449e-810f-cbc624679eaa") : secret "dns-default-metrics-tls" not found Jun 11 14:53:14.176121 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:14.176024 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:53:15.906619 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:15.906589 2574 generic.go:356] "Generic (PLEG): container finished" podID="8e5b1a48-a780-4b80-aab8-35e963db4959" containerID="31a063eb75f2979e95418ea70010b671a8601bea22fcce5cd06ab0e72cb3fbbf" exitCode=255 Jun 11 14:53:15.906991 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:15.906649 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" event={"ID":"8e5b1a48-a780-4b80-aab8-35e963db4959","Type":"ContainerDied","Data":"31a063eb75f2979e95418ea70010b671a8601bea22fcce5cd06ab0e72cb3fbbf"} Jun 11 14:53:15.907101 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:15.906999 2574 scope.go:117] "RemoveContainer" containerID="31a063eb75f2979e95418ea70010b671a8601bea22fcce5cd06ab0e72cb3fbbf" Jun 11 14:53:16.911895 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:16.911861 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" event={"ID":"8e5b1a48-a780-4b80-aab8-35e963db4959","Type":"ContainerStarted","Data":"40bb0f87e60658bafe119553a09f5254bc0c0407a4cc25d7bb1eaf23ba295254"} Jun 11 14:53:36.572541 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:36.572511 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wgzcn_400743e8-75f6-41ed-a7d6-28b75105c435/dns-node-resolver/0.log" Jun 11 14:53:37.168760 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:37.168728 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d2dgr_f6330dcf-d467-4d44-890c-e4b689e5d451/node-ca/0.log" Jun 11 14:53:37.967456 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:37.967431 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h8lr6_321e1681-bcb6-413d-8d63-c64aacd4e352/serve-healthcheck-canary/0.log" Jun 11 14:53:56.781561 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:56.781523 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kfmz7"] Jun 11 14:53:56.783751 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:56.783728 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:56.786470 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:56.786445 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 14:53:56.786707 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:56.786685 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 14:53:56.787878 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:56.787861 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 14:53:56.787967 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:56.787924 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 14:53:56.788144 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:56.788129 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4697f\"" Jun 11 14:53:56.797688 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:56.797667 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kfmz7"] Jun 11 14:53:56.947809 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:56.947775 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-crio-socket\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:56.948001 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:56.947840 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnt8g\" (UniqueName: \"kubernetes.io/projected/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-kube-api-access-mnt8g\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:56.948001 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:56.947875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:56.948001 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:56.947921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-data-volume\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:56.948001 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:56.947952 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:57.049423 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:57.049338 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-crio-socket\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:57.049423 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:57.049390 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnt8g\" (UniqueName: \"kubernetes.io/projected/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-kube-api-access-mnt8g\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:57.049423 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:57.049416 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:57.049677 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:57.049447 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-data-volume\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:57.049677 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:57.049466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:57.049677 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:57.049466 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-crio-socket\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:57.049824 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:57.049777 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-data-volume\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:57.050043 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:57.050001 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:57.051857 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:57.051837 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:57.059357 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:57.059335 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnt8g\" (UniqueName: \"kubernetes.io/projected/2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e-kube-api-access-mnt8g\") pod \"insights-runtime-extractor-kfmz7\" (UID: \"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e\") " pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:57.092502 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:57.092472 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kfmz7" Jun 11 14:53:57.212991 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:57.212960 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kfmz7"] Jun 11 14:53:57.216040 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:53:57.215997 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a37455a_2627_4ae7_8cb5_a7b3cc50ce8e.slice/crio-bfd8ddb98bea8d8577c433c2cc8c9f4eaf1ca722255b57015138c73177df06ca WatchSource:0}: Error finding container bfd8ddb98bea8d8577c433c2cc8c9f4eaf1ca722255b57015138c73177df06ca: Status 404 returned error can't find the container with id bfd8ddb98bea8d8577c433c2cc8c9f4eaf1ca722255b57015138c73177df06ca Jun 11 14:53:58.035599 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:58.035557 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kfmz7" event={"ID":"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e","Type":"ContainerStarted","Data":"d35359216c111941830714ef5fbf1ab9d97605956885419759a5253e7dc32f42"} Jun 11 14:53:58.035948 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:58.035620 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kfmz7" event={"ID":"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e","Type":"ContainerStarted","Data":"d98178414c4e0720048ad91c419a7cf224f0a304df96b6e905c952d6038efc83"} Jun 11 14:53:58.035948 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:53:58.035638 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kfmz7" event={"ID":"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e","Type":"ContainerStarted","Data":"bfd8ddb98bea8d8577c433c2cc8c9f4eaf1ca722255b57015138c73177df06ca"} Jun 11 14:54:00.044110 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:00.044069 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kfmz7" event={"ID":"2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e","Type":"ContainerStarted","Data":"4f6454a38820a4b6a54707439f10a36354d662a92b8facacc8278ce59ae51e3b"} Jun 11 14:54:00.063141 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:00.063073 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kfmz7" podStartSLOduration=1.9968568119999999 podStartE2EDuration="4.063057504s" totalImagesPullingTime="2.066200692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:53:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:00.062581419 +0000 UTC m=+219.320832809" watchObservedRunningTime="2026-06-11 14:54:00.063057504 +0000 UTC m=+219.321308896" Jun 11 14:54:00.939300 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:00.939257 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" podUID="89fe3b3c-23a8-4d75-9878-fba7694a965d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 14:54:03.544016 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:03.543981 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6fjl5"] Jun 11 14:54:03.547249 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:03.547231 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6fjl5" Jun 11 14:54:03.549748 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:03.549716 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 14:54:03.549942 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:03.549921 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-42p2n\"" Jun 11 14:54:03.554219 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:03.554157 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6fjl5"] Jun 11 14:54:03.692563 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:03.692520 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/122731c6-9e8b-457f-8bbe-d66426542a4e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-6fjl5\" (UID: \"122731c6-9e8b-457f-8bbe-d66426542a4e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6fjl5" Jun 11 14:54:03.793523 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:03.793489 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/122731c6-9e8b-457f-8bbe-d66426542a4e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-6fjl5\" (UID: \"122731c6-9e8b-457f-8bbe-d66426542a4e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6fjl5" Jun 11 14:54:03.795873 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:03.795829 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/122731c6-9e8b-457f-8bbe-d66426542a4e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-6fjl5\" (UID: \"122731c6-9e8b-457f-8bbe-d66426542a4e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6fjl5" Jun 11 14:54:03.856882 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:03.856831 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6fjl5" Jun 11 14:54:03.977645 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:03.977611 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6fjl5"] Jun 11 14:54:03.980975 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:54:03.980951 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122731c6_9e8b_457f_8bbe_d66426542a4e.slice/crio-d701d2b5b3bf289d2e33125f2285c044a80a04bc1813a183d2bd951293e5df41 WatchSource:0}: Error finding container d701d2b5b3bf289d2e33125f2285c044a80a04bc1813a183d2bd951293e5df41: Status 404 returned error can't find the container with id d701d2b5b3bf289d2e33125f2285c044a80a04bc1813a183d2bd951293e5df41 Jun 11 14:54:04.056950 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:04.056866 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6fjl5" event={"ID":"122731c6-9e8b-457f-8bbe-d66426542a4e","Type":"ContainerStarted","Data":"d701d2b5b3bf289d2e33125f2285c044a80a04bc1813a183d2bd951293e5df41"} Jun 11 14:54:05.061114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:05.061077 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6fjl5" event={"ID":"122731c6-9e8b-457f-8bbe-d66426542a4e","Type":"ContainerStarted","Data":"a67b9ddaa74304007ca12e4e92521e6ad9e3494e1f010b4f56e5799fddcd2bfb"} Jun 11 14:54:05.061522 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:05.061275 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6fjl5" Jun 11 14:54:05.066149 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:05.066127 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6fjl5" Jun 11 14:54:05.076872 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:05.076831 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6fjl5" podStartSLOduration=1.114171372 podStartE2EDuration="2.076815882s" totalImagesPullingTime="962.64451ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:54:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:05.076616722 +0000 UTC m=+224.334868114" watchObservedRunningTime="2026-06-11 14:54:05.076815882 +0000 UTC m=+224.335067272" Jun 11 14:54:09.960526 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:09.960489 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8fbl9"] Jun 11 14:54:09.963540 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:09.963521 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:09.966446 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:09.966420 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 14:54:09.966565 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:09.966421 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 14:54:09.966565 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:09.966421 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 14:54:09.966565 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:09.966560 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 14:54:09.968001 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:09.967983 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 14:54:09.968070 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:09.967996 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t8gvg\"" Jun 11 14:54:09.968111 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:09.968072 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 14:54:10.139061 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.138995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.139235 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.139093 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.139235 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.139141 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-wtmp\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.139235 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.139161 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/189a3961-82b1-4794-93a1-a24a5956e97a-metrics-client-ca\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.139235 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.139191 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/189a3961-82b1-4794-93a1-a24a5956e97a-sys\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.139235 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.139210 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzmwk\" (UniqueName: \"kubernetes.io/projected/189a3961-82b1-4794-93a1-a24a5956e97a-kube-api-access-tzmwk\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.139435 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.139246 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/189a3961-82b1-4794-93a1-a24a5956e97a-root\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.139435 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.139269 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-textfile\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.139435 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.139303 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-tls\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.240488 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.240392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-wtmp\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.240488 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.240428 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/189a3961-82b1-4794-93a1-a24a5956e97a-metrics-client-ca\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.240488 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.240450 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/189a3961-82b1-4794-93a1-a24a5956e97a-sys\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.240488 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.240467 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzmwk\" (UniqueName: \"kubernetes.io/projected/189a3961-82b1-4794-93a1-a24a5956e97a-kube-api-access-tzmwk\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.240488 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.240488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/189a3961-82b1-4794-93a1-a24a5956e97a-root\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.240852 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.240542 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/189a3961-82b1-4794-93a1-a24a5956e97a-sys\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.240852 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.240544 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-textfile\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.240852 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.240591 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/189a3961-82b1-4794-93a1-a24a5956e97a-root\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.240852 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.240604 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-wtmp\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.240852 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.240608 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-tls\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.240852 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:54:10.240672 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 14:54:10.240852 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.240729 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.240852 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:54:10.240753 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-tls podName:189a3961-82b1-4794-93a1-a24a5956e97a nodeName:}" failed. No retries permitted until 2026-06-11 14:54:10.740732676 +0000 UTC m=+229.998984045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-tls") pod "node-exporter-8fbl9" (UID: "189a3961-82b1-4794-93a1-a24a5956e97a") : secret "node-exporter-tls" not found Jun 11 14:54:10.240852 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.240784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.241260 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.240854 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-textfile\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.241260 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.241085 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/189a3961-82b1-4794-93a1-a24a5956e97a-metrics-client-ca\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.241260 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.241201 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.243121 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.243101 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.251775 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.251745 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzmwk\" (UniqueName: \"kubernetes.io/projected/189a3961-82b1-4794-93a1-a24a5956e97a-kube-api-access-tzmwk\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.744796 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.744762 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-tls\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.746995 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.746966 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/189a3961-82b1-4794-93a1-a24a5956e97a-node-exporter-tls\") pod \"node-exporter-8fbl9\" (UID: \"189a3961-82b1-4794-93a1-a24a5956e97a\") " pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.872568 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.872527 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8fbl9" Jun 11 14:54:10.884488 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:54:10.884463 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod189a3961_82b1_4794_93a1_a24a5956e97a.slice/crio-e445dd7646002423b99a78b79ea84312361851498d96d6e25bef3169b860a5d5 WatchSource:0}: Error finding container e445dd7646002423b99a78b79ea84312361851498d96d6e25bef3169b860a5d5: Status 404 returned error can't find the container with id e445dd7646002423b99a78b79ea84312361851498d96d6e25bef3169b860a5d5 Jun 11 14:54:10.938734 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:10.938702 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" podUID="89fe3b3c-23a8-4d75-9878-fba7694a965d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 14:54:11.045439 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.045363 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 14:54:11.048793 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.048775 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.051592 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.051571 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 14:54:11.051592 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.051577 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 14:54:11.051787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.051599 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 14:54:11.051787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.051682 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 14:54:11.051954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.051938 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nkrkc\"" Jun 11 14:54:11.052050 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.051992 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 14:54:11.052050 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.052023 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 14:54:11.052162 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.052095 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 14:54:11.052291 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.052275 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 14:54:11.052363 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.052301 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 14:54:11.063331 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.063309 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 14:54:11.079875 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.079844 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8fbl9" event={"ID":"189a3961-82b1-4794-93a1-a24a5956e97a","Type":"ContainerStarted","Data":"e445dd7646002423b99a78b79ea84312361851498d96d6e25bef3169b860a5d5"} Jun 11 14:54:11.149641 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.149606 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.149808 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.149670 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.149808 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.149736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.149808 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.149770 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.149970 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.149812 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.149970 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.149857 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-config-out\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.149970 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.149921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.149970 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.149955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.150171 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.149980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bwm5\" (UniqueName: \"kubernetes.io/projected/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-kube-api-access-6bwm5\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.150171 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.150039 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.150171 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.150066 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.150171 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.150109 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-web-config\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.150171 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.150138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.250652 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.250607 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.250652 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.250659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.250914 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.250700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.250914 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.250725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.250914 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.250748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.250914 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.250793 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.250914 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.250822 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-config-out\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.250914 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.250846 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.250914 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.250876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.251305 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:54:11.250957 2574 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 11 14:54:11.251305 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:54:11.251069 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-main-tls podName:3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8 nodeName:}" failed. No retries permitted until 2026-06-11 14:54:11.751044917 +0000 UTC m=+231.009296287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8") : secret "alertmanager-main-tls" not found Jun 11 14:54:11.251421 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.251354 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwm5\" (UniqueName: \"kubernetes.io/projected/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-kube-api-access-6bwm5\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.251421 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.251396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.251526 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.251425 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.251526 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.251459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-web-config\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.251526 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.251505 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.251722 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.251693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.251804 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.251770 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.254289 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.253767 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-config-out\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.254289 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.253898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.254289 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.254242 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.254520 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.254292 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.254520 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.254314 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-web-config\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.254520 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.254348 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.254520 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.254487 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.255099 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.255076 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.259071 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.259051 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bwm5\" (UniqueName: \"kubernetes.io/projected/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-kube-api-access-6bwm5\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.757954 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:11.757918 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:11.758137 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:54:11.758084 2574 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 11 14:54:11.758183 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:54:11.758145 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-main-tls podName:3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8 nodeName:}" failed. No retries permitted until 2026-06-11 14:54:12.758129624 +0000 UTC m=+232.016380994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8") : secret "alertmanager-main-tls" not found Jun 11 14:54:12.084651 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:12.084618 2574 generic.go:356] "Generic (PLEG): container finished" podID="189a3961-82b1-4794-93a1-a24a5956e97a" containerID="4f0010ed1221e0adfc12b82405899097758924386daf90c343b6d44a7762a5b5" exitCode=0 Jun 11 14:54:12.084967 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:12.084649 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8fbl9" event={"ID":"189a3961-82b1-4794-93a1-a24a5956e97a","Type":"ContainerDied","Data":"4f0010ed1221e0adfc12b82405899097758924386daf90c343b6d44a7762a5b5"} Jun 11 14:54:12.765370 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:12.765315 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:12.767700 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:12.767679 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:12.857479 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:12.857444 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:54:12.992345 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:12.992318 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 14:54:12.993342 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:54:12.993320 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e9f8ffc_8cc8_4ad2_b771_f384f020d3f8.slice/crio-dae81086f134b148ad0bc00188676ec8caa869c4914646bd72c412a126db4874 WatchSource:0}: Error finding container dae81086f134b148ad0bc00188676ec8caa869c4914646bd72c412a126db4874: Status 404 returned error can't find the container with id dae81086f134b148ad0bc00188676ec8caa869c4914646bd72c412a126db4874 Jun 11 14:54:13.090201 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:13.090106 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8fbl9" event={"ID":"189a3961-82b1-4794-93a1-a24a5956e97a","Type":"ContainerStarted","Data":"170d27c7daf76e02d077dd0d9be9a8be707a124c622e3f119ec28d5547c7e8ee"} Jun 11 14:54:13.090660 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:13.090216 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8fbl9" event={"ID":"189a3961-82b1-4794-93a1-a24a5956e97a","Type":"ContainerStarted","Data":"0d8d43626c429423ac277c8a9635b0f1af33d76a8590a2918c413e3061d920f1"} Jun 11 14:54:13.091302 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:13.091279 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerStarted","Data":"dae81086f134b148ad0bc00188676ec8caa869c4914646bd72c412a126db4874"} Jun 11 14:54:13.108587 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:13.108533 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8fbl9" podStartSLOduration=2.999813647 podStartE2EDuration="4.108517773s" totalImagesPullingTime="1.044727952s" totalInitContainerRuntime="63.976174ms" isStatefulPod=true podCreationTimestamp="2026-06-11 14:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:13.107568357 +0000 UTC m=+232.365819749" watchObservedRunningTime="2026-06-11 14:54:13.108517773 +0000 UTC m=+232.366769163" Jun 11 14:54:14.096169 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:14.096139 2574 generic.go:356] "Generic (PLEG): container finished" podID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerID="507f6f2badcf8095148916535bd87a259e8750d71c88c849accba4a7c4d3b355" exitCode=0 Jun 11 14:54:14.096523 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:14.096238 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerDied","Data":"507f6f2badcf8095148916535bd87a259e8750d71c88c849accba4a7c4d3b355"} Jun 11 14:54:16.107608 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:16.107573 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerStarted","Data":"4c9dda4bcf862e0a20d24feaf02c1801e369398d65c165cbc7f3e625812b00d8"} Jun 11 14:54:16.107995 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:16.107656 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerStarted","Data":"db24bf610abe3951878f52621ea19990b1fc3fa70366d1114160ac78e02f1a74"} Jun 11 14:54:16.107995 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:16.107699 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerStarted","Data":"2acb6bcbc2f5255dc2dd52efdebc7e58b4bfbfd0d874d72820d5980120ccbf5e"} Jun 11 14:54:16.107995 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:16.107740 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerStarted","Data":"ca1c44b8dc9a132ded193512733050d4ae550cbd6ed2946eb2f875e2dcba844b"} Jun 11 14:54:16.107995 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:16.107783 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerStarted","Data":"3c33a6a876c33a696eb3871bb2f7e8a3d74e150d94ae82719711a10433bf9eb9"} Jun 11 14:54:17.115360 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:17.115320 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerStarted","Data":"efe669e3a328fbfc7c8e3b5becf050bc77c43592a6068d2c5e85d0719287d62a"} Jun 11 14:54:17.144910 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:17.144852 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.082370806 podStartE2EDuration="6.144836517s" totalImagesPullingTime="3.044591453s" totalInitContainerRuntime="17.874258ms" isStatefulPod=false podCreationTimestamp="2026-06-11 14:54:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:17.143326135 +0000 UTC m=+236.401577561" watchObservedRunningTime="2026-06-11 14:54:17.144836517 +0000 UTC m=+236.403087942" Jun 11 14:54:20.938961 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:20.938914 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" podUID="89fe3b3c-23a8-4d75-9878-fba7694a965d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 14:54:20.939364 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:20.938995 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" Jun 11 14:54:20.939485 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:20.939456 2574 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"62921b916d50610a796a0e956ee4b0e91eba7621377d8b5523eb8a168125734b"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 14:54:20.939523 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:20.939506 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" podUID="89fe3b3c-23a8-4d75-9878-fba7694a965d" containerName="service-proxy" containerID="cri-o://62921b916d50610a796a0e956ee4b0e91eba7621377d8b5523eb8a168125734b" gracePeriod=30 Jun 11 14:54:21.131859 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:21.131798 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" event={"ID":"89fe3b3c-23a8-4d75-9878-fba7694a965d","Type":"ContainerDied","Data":"62921b916d50610a796a0e956ee4b0e91eba7621377d8b5523eb8a168125734b"} Jun 11 14:54:21.132024 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:21.131889 2574 generic.go:356] "Generic (PLEG): container finished" podID="89fe3b3c-23a8-4d75-9878-fba7694a965d" containerID="62921b916d50610a796a0e956ee4b0e91eba7621377d8b5523eb8a168125734b" exitCode=2 Jun 11 14:54:21.132024 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:21.131941 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b599897f7-nrt4m" event={"ID":"89fe3b3c-23a8-4d75-9878-fba7694a965d","Type":"ContainerStarted","Data":"a527bbbf5fa23a8bee4a54b73d54773f59dc84db6ee6aa3879b6ee45ba109550"} Jun 11 14:54:28.958851 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:28.958814 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-chcbp"] Jun 11 14:54:28.961273 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:28.961257 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-chcbp" Jun 11 14:54:28.963909 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:28.963885 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 14:54:28.964051 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:28.964021 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 14:54:28.964200 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:28.964182 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nf2z7\"" Jun 11 14:54:28.971452 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:28.971431 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-chcbp"] Jun 11 14:54:28.992621 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:28.992597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc4h9\" (UniqueName: \"kubernetes.io/projected/9d4b67b4-d967-44e6-9664-f9d89be8156d-kube-api-access-jc4h9\") pod \"downloads-6657875f97-chcbp\" (UID: \"9d4b67b4-d967-44e6-9664-f9d89be8156d\") " pod="openshift-console/downloads-6657875f97-chcbp" Jun 11 14:54:29.093626 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:29.093596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc4h9\" (UniqueName: \"kubernetes.io/projected/9d4b67b4-d967-44e6-9664-f9d89be8156d-kube-api-access-jc4h9\") pod \"downloads-6657875f97-chcbp\" (UID: \"9d4b67b4-d967-44e6-9664-f9d89be8156d\") " pod="openshift-console/downloads-6657875f97-chcbp" Jun 11 14:54:29.101464 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:29.101431 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc4h9\" (UniqueName: \"kubernetes.io/projected/9d4b67b4-d967-44e6-9664-f9d89be8156d-kube-api-access-jc4h9\") pod \"downloads-6657875f97-chcbp\" (UID: \"9d4b67b4-d967-44e6-9664-f9d89be8156d\") " pod="openshift-console/downloads-6657875f97-chcbp" Jun 11 14:54:29.270292 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:29.270205 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-chcbp" Jun 11 14:54:29.392325 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:29.392292 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-chcbp"] Jun 11 14:54:29.395996 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:54:29.395965 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4b67b4_d967_44e6_9664_f9d89be8156d.slice/crio-7e544e20f8b356e77e8fbaca5a7eab1a45c9425ca401496de2204c6c33a2c63a WatchSource:0}: Error finding container 7e544e20f8b356e77e8fbaca5a7eab1a45c9425ca401496de2204c6c33a2c63a: Status 404 returned error can't find the container with id 7e544e20f8b356e77e8fbaca5a7eab1a45c9425ca401496de2204c6c33a2c63a Jun 11 14:54:30.161554 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:30.161521 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-chcbp" event={"ID":"9d4b67b4-d967-44e6-9664-f9d89be8156d","Type":"ContainerStarted","Data":"7e544e20f8b356e77e8fbaca5a7eab1a45c9425ca401496de2204c6c33a2c63a"} Jun 11 14:54:32.119049 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:32.119001 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:54:32.121528 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:32.121499 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb162-f5a6-4c90-b19a-829f3057794b-metrics-certs\") pod \"network-metrics-daemon-q68m6\" (UID: \"d6feb162-f5a6-4c90-b19a-829f3057794b\") " pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:54:32.179282 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:32.179254 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fhnff\"" Jun 11 14:54:32.187572 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:32.187546 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q68m6" Jun 11 14:54:32.329791 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:32.329755 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q68m6"] Jun 11 14:54:32.333118 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:54:32.333090 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6feb162_f5a6_4c90_b19a_829f3057794b.slice/crio-cbe1adae3ed78f00987a618e8b5331ce6fb23f4e8e5c6130ea2f6e161de70c53 WatchSource:0}: Error finding container cbe1adae3ed78f00987a618e8b5331ce6fb23f4e8e5c6130ea2f6e161de70c53: Status 404 returned error can't find the container with id cbe1adae3ed78f00987a618e8b5331ce6fb23f4e8e5c6130ea2f6e161de70c53 Jun 11 14:54:33.174264 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:33.174231 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q68m6" event={"ID":"d6feb162-f5a6-4c90-b19a-829f3057794b","Type":"ContainerStarted","Data":"cbe1adae3ed78f00987a618e8b5331ce6fb23f4e8e5c6130ea2f6e161de70c53"} Jun 11 14:54:34.179152 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:34.179113 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q68m6" event={"ID":"d6feb162-f5a6-4c90-b19a-829f3057794b","Type":"ContainerStarted","Data":"074b35606699187a6bb8d2ec9f47d22e56e0b59ca00524e1f639843e7e77f7c3"} Jun 11 14:54:34.179533 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:34.179161 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q68m6" event={"ID":"d6feb162-f5a6-4c90-b19a-829f3057794b","Type":"ContainerStarted","Data":"166fd5f8903622c66bc40b5baae2a124691ad45cac440133be585174dc6b8088"} Jun 11 14:54:34.195182 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:34.195131 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q68m6" podStartSLOduration=252.327993108 podStartE2EDuration="4m13.195115662s" totalImagesPullingTime="867.122554ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:34.194470347 +0000 UTC m=+253.452721749" watchObservedRunningTime="2026-06-11 14:54:34.195115662 +0000 UTC m=+253.453367052" Jun 11 14:54:37.896247 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.896214 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b9799fd8c-2cd7t"] Jun 11 14:54:37.899423 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.899406 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:37.902066 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.901998 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 14:54:37.903247 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.903230 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x2z78\"" Jun 11 14:54:37.903247 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.903241 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 14:54:37.903421 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.903269 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 14:54:37.903421 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.903288 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 14:54:37.903421 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.903350 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 14:54:37.907899 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.907863 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9799fd8c-2cd7t"] Jun 11 14:54:37.971753 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.971720 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-console-config\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:37.971753 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.971752 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd078399-67a8-4f1f-86f3-860e190ff508-console-serving-cert\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:37.971949 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.971792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-oauth-serving-cert\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:37.971949 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.971875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btqmr\" (UniqueName: \"kubernetes.io/projected/cd078399-67a8-4f1f-86f3-860e190ff508-kube-api-access-btqmr\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:37.971949 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.971908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-service-ca\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:37.971949 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:37.971940 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd078399-67a8-4f1f-86f3-860e190ff508-console-oauth-config\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:38.072510 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:38.072471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-oauth-serving-cert\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:38.072510 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:38.072511 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btqmr\" (UniqueName: \"kubernetes.io/projected/cd078399-67a8-4f1f-86f3-860e190ff508-kube-api-access-btqmr\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:38.072738 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:38.072539 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-service-ca\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:38.072738 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:38.072592 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd078399-67a8-4f1f-86f3-860e190ff508-console-oauth-config\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:38.072738 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:38.072671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-console-config\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:38.072738 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:38.072691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd078399-67a8-4f1f-86f3-860e190ff508-console-serving-cert\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:38.073270 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:38.073244 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-oauth-serving-cert\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:38.073390 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:38.073325 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-console-config\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:38.073390 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:38.073335 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-service-ca\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:38.075247 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:38.075224 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd078399-67a8-4f1f-86f3-860e190ff508-console-serving-cert\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:38.075358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:38.075314 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd078399-67a8-4f1f-86f3-860e190ff508-console-oauth-config\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:38.081491 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:38.081463 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btqmr\" (UniqueName: \"kubernetes.io/projected/cd078399-67a8-4f1f-86f3-860e190ff508-kube-api-access-btqmr\") pod \"console-6b9799fd8c-2cd7t\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:38.208277 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:38.208243 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:38.341198 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:38.341164 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9799fd8c-2cd7t"] Jun 11 14:54:38.345396 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:54:38.345367 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd078399_67a8_4f1f_86f3_860e190ff508.slice/crio-32d69d1fd46eeba190c52185ad7536d54ea13eb8828ce8f50793622fb8b0f236 WatchSource:0}: Error finding container 32d69d1fd46eeba190c52185ad7536d54ea13eb8828ce8f50793622fb8b0f236: Status 404 returned error can't find the container with id 32d69d1fd46eeba190c52185ad7536d54ea13eb8828ce8f50793622fb8b0f236 Jun 11 14:54:39.197551 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:39.197516 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9799fd8c-2cd7t" event={"ID":"cd078399-67a8-4f1f-86f3-860e190ff508","Type":"ContainerStarted","Data":"32d69d1fd46eeba190c52185ad7536d54ea13eb8828ce8f50793622fb8b0f236"} Jun 11 14:54:42.210990 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:42.210947 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9799fd8c-2cd7t" event={"ID":"cd078399-67a8-4f1f-86f3-860e190ff508","Type":"ContainerStarted","Data":"8e575ba995b36b8da3df141855f820e16c045a83194ac21074abbe717fdd2da8"} Jun 11 14:54:42.226898 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:42.226849 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b9799fd8c-2cd7t" podStartSLOduration=2.087955574 podStartE2EDuration="5.226830857s" totalImagesPullingTime="3.138875283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:42.226431443 +0000 UTC m=+261.484682835" watchObservedRunningTime="2026-06-11 14:54:42.226830857 +0000 UTC m=+261.485082248" Jun 11 14:54:48.208552 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:48.208499 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:48.208970 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:48.208574 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:54:48.210164 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:48.210140 2574 patch_prober.go:28] interesting pod/console-6b9799fd8c-2cd7t container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 11 14:54:48.210293 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:48.210194 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b9799fd8c-2cd7t" podUID="cd078399-67a8-4f1f-86f3-860e190ff508" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 11 14:54:53.252169 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:53.252125 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-chcbp" event={"ID":"9d4b67b4-d967-44e6-9664-f9d89be8156d","Type":"ContainerStarted","Data":"30702a4d639cc811ae682286970c4f4ac190959ba0af167680952fa5e31b48ea"} Jun 11 14:54:53.252660 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:53.252294 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-chcbp" Jun 11 14:54:53.270492 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:53.270465 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-chcbp" Jun 11 14:54:53.270695 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:53.270641 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-chcbp" podStartSLOduration=2.121196953 podStartE2EDuration="25.27062714s" totalImagesPullingTime="23.149430187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:53.267881701 +0000 UTC m=+272.526133114" watchObservedRunningTime="2026-06-11 14:54:53.27062714 +0000 UTC m=+272.528878533" Jun 11 14:54:58.209151 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:58.209106 2574 patch_prober.go:28] interesting pod/console-6b9799fd8c-2cd7t container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 11 14:54:58.209619 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:54:58.209168 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b9799fd8c-2cd7t" podUID="cd078399-67a8-4f1f-86f3-860e190ff508" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 11 14:55:02.862569 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:55:02.862525 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fdxrx" podUID="cb805cfa-5506-449e-810f-cbc624679eaa" Jun 11 14:55:03.291654 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:03.291623 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fdxrx" Jun 11 14:55:06.125673 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:06.125636 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:55:06.127885 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:06.127863 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb805cfa-5506-449e-810f-cbc624679eaa-metrics-tls\") pod \"dns-default-fdxrx\" (UID: \"cb805cfa-5506-449e-810f-cbc624679eaa\") " pod="openshift-dns/dns-default-fdxrx" Jun 11 14:55:06.294535 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:06.294504 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5zf7p\"" Jun 11 14:55:06.302465 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:06.302439 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fdxrx" Jun 11 14:55:06.490242 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:06.490219 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fdxrx"] Jun 11 14:55:06.492670 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:55:06.492640 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb805cfa_5506_449e_810f_cbc624679eaa.slice/crio-a82d894cd0111a2500e79b332b0a7d027a2e480fa5295a60b82ac25ec0cea7e9 WatchSource:0}: Error finding container a82d894cd0111a2500e79b332b0a7d027a2e480fa5295a60b82ac25ec0cea7e9: Status 404 returned error can't find the container with id a82d894cd0111a2500e79b332b0a7d027a2e480fa5295a60b82ac25ec0cea7e9 Jun 11 14:55:06.526953 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:06.526929 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8/init-config-reloader/0.log" Jun 11 14:55:06.726981 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:06.726898 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8/alertmanager/0.log" Jun 11 14:55:06.927683 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:06.927639 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8/config-reloader/0.log" Jun 11 14:55:07.126975 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:07.126894 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8/kube-rbac-proxy-web/0.log" Jun 11 14:55:07.308068 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:07.308029 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdxrx" event={"ID":"cb805cfa-5506-449e-810f-cbc624679eaa","Type":"ContainerStarted","Data":"a82d894cd0111a2500e79b332b0a7d027a2e480fa5295a60b82ac25ec0cea7e9"} Jun 11 14:55:07.328288 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:07.328207 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8/kube-rbac-proxy/0.log" Jun 11 14:55:07.526600 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:07.526561 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8/kube-rbac-proxy-metric/0.log" Jun 11 14:55:07.727162 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:07.727130 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8/prom-label-proxy/0.log" Jun 11 14:55:08.209478 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:08.209436 2574 patch_prober.go:28] interesting pod/console-6b9799fd8c-2cd7t container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 11 14:55:08.209841 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:08.209509 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b9799fd8c-2cd7t" podUID="cd078399-67a8-4f1f-86f3-860e190ff508" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 11 14:55:09.316200 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:09.316162 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdxrx" event={"ID":"cb805cfa-5506-449e-810f-cbc624679eaa","Type":"ContainerStarted","Data":"c9badeafbe9dd082bc723ce7d7f101733d2328956fa52b4c21293f3710912b4d"} Jun 11 14:55:09.316747 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:09.316219 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdxrx" event={"ID":"cb805cfa-5506-449e-810f-cbc624679eaa","Type":"ContainerStarted","Data":"e2d05408c32e210a0096f210f2fdfbe9184404d70a1dc46bc06a05207b5cf2da"} Jun 11 14:55:09.316747 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:09.316288 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fdxrx" Jun 11 14:55:09.331223 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:09.331181 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fdxrx" podStartSLOduration=251.336509071 podStartE2EDuration="4m13.331165698s" totalImagesPullingTime="1.994656627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:55:09.331058266 +0000 UTC m=+288.589309658" watchObservedRunningTime="2026-06-11 14:55:09.331165698 +0000 UTC m=+288.589417092" Jun 11 14:55:09.726229 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:09.726198 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8fbl9_189a3961-82b1-4794-93a1-a24a5956e97a/init-textfile/0.log" Jun 11 14:55:09.927850 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:09.927820 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8fbl9_189a3961-82b1-4794-93a1-a24a5956e97a/node-exporter/0.log" Jun 11 14:55:10.127918 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:10.127841 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8fbl9_189a3961-82b1-4794-93a1-a24a5956e97a/kube-rbac-proxy/0.log" Jun 11 14:55:13.326078 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:13.326047 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-6fjl5_122731c6-9e8b-457f-8bbe-d66426542a4e/prometheus-operator-admission-webhook/0.log" Jun 11 14:55:14.257867 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:14.257835 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b9799fd8c-2cd7t"] Jun 11 14:55:15.927044 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:15.927000 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b9799fd8c-2cd7t_cd078399-67a8-4f1f-86f3-860e190ff508/console/0.log" Jun 11 14:55:16.328930 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:16.328857 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-chcbp_9d4b67b4-d967-44e6-9664-f9d89be8156d/download-server/0.log" Jun 11 14:55:16.341757 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:16.341723 2574 generic.go:356] "Generic (PLEG): container finished" podID="8e5b1a48-a780-4b80-aab8-35e963db4959" containerID="40bb0f87e60658bafe119553a09f5254bc0c0407a4cc25d7bb1eaf23ba295254" exitCode=255 Jun 11 14:55:16.341892 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:16.341762 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" event={"ID":"8e5b1a48-a780-4b80-aab8-35e963db4959","Type":"ContainerDied","Data":"40bb0f87e60658bafe119553a09f5254bc0c0407a4cc25d7bb1eaf23ba295254"} Jun 11 14:55:16.341892 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:16.341807 2574 scope.go:117] "RemoveContainer" containerID="31a063eb75f2979e95418ea70010b671a8601bea22fcce5cd06ab0e72cb3fbbf" Jun 11 14:55:16.342141 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:16.342119 2574 scope.go:117] "RemoveContainer" containerID="40bb0f87e60658bafe119553a09f5254bc0c0407a4cc25d7bb1eaf23ba295254" Jun 11 14:55:16.342320 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:55:16.342300 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-69cc8ccd78-7svdd_open-cluster-management-agent-addon(8e5b1a48-a780-4b80-aab8-35e963db4959)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" podUID="8e5b1a48-a780-4b80-aab8-35e963db4959" Jun 11 14:55:16.926575 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:16.926544 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fdxrx_cb805cfa-5506-449e-810f-cbc624679eaa/dns/0.log" Jun 11 14:55:17.126765 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:17.126735 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fdxrx_cb805cfa-5506-449e-810f-cbc624679eaa/kube-rbac-proxy/0.log" Jun 11 14:55:18.126072 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:18.126045 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wgzcn_400743e8-75f6-41ed-a7d6-28b75105c435/dns-node-resolver/0.log" Jun 11 14:55:18.927138 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:18.927111 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d2dgr_f6330dcf-d467-4d44-890c-e4b689e5d451/node-ca/0.log" Jun 11 14:55:19.322665 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:19.322591 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fdxrx" Jun 11 14:55:19.726512 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:19.726480 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h8lr6_321e1681-bcb6-413d-8d63-c64aacd4e352/serve-healthcheck-canary/0.log" Jun 11 14:55:20.929032 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:20.928970 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" Jun 11 14:55:20.929478 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:20.929465 2574 scope.go:117] "RemoveContainer" containerID="40bb0f87e60658bafe119553a09f5254bc0c0407a4cc25d7bb1eaf23ba295254" Jun 11 14:55:20.929647 ip-10-0-135-91 kubenswrapper[2574]: E0611 14:55:20.929628 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-69cc8ccd78-7svdd_open-cluster-management-agent-addon(8e5b1a48-a780-4b80-aab8-35e963db4959)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" podUID="8e5b1a48-a780-4b80-aab8-35e963db4959" Jun 11 14:55:21.100649 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:21.100620 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 14:55:21.100957 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:21.100932 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 14:55:21.103398 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:21.103379 2574 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 14:55:30.230414 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.230372 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 14:55:30.248850 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.230733 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="alertmanager" containerID="cri-o://3c33a6a876c33a696eb3871bb2f7e8a3d74e150d94ae82719711a10433bf9eb9" gracePeriod=120 Jun 11 14:55:30.248850 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.230770 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="kube-rbac-proxy-metric" containerID="cri-o://4c9dda4bcf862e0a20d24feaf02c1801e369398d65c165cbc7f3e625812b00d8" gracePeriod=120 Jun 11 14:55:30.248850 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.230785 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="kube-rbac-proxy-web" containerID="cri-o://2acb6bcbc2f5255dc2dd52efdebc7e58b4bfbfd0d874d72820d5980120ccbf5e" gracePeriod=120 Jun 11 14:55:30.248850 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.230817 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="config-reloader" containerID="cri-o://ca1c44b8dc9a132ded193512733050d4ae550cbd6ed2946eb2f875e2dcba844b" gracePeriod=120 Jun 11 14:55:30.248850 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.230830 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="prom-label-proxy" containerID="cri-o://efe669e3a328fbfc7c8e3b5becf050bc77c43592a6068d2c5e85d0719287d62a" gracePeriod=120 Jun 11 14:55:30.248850 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.230870 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="kube-rbac-proxy" containerID="cri-o://db24bf610abe3951878f52621ea19990b1fc3fa70366d1114160ac78e02f1a74" gracePeriod=120 Jun 11 14:55:30.400867 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.400833 2574 generic.go:356] "Generic (PLEG): container finished" podID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerID="efe669e3a328fbfc7c8e3b5becf050bc77c43592a6068d2c5e85d0719287d62a" exitCode=0 Jun 11 14:55:30.400867 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.400859 2574 generic.go:356] "Generic (PLEG): container finished" podID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerID="db24bf610abe3951878f52621ea19990b1fc3fa70366d1114160ac78e02f1a74" exitCode=0 Jun 11 14:55:30.400867 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.400867 2574 generic.go:356] "Generic (PLEG): container finished" podID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerID="ca1c44b8dc9a132ded193512733050d4ae550cbd6ed2946eb2f875e2dcba844b" exitCode=0 Jun 11 14:55:30.400867 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.400874 2574 generic.go:356] "Generic (PLEG): container finished" podID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerID="3c33a6a876c33a696eb3871bb2f7e8a3d74e150d94ae82719711a10433bf9eb9" exitCode=0 Jun 11 14:55:30.401213 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.400906 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerDied","Data":"efe669e3a328fbfc7c8e3b5becf050bc77c43592a6068d2c5e85d0719287d62a"} Jun 11 14:55:30.401213 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.401041 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerDied","Data":"db24bf610abe3951878f52621ea19990b1fc3fa70366d1114160ac78e02f1a74"} Jun 11 14:55:30.401213 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.401082 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerDied","Data":"ca1c44b8dc9a132ded193512733050d4ae550cbd6ed2946eb2f875e2dcba844b"} Jun 11 14:55:30.401213 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:30.401123 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerDied","Data":"3c33a6a876c33a696eb3871bb2f7e8a3d74e150d94ae82719711a10433bf9eb9"} Jun 11 14:55:31.407360 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:31.407328 2574 generic.go:356] "Generic (PLEG): container finished" podID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerID="4c9dda4bcf862e0a20d24feaf02c1801e369398d65c165cbc7f3e625812b00d8" exitCode=0 Jun 11 14:55:31.407360 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:31.407353 2574 generic.go:356] "Generic (PLEG): container finished" podID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerID="2acb6bcbc2f5255dc2dd52efdebc7e58b4bfbfd0d874d72820d5980120ccbf5e" exitCode=0 Jun 11 14:55:31.407739 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:31.407397 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerDied","Data":"4c9dda4bcf862e0a20d24feaf02c1801e369398d65c165cbc7f3e625812b00d8"} Jun 11 14:55:31.407739 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:31.407453 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerDied","Data":"2acb6bcbc2f5255dc2dd52efdebc7e58b4bfbfd0d874d72820d5980120ccbf5e"} Jun 11 14:55:31.995584 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:31.995552 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.134741 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.134657 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-cluster-tls-config\") pod \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " Jun 11 14:55:32.134741 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.134694 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " Jun 11 14:55:32.134741 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.134729 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-config-volume\") pod \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " Jun 11 14:55:32.135041 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.134752 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-tls-assets\") pod \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " Jun 11 14:55:32.135041 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.134794 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-web-config\") pod \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " Jun 11 14:55:32.135041 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.134821 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy\") pod \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " Jun 11 14:55:32.135041 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.134858 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-config-out\") pod \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " Jun 11 14:55:32.135041 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.134882 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-alertmanager-main-db\") pod \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " Jun 11 14:55:32.135041 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.134923 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-main-tls\") pod \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " Jun 11 14:55:32.135041 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.134950 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bwm5\" (UniqueName: \"kubernetes.io/projected/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-kube-api-access-6bwm5\") pod \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " Jun 11 14:55:32.135041 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.134982 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " Jun 11 14:55:32.135041 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.135032 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-metrics-client-ca\") pod \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " Jun 11 14:55:32.135499 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.135080 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-alertmanager-trusted-ca-bundle\") pod \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\" (UID: \"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8\") " Jun 11 14:55:32.135778 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.135656 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:55:32.136062 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.136036 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:55:32.136157 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.136093 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:55:32.137728 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.137689 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:55:32.137867 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.137844 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:55:32.138092 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.138068 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-config-out" (OuterVolumeSpecName: "config-out") pod "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:55:32.138300 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.138280 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:55:32.138439 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.138404 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-kube-api-access-6bwm5" (OuterVolumeSpecName: "kube-api-access-6bwm5") pod "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8"). InnerVolumeSpecName "kube-api-access-6bwm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:55:32.139357 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.139330 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-config-volume" (OuterVolumeSpecName: "config-volume") pod "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:55:32.139436 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.139357 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:55:32.139718 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.139699 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:55:32.142297 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.142198 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:55:32.147204 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.147185 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-web-config" (OuterVolumeSpecName: "web-config") pod "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" (UID: "3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:55:32.175846 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.175824 2574 scope.go:117] "RemoveContainer" containerID="40bb0f87e60658bafe119553a09f5254bc0c0407a4cc25d7bb1eaf23ba295254" Jun 11 14:55:32.236071 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.236049 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:32.236184 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.236074 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-config-out\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:32.236184 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.236088 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-alertmanager-main-db\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:32.236184 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.236102 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-main-tls\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:32.236184 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.236116 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bwm5\" (UniqueName: \"kubernetes.io/projected/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-kube-api-access-6bwm5\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:32.236184 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.236128 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:32.236184 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.236142 2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-metrics-client-ca\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:32.236184 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.236154 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:32.236184 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.236166 2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-cluster-tls-config\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:32.236184 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.236179 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:32.236479 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.236192 2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-config-volume\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:32.236479 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.236207 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-tls-assets\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:32.236479 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.236245 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8-web-config\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:32.412893 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.412858 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69cc8ccd78-7svdd" event={"ID":"8e5b1a48-a780-4b80-aab8-35e963db4959","Type":"ContainerStarted","Data":"d918596d66cc81903573c789c5c2cf45b59605b2e363b96c0c07a6eb0aafa623"} Jun 11 14:55:32.415780 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.415757 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8","Type":"ContainerDied","Data":"dae81086f134b148ad0bc00188676ec8caa869c4914646bd72c412a126db4874"} Jun 11 14:55:32.415907 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.415787 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.415907 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.415825 2574 scope.go:117] "RemoveContainer" containerID="efe669e3a328fbfc7c8e3b5becf050bc77c43592a6068d2c5e85d0719287d62a" Jun 11 14:55:32.423965 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.423946 2574 scope.go:117] "RemoveContainer" containerID="4c9dda4bcf862e0a20d24feaf02c1801e369398d65c165cbc7f3e625812b00d8" Jun 11 14:55:32.431177 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.431152 2574 scope.go:117] "RemoveContainer" containerID="db24bf610abe3951878f52621ea19990b1fc3fa70366d1114160ac78e02f1a74" Jun 11 14:55:32.437755 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.437735 2574 scope.go:117] "RemoveContainer" containerID="2acb6bcbc2f5255dc2dd52efdebc7e58b4bfbfd0d874d72820d5980120ccbf5e" Jun 11 14:55:32.442349 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.442327 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 14:55:32.444766 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.444749 2574 scope.go:117] "RemoveContainer" containerID="ca1c44b8dc9a132ded193512733050d4ae550cbd6ed2946eb2f875e2dcba844b" Jun 11 14:55:32.450342 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.450317 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 14:55:32.452463 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.452442 2574 scope.go:117] "RemoveContainer" containerID="3c33a6a876c33a696eb3871bb2f7e8a3d74e150d94ae82719711a10433bf9eb9" Jun 11 14:55:32.459236 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.459218 2574 scope.go:117] "RemoveContainer" containerID="507f6f2badcf8095148916535bd87a259e8750d71c88c849accba4a7c4d3b355" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475135 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475605 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="kube-rbac-proxy-metric" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475622 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="kube-rbac-proxy-metric" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475650 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="init-config-reloader" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475659 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="init-config-reloader" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475682 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="config-reloader" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475691 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="config-reloader" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475704 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="alertmanager" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475714 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="alertmanager" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475733 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="prom-label-proxy" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475742 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="prom-label-proxy" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475755 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="kube-rbac-proxy" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475764 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="kube-rbac-proxy" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475787 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="kube-rbac-proxy-web" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475796 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="kube-rbac-proxy-web" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475898 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="config-reloader" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475913 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="alertmanager" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475923 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="kube-rbac-proxy-metric" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475932 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="kube-rbac-proxy-web" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475947 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="kube-rbac-proxy" Jun 11 14:55:32.477547 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.475955 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" containerName="prom-label-proxy" Jun 11 14:55:32.509519 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.509493 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 14:55:32.509638 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.509624 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.512292 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.512259 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 14:55:32.512407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.512316 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 14:55:32.512475 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.512439 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 14:55:32.512563 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.512545 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 14:55:32.512666 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.512649 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 14:55:32.512738 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.512672 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nkrkc\"" Jun 11 14:55:32.512785 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.512762 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 14:55:32.512785 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.512775 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 14:55:32.512859 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.512819 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 14:55:32.517665 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.517649 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 14:55:32.639525 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.639494 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-web-config\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.639525 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.639526 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ff5bd8a-2072-4159-bbd5-d0221432c351-config-out\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.639715 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.639546 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ff5bd8a-2072-4159-bbd5-d0221432c351-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.639715 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.639593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ff5bd8a-2072-4159-bbd5-d0221432c351-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.639715 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.639632 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.639715 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.639658 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.639715 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.639694 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ff5bd8a-2072-4159-bbd5-d0221432c351-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.639715 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.639711 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w7pk\" (UniqueName: \"kubernetes.io/projected/8ff5bd8a-2072-4159-bbd5-d0221432c351-kube-api-access-4w7pk\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.639882 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.639740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.639882 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.639755 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.639882 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.639770 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.639882 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.639838 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ff5bd8a-2072-4159-bbd5-d0221432c351-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.639882 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.639856 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.740320 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.740238 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ff5bd8a-2072-4159-bbd5-d0221432c351-config-out\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.740320 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.740273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ff5bd8a-2072-4159-bbd5-d0221432c351-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.740320 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.740291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ff5bd8a-2072-4159-bbd5-d0221432c351-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.740320 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.740314 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.740551 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.740347 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.740551 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.740470 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ff5bd8a-2072-4159-bbd5-d0221432c351-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.740654 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.740563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w7pk\" (UniqueName: \"kubernetes.io/projected/8ff5bd8a-2072-4159-bbd5-d0221432c351-kube-api-access-4w7pk\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.740654 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.740610 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.740654 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.740643 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.740788 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.740672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.740788 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.740729 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ff5bd8a-2072-4159-bbd5-d0221432c351-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.740788 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.740759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.740926 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.740797 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-web-config\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.740926 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.740889 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ff5bd8a-2072-4159-bbd5-d0221432c351-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.741959 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.741461 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ff5bd8a-2072-4159-bbd5-d0221432c351-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.741959 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.741490 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ff5bd8a-2072-4159-bbd5-d0221432c351-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.743759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.743458 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.743759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.743602 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.743759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.743623 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ff5bd8a-2072-4159-bbd5-d0221432c351-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.743759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.743649 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-web-config\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.743759 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.743711 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.743973 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.743814 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ff5bd8a-2072-4159-bbd5-d0221432c351-config-out\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.744142 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.744109 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.744369 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.744350 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.745593 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.745573 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ff5bd8a-2072-4159-bbd5-d0221432c351-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.749475 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.749448 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w7pk\" (UniqueName: \"kubernetes.io/projected/8ff5bd8a-2072-4159-bbd5-d0221432c351-kube-api-access-4w7pk\") pod \"alertmanager-main-0\" (UID: \"8ff5bd8a-2072-4159-bbd5-d0221432c351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.819344 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.819307 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:55:32.978470 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:32.978438 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 14:55:32.981157 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:55:32.981136 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff5bd8a_2072_4159_bbd5_d0221432c351.slice/crio-415f9acb99703aad4dd3dcb504b3df47f60721e6dcef0a4c1f9f83467fab4b17 WatchSource:0}: Error finding container 415f9acb99703aad4dd3dcb504b3df47f60721e6dcef0a4c1f9f83467fab4b17: Status 404 returned error can't find the container with id 415f9acb99703aad4dd3dcb504b3df47f60721e6dcef0a4c1f9f83467fab4b17 Jun 11 14:55:33.180718 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:33.180684 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8" path="/var/lib/kubelet/pods/3e9f8ffc-8cc8-4ad2-b771-f384f020d3f8/volumes" Jun 11 14:55:33.421567 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:33.421534 2574 generic.go:356] "Generic (PLEG): container finished" podID="8ff5bd8a-2072-4159-bbd5-d0221432c351" containerID="cd466bfc5dc9c2078700cffdd5c7dfba510b020ed55ffa1712c096c5c6a7fd60" exitCode=0 Jun 11 14:55:33.421922 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:33.421599 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ff5bd8a-2072-4159-bbd5-d0221432c351","Type":"ContainerDied","Data":"cd466bfc5dc9c2078700cffdd5c7dfba510b020ed55ffa1712c096c5c6a7fd60"} Jun 11 14:55:33.421922 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:33.421648 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ff5bd8a-2072-4159-bbd5-d0221432c351","Type":"ContainerStarted","Data":"415f9acb99703aad4dd3dcb504b3df47f60721e6dcef0a4c1f9f83467fab4b17"} Jun 11 14:55:34.428383 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:34.428351 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ff5bd8a-2072-4159-bbd5-d0221432c351","Type":"ContainerStarted","Data":"e24127332273ac1fac7dcbd5f71bb34df8027b3f5758e8676825d0628d44aa64"} Jun 11 14:55:34.428842 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:34.428429 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ff5bd8a-2072-4159-bbd5-d0221432c351","Type":"ContainerStarted","Data":"7eb3465a008246fd2f385d54aa64735274b10599e275b20b922a2099c1327ea9"} Jun 11 14:55:34.428842 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:34.428477 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ff5bd8a-2072-4159-bbd5-d0221432c351","Type":"ContainerStarted","Data":"7dc443d06b759bb6594add7f01e9289bb201184997b66645bf815699cdc4329e"} Jun 11 14:55:34.428842 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:34.428522 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ff5bd8a-2072-4159-bbd5-d0221432c351","Type":"ContainerStarted","Data":"3773322334c6f43f6acc917f2ea2872b46f17460c9d8d6f752478d147d77d539"} Jun 11 14:55:34.428842 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:34.428560 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ff5bd8a-2072-4159-bbd5-d0221432c351","Type":"ContainerStarted","Data":"5f66b0174fc4bacb96dd812503332f83c7c09e87ffc46c02e1b49ce34dc48ff4"} Jun 11 14:55:34.428842 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:34.428601 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ff5bd8a-2072-4159-bbd5-d0221432c351","Type":"ContainerStarted","Data":"60ae8dbb4032a570c3e3ec05943f63f9cb193c839c74ba282fd19f7d215f00d1"} Jun 11 14:55:39.277429 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.277381 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6b9799fd8c-2cd7t" podUID="cd078399-67a8-4f1f-86f3-860e190ff508" containerName="console" containerID="cri-o://8e575ba995b36b8da3df141855f820e16c045a83194ac21074abbe717fdd2da8" gracePeriod=15 Jun 11 14:55:39.448122 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.448020 2574 generic.go:356] "Generic (PLEG): container finished" podID="cd078399-67a8-4f1f-86f3-860e190ff508" containerID="8e575ba995b36b8da3df141855f820e16c045a83194ac21074abbe717fdd2da8" exitCode=0 Jun 11 14:55:39.448241 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.448136 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9799fd8c-2cd7t" event={"ID":"cd078399-67a8-4f1f-86f3-860e190ff508","Type":"ContainerDied","Data":"8e575ba995b36b8da3df141855f820e16c045a83194ac21074abbe717fdd2da8"} Jun 11 14:55:39.515462 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.515439 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:55:39.535392 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.535289 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.514691371 podStartE2EDuration="7.53526747s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.576099ms" isStatefulPod=false podCreationTimestamp="2026-06-11 14:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:55:34.456587997 +0000 UTC m=+313.714839391" watchObservedRunningTime="2026-06-11 14:55:39.53526747 +0000 UTC m=+318.793518862" Jun 11 14:55:39.704659 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.704612 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-oauth-serving-cert\") pod \"cd078399-67a8-4f1f-86f3-860e190ff508\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " Jun 11 14:55:39.704841 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.704672 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd078399-67a8-4f1f-86f3-860e190ff508-console-oauth-config\") pod \"cd078399-67a8-4f1f-86f3-860e190ff508\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " Jun 11 14:55:39.704841 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.704714 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-service-ca\") pod \"cd078399-67a8-4f1f-86f3-860e190ff508\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " Jun 11 14:55:39.704841 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.704750 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd078399-67a8-4f1f-86f3-860e190ff508-console-serving-cert\") pod \"cd078399-67a8-4f1f-86f3-860e190ff508\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " Jun 11 14:55:39.704841 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.704822 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-console-config\") pod \"cd078399-67a8-4f1f-86f3-860e190ff508\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " Jun 11 14:55:39.705160 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.704852 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btqmr\" (UniqueName: \"kubernetes.io/projected/cd078399-67a8-4f1f-86f3-860e190ff508-kube-api-access-btqmr\") pod \"cd078399-67a8-4f1f-86f3-860e190ff508\" (UID: \"cd078399-67a8-4f1f-86f3-860e190ff508\") " Jun 11 14:55:39.705160 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.705121 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd078399-67a8-4f1f-86f3-860e190ff508" (UID: "cd078399-67a8-4f1f-86f3-860e190ff508"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:55:39.705253 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.705185 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd078399-67a8-4f1f-86f3-860e190ff508" (UID: "cd078399-67a8-4f1f-86f3-860e190ff508"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:55:39.705465 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.705437 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-console-config" (OuterVolumeSpecName: "console-config") pod "cd078399-67a8-4f1f-86f3-860e190ff508" (UID: "cd078399-67a8-4f1f-86f3-860e190ff508"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:55:39.707031 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.706993 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd078399-67a8-4f1f-86f3-860e190ff508-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd078399-67a8-4f1f-86f3-860e190ff508" (UID: "cd078399-67a8-4f1f-86f3-860e190ff508"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:55:39.707140 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.707048 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd078399-67a8-4f1f-86f3-860e190ff508-kube-api-access-btqmr" (OuterVolumeSpecName: "kube-api-access-btqmr") pod "cd078399-67a8-4f1f-86f3-860e190ff508" (UID: "cd078399-67a8-4f1f-86f3-860e190ff508"). InnerVolumeSpecName "kube-api-access-btqmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:55:39.707140 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.707107 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd078399-67a8-4f1f-86f3-860e190ff508-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd078399-67a8-4f1f-86f3-860e190ff508" (UID: "cd078399-67a8-4f1f-86f3-860e190ff508"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:55:39.805690 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.805608 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-console-config\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:39.805690 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.805637 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btqmr\" (UniqueName: \"kubernetes.io/projected/cd078399-67a8-4f1f-86f3-860e190ff508-kube-api-access-btqmr\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:39.805690 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.805651 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-oauth-serving-cert\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:39.805690 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.805664 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd078399-67a8-4f1f-86f3-860e190ff508-console-oauth-config\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:39.805690 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.805673 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd078399-67a8-4f1f-86f3-860e190ff508-service-ca\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:39.805690 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:39.805682 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd078399-67a8-4f1f-86f3-860e190ff508-console-serving-cert\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:55:40.455458 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:40.455414 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9799fd8c-2cd7t" event={"ID":"cd078399-67a8-4f1f-86f3-860e190ff508","Type":"ContainerDied","Data":"32d69d1fd46eeba190c52185ad7536d54ea13eb8828ce8f50793622fb8b0f236"} Jun 11 14:55:40.455879 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:40.455482 2574 scope.go:117] "RemoveContainer" containerID="8e575ba995b36b8da3df141855f820e16c045a83194ac21074abbe717fdd2da8" Jun 11 14:55:40.455879 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:40.455432 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9799fd8c-2cd7t" Jun 11 14:55:40.475694 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:40.475666 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b9799fd8c-2cd7t"] Jun 11 14:55:40.477138 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:40.477113 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b9799fd8c-2cd7t"] Jun 11 14:55:41.179873 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:55:41.179842 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd078399-67a8-4f1f-86f3-860e190ff508" path="/var/lib/kubelet/pods/cd078399-67a8-4f1f-86f3-860e190ff508/volumes" Jun 11 14:56:37.511863 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.511823 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r"] Jun 11 14:56:37.512404 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.512197 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd078399-67a8-4f1f-86f3-860e190ff508" containerName="console" Jun 11 14:56:37.512404 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.512215 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd078399-67a8-4f1f-86f3-860e190ff508" containerName="console" Jun 11 14:56:37.512404 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.512295 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd078399-67a8-4f1f-86f3-860e190ff508" containerName="console" Jun 11 14:56:37.516478 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.516456 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" Jun 11 14:56:37.519100 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.519081 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:56:37.519236 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.519081 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:56:37.520197 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.520182 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gb8nl\"" Jun 11 14:56:37.524182 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.524060 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r"] Jun 11 14:56:37.622465 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.622432 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqpzf\" (UniqueName: \"kubernetes.io/projected/030a6599-7532-45da-abd5-bd20bb515b65-kube-api-access-kqpzf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r\" (UID: \"030a6599-7532-45da-abd5-bd20bb515b65\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" Jun 11 14:56:37.622627 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.622476 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/030a6599-7532-45da-abd5-bd20bb515b65-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r\" (UID: \"030a6599-7532-45da-abd5-bd20bb515b65\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" Jun 11 14:56:37.622627 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.622498 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/030a6599-7532-45da-abd5-bd20bb515b65-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r\" (UID: \"030a6599-7532-45da-abd5-bd20bb515b65\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" Jun 11 14:56:37.723465 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.723429 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqpzf\" (UniqueName: \"kubernetes.io/projected/030a6599-7532-45da-abd5-bd20bb515b65-kube-api-access-kqpzf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r\" (UID: \"030a6599-7532-45da-abd5-bd20bb515b65\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" Jun 11 14:56:37.723622 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.723477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/030a6599-7532-45da-abd5-bd20bb515b65-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r\" (UID: \"030a6599-7532-45da-abd5-bd20bb515b65\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" Jun 11 14:56:37.723676 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.723612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/030a6599-7532-45da-abd5-bd20bb515b65-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r\" (UID: \"030a6599-7532-45da-abd5-bd20bb515b65\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" Jun 11 14:56:37.723797 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.723780 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/030a6599-7532-45da-abd5-bd20bb515b65-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r\" (UID: \"030a6599-7532-45da-abd5-bd20bb515b65\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" Jun 11 14:56:37.723964 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.723945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/030a6599-7532-45da-abd5-bd20bb515b65-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r\" (UID: \"030a6599-7532-45da-abd5-bd20bb515b65\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" Jun 11 14:56:37.731612 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.731589 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqpzf\" (UniqueName: \"kubernetes.io/projected/030a6599-7532-45da-abd5-bd20bb515b65-kube-api-access-kqpzf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r\" (UID: \"030a6599-7532-45da-abd5-bd20bb515b65\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" Jun 11 14:56:37.827422 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.827349 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" Jun 11 14:56:37.952357 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.952326 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r"] Jun 11 14:56:37.955398 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:56:37.955373 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030a6599_7532_45da_abd5_bd20bb515b65.slice/crio-8b88be815cd3c0940d2704c0fc56f1c47edec458026b397aa28cb40e848aac3a WatchSource:0}: Error finding container 8b88be815cd3c0940d2704c0fc56f1c47edec458026b397aa28cb40e848aac3a: Status 404 returned error can't find the container with id 8b88be815cd3c0940d2704c0fc56f1c47edec458026b397aa28cb40e848aac3a Jun 11 14:56:37.962404 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:37.962383 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:56:38.653963 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:38.653920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" event={"ID":"030a6599-7532-45da-abd5-bd20bb515b65","Type":"ContainerStarted","Data":"8b88be815cd3c0940d2704c0fc56f1c47edec458026b397aa28cb40e848aac3a"} Jun 11 14:56:46.685427 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:46.685384 2574 generic.go:356] "Generic (PLEG): container finished" podID="030a6599-7532-45da-abd5-bd20bb515b65" containerID="d0ba2c8f9faf76cfc345ecdb6124760e482f251ff322298c8b3faf39e14ee327" exitCode=0 Jun 11 14:56:46.685818 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:46.685459 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" event={"ID":"030a6599-7532-45da-abd5-bd20bb515b65","Type":"ContainerDied","Data":"d0ba2c8f9faf76cfc345ecdb6124760e482f251ff322298c8b3faf39e14ee327"} Jun 11 14:56:48.698044 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:48.697991 2574 generic.go:356] "Generic (PLEG): container finished" podID="030a6599-7532-45da-abd5-bd20bb515b65" containerID="f7ba050b34c15e94e4df533edd76726ccbee8d5a71e03adf115dde398389480c" exitCode=0 Jun 11 14:56:48.698445 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:48.698088 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" event={"ID":"030a6599-7532-45da-abd5-bd20bb515b65","Type":"ContainerDied","Data":"f7ba050b34c15e94e4df533edd76726ccbee8d5a71e03adf115dde398389480c"} Jun 11 14:56:55.727740 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:55.727704 2574 generic.go:356] "Generic (PLEG): container finished" podID="030a6599-7532-45da-abd5-bd20bb515b65" containerID="a5b163eae57280905d9b523010cdab97361ac23dcd1110a4ed1d2ddd569bc6f6" exitCode=0 Jun 11 14:56:55.728173 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:55.727760 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" event={"ID":"030a6599-7532-45da-abd5-bd20bb515b65","Type":"ContainerDied","Data":"a5b163eae57280905d9b523010cdab97361ac23dcd1110a4ed1d2ddd569bc6f6"} Jun 11 14:56:56.851093 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:56.851068 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" Jun 11 14:56:56.982068 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:56.981981 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/030a6599-7532-45da-abd5-bd20bb515b65-bundle\") pod \"030a6599-7532-45da-abd5-bd20bb515b65\" (UID: \"030a6599-7532-45da-abd5-bd20bb515b65\") " Jun 11 14:56:56.982068 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:56.982056 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/030a6599-7532-45da-abd5-bd20bb515b65-util\") pod \"030a6599-7532-45da-abd5-bd20bb515b65\" (UID: \"030a6599-7532-45da-abd5-bd20bb515b65\") " Jun 11 14:56:56.982253 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:56.982099 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqpzf\" (UniqueName: \"kubernetes.io/projected/030a6599-7532-45da-abd5-bd20bb515b65-kube-api-access-kqpzf\") pod \"030a6599-7532-45da-abd5-bd20bb515b65\" (UID: \"030a6599-7532-45da-abd5-bd20bb515b65\") " Jun 11 14:56:56.982621 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:56.982594 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/030a6599-7532-45da-abd5-bd20bb515b65-bundle" (OuterVolumeSpecName: "bundle") pod "030a6599-7532-45da-abd5-bd20bb515b65" (UID: "030a6599-7532-45da-abd5-bd20bb515b65"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:56:56.984310 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:56.984285 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/030a6599-7532-45da-abd5-bd20bb515b65-kube-api-access-kqpzf" (OuterVolumeSpecName: "kube-api-access-kqpzf") pod "030a6599-7532-45da-abd5-bd20bb515b65" (UID: "030a6599-7532-45da-abd5-bd20bb515b65"). InnerVolumeSpecName "kube-api-access-kqpzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:56:56.986444 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:56.986418 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/030a6599-7532-45da-abd5-bd20bb515b65-util" (OuterVolumeSpecName: "util") pod "030a6599-7532-45da-abd5-bd20bb515b65" (UID: "030a6599-7532-45da-abd5-bd20bb515b65"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:56:57.082754 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:57.082716 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/030a6599-7532-45da-abd5-bd20bb515b65-util\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:56:57.082754 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:57.082748 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqpzf\" (UniqueName: \"kubernetes.io/projected/030a6599-7532-45da-abd5-bd20bb515b65-kube-api-access-kqpzf\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:56:57.082754 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:57.082758 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/030a6599-7532-45da-abd5-bd20bb515b65-bundle\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:56:57.736466 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:57.736438 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" Jun 11 14:56:57.736636 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:57.736439 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzxk8r" event={"ID":"030a6599-7532-45da-abd5-bd20bb515b65","Type":"ContainerDied","Data":"8b88be815cd3c0940d2704c0fc56f1c47edec458026b397aa28cb40e848aac3a"} Jun 11 14:56:57.736636 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:56:57.736554 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b88be815cd3c0940d2704c0fc56f1c47edec458026b397aa28cb40e848aac3a" Jun 11 14:57:06.009691 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.009657 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2crs8"] Jun 11 14:57:06.010206 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.009907 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="030a6599-7532-45da-abd5-bd20bb515b65" containerName="util" Jun 11 14:57:06.010206 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.009917 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="030a6599-7532-45da-abd5-bd20bb515b65" containerName="util" Jun 11 14:57:06.010206 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.009926 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="030a6599-7532-45da-abd5-bd20bb515b65" containerName="pull" Jun 11 14:57:06.010206 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.009933 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="030a6599-7532-45da-abd5-bd20bb515b65" containerName="pull" Jun 11 14:57:06.010206 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.009952 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="030a6599-7532-45da-abd5-bd20bb515b65" containerName="extract" Jun 11 14:57:06.010206 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.009958 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="030a6599-7532-45da-abd5-bd20bb515b65" containerName="extract" Jun 11 14:57:06.010206 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.009996 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="030a6599-7532-45da-abd5-bd20bb515b65" containerName="extract" Jun 11 14:57:06.012228 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.012211 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2crs8" Jun 11 14:57:06.015490 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.015470 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ddjqz\"" Jun 11 14:57:06.015618 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.015514 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 14:57:06.015832 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.015815 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:57:06.036260 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.036235 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2crs8"] Jun 11 14:57:06.046284 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.046263 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f47f716a-9ae4-44d3-8efd-50fb68b44923-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2crs8\" (UID: \"f47f716a-9ae4-44d3-8efd-50fb68b44923\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2crs8" Jun 11 14:57:06.046387 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.046315 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5kjg\" (UniqueName: \"kubernetes.io/projected/f47f716a-9ae4-44d3-8efd-50fb68b44923-kube-api-access-q5kjg\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2crs8\" (UID: \"f47f716a-9ae4-44d3-8efd-50fb68b44923\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2crs8" Jun 11 14:57:06.147285 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.147248 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5kjg\" (UniqueName: \"kubernetes.io/projected/f47f716a-9ae4-44d3-8efd-50fb68b44923-kube-api-access-q5kjg\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2crs8\" (UID: \"f47f716a-9ae4-44d3-8efd-50fb68b44923\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2crs8" Jun 11 14:57:06.147450 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.147292 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f47f716a-9ae4-44d3-8efd-50fb68b44923-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2crs8\" (UID: \"f47f716a-9ae4-44d3-8efd-50fb68b44923\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2crs8" Jun 11 14:57:06.147635 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.147620 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f47f716a-9ae4-44d3-8efd-50fb68b44923-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2crs8\" (UID: \"f47f716a-9ae4-44d3-8efd-50fb68b44923\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2crs8" Jun 11 14:57:06.158656 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.158635 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5kjg\" (UniqueName: \"kubernetes.io/projected/f47f716a-9ae4-44d3-8efd-50fb68b44923-kube-api-access-q5kjg\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2crs8\" (UID: \"f47f716a-9ae4-44d3-8efd-50fb68b44923\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2crs8" Jun 11 14:57:06.321435 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.321358 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2crs8" Jun 11 14:57:06.476647 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.476624 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2crs8"] Jun 11 14:57:06.479468 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:57:06.479438 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47f716a_9ae4_44d3_8efd_50fb68b44923.slice/crio-bc27be93d60a6127e22f929b3c97ed8c4d9462d9d1efa1e0a38fc26c3c33b5b0 WatchSource:0}: Error finding container bc27be93d60a6127e22f929b3c97ed8c4d9462d9d1efa1e0a38fc26c3c33b5b0: Status 404 returned error can't find the container with id bc27be93d60a6127e22f929b3c97ed8c4d9462d9d1efa1e0a38fc26c3c33b5b0 Jun 11 14:57:06.769787 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:06.769749 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2crs8" event={"ID":"f47f716a-9ae4-44d3-8efd-50fb68b44923","Type":"ContainerStarted","Data":"bc27be93d60a6127e22f929b3c97ed8c4d9462d9d1efa1e0a38fc26c3c33b5b0"} Jun 11 14:57:08.786929 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:08.786869 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2crs8" event={"ID":"f47f716a-9ae4-44d3-8efd-50fb68b44923","Type":"ContainerStarted","Data":"b8a3e4476e736b02e9247d1f225f238b52eee7da1621a9be7500b30a451036f1"} Jun 11 14:57:08.819222 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:08.819171 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2crs8" podStartSLOduration=2.047587299 podStartE2EDuration="3.819155603s" totalImagesPullingTime="1.771568304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:57:08.81789377 +0000 UTC m=+408.076145161" watchObservedRunningTime="2026-06-11 14:57:08.819155603 +0000 UTC m=+408.077406994" Jun 11 14:57:10.014803 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.014766 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m"] Jun 11 14:57:10.018300 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.018277 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" Jun 11 14:57:10.022198 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.022176 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gb8nl\"" Jun 11 14:57:10.022198 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.022189 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:57:10.023325 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.023295 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:57:10.037056 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.037036 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m"] Jun 11 14:57:10.074505 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.074472 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k764\" (UniqueName: \"kubernetes.io/projected/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-kube-api-access-8k764\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m\" (UID: \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" Jun 11 14:57:10.074649 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.074515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m\" (UID: \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" Jun 11 14:57:10.074649 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.074586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m\" (UID: \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" Jun 11 14:57:10.175555 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.175522 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k764\" (UniqueName: \"kubernetes.io/projected/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-kube-api-access-8k764\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m\" (UID: \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" Jun 11 14:57:10.175688 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.175567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m\" (UID: \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" Jun 11 14:57:10.175688 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.175610 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m\" (UID: \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" Jun 11 14:57:10.175969 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.175954 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m\" (UID: \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" Jun 11 14:57:10.176034 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.175986 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m\" (UID: \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" Jun 11 14:57:10.189372 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.189343 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k764\" (UniqueName: \"kubernetes.io/projected/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-kube-api-access-8k764\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m\" (UID: \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" Jun 11 14:57:10.327234 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.327154 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" Jun 11 14:57:10.474726 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.474698 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m"] Jun 11 14:57:10.478018 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:57:10.477974 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5bc77c_51ad_4e6b_b78c_df19a11d0b7d.slice/crio-42b10439c1ac70be249c2579a010a9b8e70c2e64c2166dbb5f86987d54cbf942 WatchSource:0}: Error finding container 42b10439c1ac70be249c2579a010a9b8e70c2e64c2166dbb5f86987d54cbf942: Status 404 returned error can't find the container with id 42b10439c1ac70be249c2579a010a9b8e70c2e64c2166dbb5f86987d54cbf942 Jun 11 14:57:10.795751 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.795715 2574 generic.go:356] "Generic (PLEG): container finished" podID="7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d" containerID="ef34ab7c88172d6b8cd8aafc7ba253aea1a3a7decbe2bc88eda9e33620e80169" exitCode=0 Jun 11 14:57:10.795916 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.795767 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" event={"ID":"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d","Type":"ContainerDied","Data":"ef34ab7c88172d6b8cd8aafc7ba253aea1a3a7decbe2bc88eda9e33620e80169"} Jun 11 14:57:10.795916 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:10.795815 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" event={"ID":"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d","Type":"ContainerStarted","Data":"42b10439c1ac70be249c2579a010a9b8e70c2e64c2166dbb5f86987d54cbf942"} Jun 11 14:57:13.812331 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:13.812297 2574 generic.go:356] "Generic (PLEG): container finished" podID="7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d" containerID="09cadcd80beb364d824c5e5436cb05d841a773a78e99eb2634d225cbd857aa7a" exitCode=0 Jun 11 14:57:13.812732 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:13.812392 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" event={"ID":"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d","Type":"ContainerDied","Data":"09cadcd80beb364d824c5e5436cb05d841a773a78e99eb2634d225cbd857aa7a"} Jun 11 14:57:14.818677 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:14.818644 2574 generic.go:356] "Generic (PLEG): container finished" podID="7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d" containerID="3374c9d738a7694cb6bd1ed36ab1dcfc92e28196f912a3de8fb784255459139b" exitCode=0 Jun 11 14:57:14.819074 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:14.818727 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" event={"ID":"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d","Type":"ContainerDied","Data":"3374c9d738a7694cb6bd1ed36ab1dcfc92e28196f912a3de8fb784255459139b"} Jun 11 14:57:15.950321 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:15.950297 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" Jun 11 14:57:16.018589 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.018557 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-bundle\") pod \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\" (UID: \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\") " Jun 11 14:57:16.018737 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.018600 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-util\") pod \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\" (UID: \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\") " Jun 11 14:57:16.018737 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.018628 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k764\" (UniqueName: \"kubernetes.io/projected/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-kube-api-access-8k764\") pod \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\" (UID: \"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d\") " Jun 11 14:57:16.018955 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.018917 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-bundle" (OuterVolumeSpecName: "bundle") pod "7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d" (UID: "7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:57:16.020676 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.020657 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-kube-api-access-8k764" (OuterVolumeSpecName: "kube-api-access-8k764") pod "7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d" (UID: "7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d"). InnerVolumeSpecName "kube-api-access-8k764". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:57:16.023101 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.023064 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-util" (OuterVolumeSpecName: "util") pod "7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d" (UID: "7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:57:16.119938 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.119851 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-util\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:57:16.119938 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.119888 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k764\" (UniqueName: \"kubernetes.io/projected/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-kube-api-access-8k764\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:57:16.119938 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.119900 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d-bundle\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:57:16.581270 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.581236 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr"] Jun 11 14:57:16.581545 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.581529 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d" containerName="util" Jun 11 14:57:16.581588 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.581547 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d" containerName="util" Jun 11 14:57:16.581588 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.581555 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d" containerName="extract" Jun 11 14:57:16.581588 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.581561 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d" containerName="extract" Jun 11 14:57:16.581588 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.581572 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d" containerName="pull" Jun 11 14:57:16.581588 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.581580 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d" containerName="pull" Jun 11 14:57:16.581771 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.581639 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d" containerName="extract" Jun 11 14:57:16.585825 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.585805 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr" Jun 11 14:57:16.588724 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.588701 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 14:57:16.589947 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.589932 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zb4m7\"" Jun 11 14:57:16.590067 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.589934 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 14:57:16.594859 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.594838 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr"] Jun 11 14:57:16.624064 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.624040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d80b5566-13b8-4cba-acb0-4d0bbd8e6ef7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-cmqbr\" (UID: \"d80b5566-13b8-4cba-acb0-4d0bbd8e6ef7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr" Jun 11 14:57:16.624195 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.624092 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9zbv\" (UniqueName: \"kubernetes.io/projected/d80b5566-13b8-4cba-acb0-4d0bbd8e6ef7-kube-api-access-n9zbv\") pod \"cert-manager-webhook-7dc76cbb94-cmqbr\" (UID: \"d80b5566-13b8-4cba-acb0-4d0bbd8e6ef7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr" Jun 11 14:57:16.725370 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.725340 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d80b5566-13b8-4cba-acb0-4d0bbd8e6ef7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-cmqbr\" (UID: \"d80b5566-13b8-4cba-acb0-4d0bbd8e6ef7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr" Jun 11 14:57:16.725533 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.725397 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9zbv\" (UniqueName: \"kubernetes.io/projected/d80b5566-13b8-4cba-acb0-4d0bbd8e6ef7-kube-api-access-n9zbv\") pod \"cert-manager-webhook-7dc76cbb94-cmqbr\" (UID: \"d80b5566-13b8-4cba-acb0-4d0bbd8e6ef7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr" Jun 11 14:57:16.733486 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.733457 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d80b5566-13b8-4cba-acb0-4d0bbd8e6ef7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-cmqbr\" (UID: \"d80b5566-13b8-4cba-acb0-4d0bbd8e6ef7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr" Jun 11 14:57:16.733634 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.733615 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9zbv\" (UniqueName: \"kubernetes.io/projected/d80b5566-13b8-4cba-acb0-4d0bbd8e6ef7-kube-api-access-n9zbv\") pod \"cert-manager-webhook-7dc76cbb94-cmqbr\" (UID: \"d80b5566-13b8-4cba-acb0-4d0bbd8e6ef7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr" Jun 11 14:57:16.829247 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.829210 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" event={"ID":"7f5bc77c-51ad-4e6b-b78c-df19a11d0b7d","Type":"ContainerDied","Data":"42b10439c1ac70be249c2579a010a9b8e70c2e64c2166dbb5f86987d54cbf942"} Jun 11 14:57:16.829397 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.829259 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9k4m" Jun 11 14:57:16.829397 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.829265 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42b10439c1ac70be249c2579a010a9b8e70c2e64c2166dbb5f86987d54cbf942" Jun 11 14:57:16.895100 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:16.895068 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr" Jun 11 14:57:17.021212 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:17.021188 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr"] Jun 11 14:57:17.025476 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:57:17.025433 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd80b5566_13b8_4cba_acb0_4d0bbd8e6ef7.slice/crio-966c2d450f11f8fdfd328473b1ea8970fb6a2721e44b715b5a2a743ff57cfbe8 WatchSource:0}: Error finding container 966c2d450f11f8fdfd328473b1ea8970fb6a2721e44b715b5a2a743ff57cfbe8: Status 404 returned error can't find the container with id 966c2d450f11f8fdfd328473b1ea8970fb6a2721e44b715b5a2a743ff57cfbe8 Jun 11 14:57:17.834899 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:17.834860 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr" event={"ID":"d80b5566-13b8-4cba-acb0-4d0bbd8e6ef7","Type":"ContainerStarted","Data":"966c2d450f11f8fdfd328473b1ea8970fb6a2721e44b715b5a2a743ff57cfbe8"} Jun 11 14:57:19.845399 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:19.845369 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr" event={"ID":"d80b5566-13b8-4cba-acb0-4d0bbd8e6ef7","Type":"ContainerStarted","Data":"a02a3fd528d32d71d76243de57fbfa75e996ce536974f964824a5bc60669f686"} Jun 11 14:57:19.845735 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:19.845463 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr" Jun 11 14:57:19.867421 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:19.867370 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr" podStartSLOduration=1.142227627 podStartE2EDuration="3.867356136s" totalImagesPullingTime="2.725128509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:57:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:57:19.866147078 +0000 UTC m=+419.124398469" watchObservedRunningTime="2026-06-11 14:57:19.867356136 +0000 UTC m=+419.125607526" Jun 11 14:57:25.851778 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:25.851746 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cmqbr" Jun 11 14:57:29.699895 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.699859 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6"] Jun 11 14:57:29.722485 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.722454 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6"] Jun 11 14:57:29.722612 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.722536 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" Jun 11 14:57:29.725843 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.725818 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gb8nl\"" Jun 11 14:57:29.726037 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.725818 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:57:29.726037 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.725818 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:57:29.827400 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.827366 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2265b415-1404-47c5-875a-72a560c2cc1e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6\" (UID: \"2265b415-1404-47c5-875a-72a560c2cc1e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" Jun 11 14:57:29.827400 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.827401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59dn4\" (UniqueName: \"kubernetes.io/projected/2265b415-1404-47c5-875a-72a560c2cc1e-kube-api-access-59dn4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6\" (UID: \"2265b415-1404-47c5-875a-72a560c2cc1e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" Jun 11 14:57:29.827615 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.827426 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2265b415-1404-47c5-875a-72a560c2cc1e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6\" (UID: \"2265b415-1404-47c5-875a-72a560c2cc1e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" Jun 11 14:57:29.927855 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.927820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2265b415-1404-47c5-875a-72a560c2cc1e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6\" (UID: \"2265b415-1404-47c5-875a-72a560c2cc1e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" Jun 11 14:57:29.927990 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.927927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2265b415-1404-47c5-875a-72a560c2cc1e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6\" (UID: \"2265b415-1404-47c5-875a-72a560c2cc1e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" Jun 11 14:57:29.928071 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.928001 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59dn4\" (UniqueName: \"kubernetes.io/projected/2265b415-1404-47c5-875a-72a560c2cc1e-kube-api-access-59dn4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6\" (UID: \"2265b415-1404-47c5-875a-72a560c2cc1e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" Jun 11 14:57:29.928261 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.928242 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2265b415-1404-47c5-875a-72a560c2cc1e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6\" (UID: \"2265b415-1404-47c5-875a-72a560c2cc1e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" Jun 11 14:57:29.928343 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.928290 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2265b415-1404-47c5-875a-72a560c2cc1e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6\" (UID: \"2265b415-1404-47c5-875a-72a560c2cc1e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" Jun 11 14:57:29.940344 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:29.940314 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59dn4\" (UniqueName: \"kubernetes.io/projected/2265b415-1404-47c5-875a-72a560c2cc1e-kube-api-access-59dn4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6\" (UID: \"2265b415-1404-47c5-875a-72a560c2cc1e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" Jun 11 14:57:30.031667 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:30.031580 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" Jun 11 14:57:30.179550 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:30.179455 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6"] Jun 11 14:57:30.182146 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:57:30.182118 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2265b415_1404_47c5_875a_72a560c2cc1e.slice/crio-1275764558d4869f63a22592608b9afe3ac709e8b79a0c6226be939b9f6ca0bb WatchSource:0}: Error finding container 1275764558d4869f63a22592608b9afe3ac709e8b79a0c6226be939b9f6ca0bb: Status 404 returned error can't find the container with id 1275764558d4869f63a22592608b9afe3ac709e8b79a0c6226be939b9f6ca0bb Jun 11 14:57:30.890450 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:30.890411 2574 generic.go:356] "Generic (PLEG): container finished" podID="2265b415-1404-47c5-875a-72a560c2cc1e" containerID="13f1fef54dd6b37cde8cd6abedce8bfd8603fbf0b9d0a00e49a977b6c8b568f2" exitCode=0 Jun 11 14:57:30.890821 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:30.890482 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" event={"ID":"2265b415-1404-47c5-875a-72a560c2cc1e","Type":"ContainerDied","Data":"13f1fef54dd6b37cde8cd6abedce8bfd8603fbf0b9d0a00e49a977b6c8b568f2"} Jun 11 14:57:30.890821 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:30.890563 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" event={"ID":"2265b415-1404-47c5-875a-72a560c2cc1e","Type":"ContainerStarted","Data":"1275764558d4869f63a22592608b9afe3ac709e8b79a0c6226be939b9f6ca0bb"} Jun 11 14:57:31.897805 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:31.897719 2574 generic.go:356] "Generic (PLEG): container finished" podID="2265b415-1404-47c5-875a-72a560c2cc1e" containerID="f1081d86d023e3dced8d82f4a0d4cfbfbc9dd325ce8c21c6ea762b9e41bc5644" exitCode=0 Jun 11 14:57:31.897805 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:31.897756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" event={"ID":"2265b415-1404-47c5-875a-72a560c2cc1e","Type":"ContainerDied","Data":"f1081d86d023e3dced8d82f4a0d4cfbfbc9dd325ce8c21c6ea762b9e41bc5644"} Jun 11 14:57:32.904728 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:32.904685 2574 generic.go:356] "Generic (PLEG): container finished" podID="2265b415-1404-47c5-875a-72a560c2cc1e" containerID="6a47b78449ffe569487d6bec4d776ef308800a5639655023cd70450bc3a9342d" exitCode=0 Jun 11 14:57:32.905184 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:32.904769 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" event={"ID":"2265b415-1404-47c5-875a-72a560c2cc1e","Type":"ContainerDied","Data":"6a47b78449ffe569487d6bec4d776ef308800a5639655023cd70450bc3a9342d"} Jun 11 14:57:34.033019 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:34.032973 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" Jun 11 14:57:34.161469 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:34.161391 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59dn4\" (UniqueName: \"kubernetes.io/projected/2265b415-1404-47c5-875a-72a560c2cc1e-kube-api-access-59dn4\") pod \"2265b415-1404-47c5-875a-72a560c2cc1e\" (UID: \"2265b415-1404-47c5-875a-72a560c2cc1e\") " Jun 11 14:57:34.161469 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:34.161428 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2265b415-1404-47c5-875a-72a560c2cc1e-util\") pod \"2265b415-1404-47c5-875a-72a560c2cc1e\" (UID: \"2265b415-1404-47c5-875a-72a560c2cc1e\") " Jun 11 14:57:34.161469 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:34.161469 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2265b415-1404-47c5-875a-72a560c2cc1e-bundle\") pod \"2265b415-1404-47c5-875a-72a560c2cc1e\" (UID: \"2265b415-1404-47c5-875a-72a560c2cc1e\") " Jun 11 14:57:34.162216 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:34.162187 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2265b415-1404-47c5-875a-72a560c2cc1e-bundle" (OuterVolumeSpecName: "bundle") pod "2265b415-1404-47c5-875a-72a560c2cc1e" (UID: "2265b415-1404-47c5-875a-72a560c2cc1e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:57:34.163439 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:34.163412 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2265b415-1404-47c5-875a-72a560c2cc1e-kube-api-access-59dn4" (OuterVolumeSpecName: "kube-api-access-59dn4") pod "2265b415-1404-47c5-875a-72a560c2cc1e" (UID: "2265b415-1404-47c5-875a-72a560c2cc1e"). InnerVolumeSpecName "kube-api-access-59dn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:57:34.169686 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:34.169658 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2265b415-1404-47c5-875a-72a560c2cc1e-util" (OuterVolumeSpecName: "util") pod "2265b415-1404-47c5-875a-72a560c2cc1e" (UID: "2265b415-1404-47c5-875a-72a560c2cc1e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:57:34.262062 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:34.262000 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59dn4\" (UniqueName: \"kubernetes.io/projected/2265b415-1404-47c5-875a-72a560c2cc1e-kube-api-access-59dn4\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:57:34.262062 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:34.262057 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2265b415-1404-47c5-875a-72a560c2cc1e-util\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:57:34.262062 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:34.262068 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2265b415-1404-47c5-875a-72a560c2cc1e-bundle\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:57:34.914974 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:34.914940 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" event={"ID":"2265b415-1404-47c5-875a-72a560c2cc1e","Type":"ContainerDied","Data":"1275764558d4869f63a22592608b9afe3ac709e8b79a0c6226be939b9f6ca0bb"} Jun 11 14:57:34.914974 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:34.914992 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf7jj6" Jun 11 14:57:34.915225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:34.915026 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1275764558d4869f63a22592608b9afe3ac709e8b79a0c6226be939b9f6ca0bb" Jun 11 14:57:46.483964 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.483879 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf"] Jun 11 14:57:46.484407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.484227 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2265b415-1404-47c5-875a-72a560c2cc1e" containerName="util" Jun 11 14:57:46.484407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.484241 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2265b415-1404-47c5-875a-72a560c2cc1e" containerName="util" Jun 11 14:57:46.484407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.484256 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2265b415-1404-47c5-875a-72a560c2cc1e" containerName="pull" Jun 11 14:57:46.484407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.484263 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2265b415-1404-47c5-875a-72a560c2cc1e" containerName="pull" Jun 11 14:57:46.484407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.484269 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2265b415-1404-47c5-875a-72a560c2cc1e" containerName="extract" Jun 11 14:57:46.484407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.484274 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2265b415-1404-47c5-875a-72a560c2cc1e" containerName="extract" Jun 11 14:57:46.484407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.484316 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2265b415-1404-47c5-875a-72a560c2cc1e" containerName="extract" Jun 11 14:57:46.488474 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.488456 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.496680 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.496647 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 14:57:46.496680 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.496657 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 14:57:46.497420 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.497401 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 14:57:46.497531 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.497402 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cmgps\"" Jun 11 14:57:46.497755 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.497740 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 14:57:46.514723 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.514699 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf"] Jun 11 14:57:46.563634 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.563602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63daf9d7-8f0e-4182-acdd-9089813e3e58-webhook-cert\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.563788 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.563642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dc8c\" (UniqueName: \"kubernetes.io/projected/63daf9d7-8f0e-4182-acdd-9089813e3e58-kube-api-access-7dc8c\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.563788 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.563667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63daf9d7-8f0e-4182-acdd-9089813e3e58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.563788 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.563713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63daf9d7-8f0e-4182-acdd-9089813e3e58-tmp\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.563788 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.563774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63daf9d7-8f0e-4182-acdd-9089813e3e58-manifests\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.664981 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.664929 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63daf9d7-8f0e-4182-acdd-9089813e3e58-manifests\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.665213 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.664992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63daf9d7-8f0e-4182-acdd-9089813e3e58-webhook-cert\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.665213 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.665048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dc8c\" (UniqueName: \"kubernetes.io/projected/63daf9d7-8f0e-4182-acdd-9089813e3e58-kube-api-access-7dc8c\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.665213 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.665170 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63daf9d7-8f0e-4182-acdd-9089813e3e58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.665363 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.665214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63daf9d7-8f0e-4182-acdd-9089813e3e58-tmp\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.665363 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.665348 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63daf9d7-8f0e-4182-acdd-9089813e3e58-manifests\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.667453 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.667424 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63daf9d7-8f0e-4182-acdd-9089813e3e58-tmp\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.667654 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.667637 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63daf9d7-8f0e-4182-acdd-9089813e3e58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.667696 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.667659 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63daf9d7-8f0e-4182-acdd-9089813e3e58-webhook-cert\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.678373 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.678349 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dc8c\" (UniqueName: \"kubernetes.io/projected/63daf9d7-8f0e-4182-acdd-9089813e3e58-kube-api-access-7dc8c\") pod \"opendatahub-operator-controller-manager-58897f8c7f-m54rf\" (UID: \"63daf9d7-8f0e-4182-acdd-9089813e3e58\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.798018 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.797914 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:46.951183 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.951139 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf"] Jun 11 14:57:46.956884 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:57:46.956855 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63daf9d7_8f0e_4182_acdd_9089813e3e58.slice/crio-00e300e6a0b4b745c09191dcecbf54eda4ac3bf1cf422ce6f5f4ec212bd9b48b WatchSource:0}: Error finding container 00e300e6a0b4b745c09191dcecbf54eda4ac3bf1cf422ce6f5f4ec212bd9b48b: Status 404 returned error can't find the container with id 00e300e6a0b4b745c09191dcecbf54eda4ac3bf1cf422ce6f5f4ec212bd9b48b Jun 11 14:57:46.973081 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:46.973047 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" event={"ID":"63daf9d7-8f0e-4182-acdd-9089813e3e58","Type":"ContainerStarted","Data":"00e300e6a0b4b745c09191dcecbf54eda4ac3bf1cf422ce6f5f4ec212bd9b48b"} Jun 11 14:57:50.995485 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:50.995444 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" event={"ID":"63daf9d7-8f0e-4182-acdd-9089813e3e58","Type":"ContainerStarted","Data":"af8ac7408ebd32aa313c372c7e6ea945a71ac443a9105fc537591a9367d27cc9"} Jun 11 14:57:52.001784 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:52.001741 2574 generic.go:356] "Generic (PLEG): container finished" podID="63daf9d7-8f0e-4182-acdd-9089813e3e58" containerID="af8ac7408ebd32aa313c372c7e6ea945a71ac443a9105fc537591a9367d27cc9" exitCode=0 Jun 11 14:57:52.002297 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:52.001825 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" event={"ID":"63daf9d7-8f0e-4182-acdd-9089813e3e58","Type":"ContainerDied","Data":"af8ac7408ebd32aa313c372c7e6ea945a71ac443a9105fc537591a9367d27cc9"} Jun 11 14:57:53.012692 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:53.012652 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" event={"ID":"63daf9d7-8f0e-4182-acdd-9089813e3e58","Type":"ContainerStarted","Data":"402f2cf7652b7c15d5d79972b621197d55fa019664f91515fe43cf17757293b2"} Jun 11 14:57:53.013081 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:53.012802 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:57:53.038921 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:57:53.038862 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" podStartSLOduration=2.669581236 podStartE2EDuration="7.038845407s" totalImagesPullingTime="3.428177199s" totalInitContainerRuntime="941.086972ms" isStatefulPod=false podCreationTimestamp="2026-06-11 14:57:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:57:53.036625944 +0000 UTC m=+452.294877325" watchObservedRunningTime="2026-06-11 14:57:53.038845407 +0000 UTC m=+452.297096802" Jun 11 14:58:04.019671 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:04.019636 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-m54rf" Jun 11 14:58:06.543175 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.543140 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5"] Jun 11 14:58:06.551402 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.551384 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5" Jun 11 14:58:06.556797 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.556771 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 14:58:06.557671 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.557573 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 14:58:06.558210 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.558191 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7b5vr\"" Jun 11 14:58:06.558310 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.558244 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 14:58:06.558310 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.558262 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 14:58:06.573397 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.573376 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5"] Jun 11 14:58:06.624399 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.624367 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9brw\" (UniqueName: \"kubernetes.io/projected/7e200669-911a-4727-99ba-d0428def4e7f-kube-api-access-h9brw\") pod \"kube-auth-proxy-bb8d84687-vb9r5\" (UID: \"7e200669-911a-4727-99ba-d0428def4e7f\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5" Jun 11 14:58:06.624543 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.624420 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e200669-911a-4727-99ba-d0428def4e7f-tmp\") pod \"kube-auth-proxy-bb8d84687-vb9r5\" (UID: \"7e200669-911a-4727-99ba-d0428def4e7f\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5" Jun 11 14:58:06.624543 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.624459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e200669-911a-4727-99ba-d0428def4e7f-tls-certs\") pod \"kube-auth-proxy-bb8d84687-vb9r5\" (UID: \"7e200669-911a-4727-99ba-d0428def4e7f\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5" Jun 11 14:58:06.725247 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.725214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e200669-911a-4727-99ba-d0428def4e7f-tmp\") pod \"kube-auth-proxy-bb8d84687-vb9r5\" (UID: \"7e200669-911a-4727-99ba-d0428def4e7f\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5" Jun 11 14:58:06.725402 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.725273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e200669-911a-4727-99ba-d0428def4e7f-tls-certs\") pod \"kube-auth-proxy-bb8d84687-vb9r5\" (UID: \"7e200669-911a-4727-99ba-d0428def4e7f\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5" Jun 11 14:58:06.725402 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.725300 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9brw\" (UniqueName: \"kubernetes.io/projected/7e200669-911a-4727-99ba-d0428def4e7f-kube-api-access-h9brw\") pod \"kube-auth-proxy-bb8d84687-vb9r5\" (UID: \"7e200669-911a-4727-99ba-d0428def4e7f\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5" Jun 11 14:58:06.727644 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.727613 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e200669-911a-4727-99ba-d0428def4e7f-tmp\") pod \"kube-auth-proxy-bb8d84687-vb9r5\" (UID: \"7e200669-911a-4727-99ba-d0428def4e7f\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5" Jun 11 14:58:06.727775 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.727703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e200669-911a-4727-99ba-d0428def4e7f-tls-certs\") pod \"kube-auth-proxy-bb8d84687-vb9r5\" (UID: \"7e200669-911a-4727-99ba-d0428def4e7f\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5" Jun 11 14:58:06.743323 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.743300 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9brw\" (UniqueName: \"kubernetes.io/projected/7e200669-911a-4727-99ba-d0428def4e7f-kube-api-access-h9brw\") pod \"kube-auth-proxy-bb8d84687-vb9r5\" (UID: \"7e200669-911a-4727-99ba-d0428def4e7f\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5" Jun 11 14:58:06.860600 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.860518 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5" Jun 11 14:58:06.991222 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:06.991051 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5"] Jun 11 14:58:06.993802 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:58:06.993777 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e200669_911a_4727_99ba_d0428def4e7f.slice/crio-f0b6a2eed2402f376d38814e97e2133fec478bdabb762dfa45d72535f949a658 WatchSource:0}: Error finding container f0b6a2eed2402f376d38814e97e2133fec478bdabb762dfa45d72535f949a658: Status 404 returned error can't find the container with id f0b6a2eed2402f376d38814e97e2133fec478bdabb762dfa45d72535f949a658 Jun 11 14:58:07.073374 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:07.073332 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5" event={"ID":"7e200669-911a-4727-99ba-d0428def4e7f","Type":"ContainerStarted","Data":"f0b6a2eed2402f376d38814e97e2133fec478bdabb762dfa45d72535f949a658"} Jun 11 14:58:07.477088 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:07.477057 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-xzb8h"] Jun 11 14:58:07.481589 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:07.481572 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-xzb8h" Jun 11 14:58:07.486335 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:07.486315 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 14:58:07.486473 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:07.486346 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-btx46\"" Jun 11 14:58:07.495997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:07.495975 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-xzb8h"] Jun 11 14:58:07.530932 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:07.530903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s88k6\" (UniqueName: \"kubernetes.io/projected/3ef8c9bb-489a-446a-aa09-7a82646bb137-kube-api-access-s88k6\") pod \"model-serving-api-5dd488fc48-xzb8h\" (UID: \"3ef8c9bb-489a-446a-aa09-7a82646bb137\") " pod="opendatahub/model-serving-api-5dd488fc48-xzb8h" Jun 11 14:58:07.531099 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:07.530960 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ef8c9bb-489a-446a-aa09-7a82646bb137-tls-certs\") pod \"model-serving-api-5dd488fc48-xzb8h\" (UID: \"3ef8c9bb-489a-446a-aa09-7a82646bb137\") " pod="opendatahub/model-serving-api-5dd488fc48-xzb8h" Jun 11 14:58:07.632238 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:07.632206 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s88k6\" (UniqueName: \"kubernetes.io/projected/3ef8c9bb-489a-446a-aa09-7a82646bb137-kube-api-access-s88k6\") pod \"model-serving-api-5dd488fc48-xzb8h\" (UID: \"3ef8c9bb-489a-446a-aa09-7a82646bb137\") " pod="opendatahub/model-serving-api-5dd488fc48-xzb8h" Jun 11 14:58:07.632625 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:07.632268 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ef8c9bb-489a-446a-aa09-7a82646bb137-tls-certs\") pod \"model-serving-api-5dd488fc48-xzb8h\" (UID: \"3ef8c9bb-489a-446a-aa09-7a82646bb137\") " pod="opendatahub/model-serving-api-5dd488fc48-xzb8h" Jun 11 14:58:07.634636 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:07.634616 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ef8c9bb-489a-446a-aa09-7a82646bb137-tls-certs\") pod \"model-serving-api-5dd488fc48-xzb8h\" (UID: \"3ef8c9bb-489a-446a-aa09-7a82646bb137\") " pod="opendatahub/model-serving-api-5dd488fc48-xzb8h" Jun 11 14:58:07.641687 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:07.641664 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s88k6\" (UniqueName: \"kubernetes.io/projected/3ef8c9bb-489a-446a-aa09-7a82646bb137-kube-api-access-s88k6\") pod \"model-serving-api-5dd488fc48-xzb8h\" (UID: \"3ef8c9bb-489a-446a-aa09-7a82646bb137\") " pod="opendatahub/model-serving-api-5dd488fc48-xzb8h" Jun 11 14:58:07.792456 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:07.792331 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-xzb8h" Jun 11 14:58:07.944795 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:07.944770 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-xzb8h"] Jun 11 14:58:07.947118 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:58:07.947089 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef8c9bb_489a_446a_aa09_7a82646bb137.slice/crio-7b4708ef54af47578f3f280c257f1cd328429dfaaa38df631a7ce43251af7861 WatchSource:0}: Error finding container 7b4708ef54af47578f3f280c257f1cd328429dfaaa38df631a7ce43251af7861: Status 404 returned error can't find the container with id 7b4708ef54af47578f3f280c257f1cd328429dfaaa38df631a7ce43251af7861 Jun 11 14:58:08.080330 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:08.080244 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-xzb8h" event={"ID":"3ef8c9bb-489a-446a-aa09-7a82646bb137","Type":"ContainerStarted","Data":"7b4708ef54af47578f3f280c257f1cd328429dfaaa38df631a7ce43251af7861"} Jun 11 14:58:10.092408 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:10.092373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-xzb8h" event={"ID":"3ef8c9bb-489a-446a-aa09-7a82646bb137","Type":"ContainerStarted","Data":"25e57a199fdef6b2b954e2bb2fb47f877b88322e810c08f4166ead9b6cdcb44c"} Jun 11 14:58:10.092844 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:10.092469 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-xzb8h" Jun 11 14:58:10.113301 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:10.113253 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-xzb8h" podStartSLOduration=1.415875155 podStartE2EDuration="3.113236394s" totalImagesPullingTime="1.697361239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:58:10.110545665 +0000 UTC m=+469.368797057" watchObservedRunningTime="2026-06-11 14:58:10.113236394 +0000 UTC m=+469.371487824" Jun 11 14:58:11.099065 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:11.099022 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5" event={"ID":"7e200669-911a-4727-99ba-d0428def4e7f","Type":"ContainerStarted","Data":"425e0e8cdcf5201389625b8fdc520f2e993cfcf15ca30c93ef28e2e5cb944507"} Jun 11 14:58:11.117900 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:11.117850 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-bb8d84687-vb9r5" podStartSLOduration=1.764507651 podStartE2EDuration="5.117833155s" totalImagesPullingTime="3.353325504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:58:11.116589528 +0000 UTC m=+470.374840935" watchObservedRunningTime="2026-06-11 14:58:11.117833155 +0000 UTC m=+470.376084546" Jun 11 14:58:16.721592 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.721563 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-8hct7"] Jun 11 14:58:16.724704 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.724686 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-8hct7" Jun 11 14:58:16.731567 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.731544 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm"] Jun 11 14:58:16.732361 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.732340 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 14:58:16.732575 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.732560 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dt472\"" Jun 11 14:58:16.734663 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.734646 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm" Jun 11 14:58:16.737322 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.737306 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7v7hl\"" Jun 11 14:58:16.737939 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.737926 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 14:58:16.800978 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.800942 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rsnr\" (UniqueName: \"kubernetes.io/projected/113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d-kube-api-access-2rsnr\") pod \"kserve-controller-manager-69fc866d76-8hct7\" (UID: \"113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8hct7" Jun 11 14:58:16.801151 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.801035 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b40a52f-90a6-4ddf-a537-257e361515a8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4kvvm\" (UID: \"9b40a52f-90a6-4ddf-a537-257e361515a8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm" Jun 11 14:58:16.801151 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.801103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn2w7\" (UniqueName: \"kubernetes.io/projected/9b40a52f-90a6-4ddf-a537-257e361515a8-kube-api-access-wn2w7\") pod \"llmisvc-controller-manager-864bfd7bc9-4kvvm\" (UID: \"9b40a52f-90a6-4ddf-a537-257e361515a8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm" Jun 11 14:58:16.801240 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.801167 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d-cert\") pod \"kserve-controller-manager-69fc866d76-8hct7\" (UID: \"113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8hct7" Jun 11 14:58:16.802891 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.802869 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-8hct7"] Jun 11 14:58:16.833238 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.833208 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm"] Jun 11 14:58:16.902521 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.902485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rsnr\" (UniqueName: \"kubernetes.io/projected/113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d-kube-api-access-2rsnr\") pod \"kserve-controller-manager-69fc866d76-8hct7\" (UID: \"113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8hct7" Jun 11 14:58:16.902521 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.902526 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b40a52f-90a6-4ddf-a537-257e361515a8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4kvvm\" (UID: \"9b40a52f-90a6-4ddf-a537-257e361515a8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm" Jun 11 14:58:16.902738 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.902553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn2w7\" (UniqueName: \"kubernetes.io/projected/9b40a52f-90a6-4ddf-a537-257e361515a8-kube-api-access-wn2w7\") pod \"llmisvc-controller-manager-864bfd7bc9-4kvvm\" (UID: \"9b40a52f-90a6-4ddf-a537-257e361515a8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm" Jun 11 14:58:16.902738 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.902612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d-cert\") pod \"kserve-controller-manager-69fc866d76-8hct7\" (UID: \"113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8hct7" Jun 11 14:58:16.905100 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.905071 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b40a52f-90a6-4ddf-a537-257e361515a8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4kvvm\" (UID: \"9b40a52f-90a6-4ddf-a537-257e361515a8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm" Jun 11 14:58:16.905220 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.905082 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d-cert\") pod \"kserve-controller-manager-69fc866d76-8hct7\" (UID: \"113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8hct7" Jun 11 14:58:16.913881 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.913858 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn2w7\" (UniqueName: \"kubernetes.io/projected/9b40a52f-90a6-4ddf-a537-257e361515a8-kube-api-access-wn2w7\") pod \"llmisvc-controller-manager-864bfd7bc9-4kvvm\" (UID: \"9b40a52f-90a6-4ddf-a537-257e361515a8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm" Jun 11 14:58:16.915959 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:16.915937 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rsnr\" (UniqueName: \"kubernetes.io/projected/113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d-kube-api-access-2rsnr\") pod \"kserve-controller-manager-69fc866d76-8hct7\" (UID: \"113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8hct7" Jun 11 14:58:17.035078 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.034972 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-8hct7" Jun 11 14:58:17.042663 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.042639 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm" Jun 11 14:58:17.065826 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.065794 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v"] Jun 11 14:58:17.069228 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.069204 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" Jun 11 14:58:17.072216 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.072182 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gb8nl\"" Jun 11 14:58:17.072355 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.072275 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:58:17.072594 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.072579 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:58:17.087923 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.087860 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v"] Jun 11 14:58:17.104997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.104952 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c24a5216-ccd3-49f0-91c1-5413998715d8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v\" (UID: \"c24a5216-ccd3-49f0-91c1-5413998715d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" Jun 11 14:58:17.104997 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.105046 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c24a5216-ccd3-49f0-91c1-5413998715d8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v\" (UID: \"c24a5216-ccd3-49f0-91c1-5413998715d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" Jun 11 14:58:17.105265 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.105186 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqzch\" (UniqueName: \"kubernetes.io/projected/c24a5216-ccd3-49f0-91c1-5413998715d8-kube-api-access-gqzch\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v\" (UID: \"c24a5216-ccd3-49f0-91c1-5413998715d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" Jun 11 14:58:17.189531 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.189501 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-8hct7"] Jun 11 14:58:17.191203 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:58:17.191173 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113f4a20_6ff2_4640_b6eb_6a9d2bb78f4d.slice/crio-e108614e1808f048620459291c02b6172f81588304f19ebfaca224f4fa2b91a0 WatchSource:0}: Error finding container e108614e1808f048620459291c02b6172f81588304f19ebfaca224f4fa2b91a0: Status 404 returned error can't find the container with id e108614e1808f048620459291c02b6172f81588304f19ebfaca224f4fa2b91a0 Jun 11 14:58:17.205892 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.205867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqzch\" (UniqueName: \"kubernetes.io/projected/c24a5216-ccd3-49f0-91c1-5413998715d8-kube-api-access-gqzch\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v\" (UID: \"c24a5216-ccd3-49f0-91c1-5413998715d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" Jun 11 14:58:17.205991 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.205907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c24a5216-ccd3-49f0-91c1-5413998715d8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v\" (UID: \"c24a5216-ccd3-49f0-91c1-5413998715d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" Jun 11 14:58:17.205991 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.205935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c24a5216-ccd3-49f0-91c1-5413998715d8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v\" (UID: \"c24a5216-ccd3-49f0-91c1-5413998715d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" Jun 11 14:58:17.206236 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.206217 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c24a5216-ccd3-49f0-91c1-5413998715d8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v\" (UID: \"c24a5216-ccd3-49f0-91c1-5413998715d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" Jun 11 14:58:17.206273 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.206242 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c24a5216-ccd3-49f0-91c1-5413998715d8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v\" (UID: \"c24a5216-ccd3-49f0-91c1-5413998715d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" Jun 11 14:58:17.239504 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.239475 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqzch\" (UniqueName: \"kubernetes.io/projected/c24a5216-ccd3-49f0-91c1-5413998715d8-kube-api-access-gqzch\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v\" (UID: \"c24a5216-ccd3-49f0-91c1-5413998715d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" Jun 11 14:58:17.249085 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:58:17.249062 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9b40a52f_90a6_4ddf_a537_257e361515a8.slice/crio-fa07c28548c45a28ce95c4d7f686fe8e1ed73755e99cad3a31b10cd2ff6bbe85 WatchSource:0}: Error finding container fa07c28548c45a28ce95c4d7f686fe8e1ed73755e99cad3a31b10cd2ff6bbe85: Status 404 returned error can't find the container with id fa07c28548c45a28ce95c4d7f686fe8e1ed73755e99cad3a31b10cd2ff6bbe85 Jun 11 14:58:17.250353 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.250325 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm"] Jun 11 14:58:17.379201 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.379113 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" Jun 11 14:58:17.512032 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:17.511980 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v"] Jun 11 14:58:17.515159 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:58:17.515136 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc24a5216_ccd3_49f0_91c1_5413998715d8.slice/crio-7285a090d19d8b6e7163e9ad4ec54742a31b09d275f317b2eb829f67641585f3 WatchSource:0}: Error finding container 7285a090d19d8b6e7163e9ad4ec54742a31b09d275f317b2eb829f67641585f3: Status 404 returned error can't find the container with id 7285a090d19d8b6e7163e9ad4ec54742a31b09d275f317b2eb829f67641585f3 Jun 11 14:58:18.136771 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:18.136175 2574 generic.go:356] "Generic (PLEG): container finished" podID="c24a5216-ccd3-49f0-91c1-5413998715d8" containerID="e3c1c24fc1a13f37d84fcab5e06b26227a83e614488c8d2b985aefbcb1b32fb4" exitCode=0 Jun 11 14:58:18.136771 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:18.136453 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" event={"ID":"c24a5216-ccd3-49f0-91c1-5413998715d8","Type":"ContainerDied","Data":"e3c1c24fc1a13f37d84fcab5e06b26227a83e614488c8d2b985aefbcb1b32fb4"} Jun 11 14:58:18.136771 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:18.136519 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" event={"ID":"c24a5216-ccd3-49f0-91c1-5413998715d8","Type":"ContainerStarted","Data":"7285a090d19d8b6e7163e9ad4ec54742a31b09d275f317b2eb829f67641585f3"} Jun 11 14:58:18.138926 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:18.138898 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm" event={"ID":"9b40a52f-90a6-4ddf-a537-257e361515a8","Type":"ContainerStarted","Data":"fa07c28548c45a28ce95c4d7f686fe8e1ed73755e99cad3a31b10cd2ff6bbe85"} Jun 11 14:58:18.140202 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:18.140171 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-8hct7" event={"ID":"113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d","Type":"ContainerStarted","Data":"e108614e1808f048620459291c02b6172f81588304f19ebfaca224f4fa2b91a0"} Jun 11 14:58:19.151195 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:19.151089 2574 generic.go:356] "Generic (PLEG): container finished" podID="c24a5216-ccd3-49f0-91c1-5413998715d8" containerID="65820cefc5b98b9e2956145dbddedb3325351e796ce6eaa83c672fcae39d500f" exitCode=0 Jun 11 14:58:19.151640 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:19.151192 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" event={"ID":"c24a5216-ccd3-49f0-91c1-5413998715d8","Type":"ContainerDied","Data":"65820cefc5b98b9e2956145dbddedb3325351e796ce6eaa83c672fcae39d500f"} Jun 11 14:58:20.159809 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:20.159779 2574 generic.go:356] "Generic (PLEG): container finished" podID="c24a5216-ccd3-49f0-91c1-5413998715d8" containerID="b6b570403c82d9c1a11553c9f671cbe2ccde84c5b5c20cc057b5d94e1e6cdde4" exitCode=0 Jun 11 14:58:20.160218 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:20.159866 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" event={"ID":"c24a5216-ccd3-49f0-91c1-5413998715d8","Type":"ContainerDied","Data":"b6b570403c82d9c1a11553c9f671cbe2ccde84c5b5c20cc057b5d94e1e6cdde4"} Jun 11 14:58:21.103325 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.103299 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-xzb8h" Jun 11 14:58:21.165630 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.165594 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-8hct7" event={"ID":"113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d","Type":"ContainerStarted","Data":"485025ff68dce6bf8109699f7b6bdf663df975fcf8c2ed8987c50116253585bf"} Jun 11 14:58:21.166066 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.165736 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-8hct7" Jun 11 14:58:21.167148 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.167124 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm" event={"ID":"9b40a52f-90a6-4ddf-a537-257e361515a8","Type":"ContainerStarted","Data":"e100375620e6f5b5053e6e4f2d9282a0324e6ee08fff8f235d27bbed6f55aa52"} Jun 11 14:58:21.167276 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.167262 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm" Jun 11 14:58:21.185112 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.185060 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-8hct7" podStartSLOduration=1.9360527589999998 podStartE2EDuration="5.185043583s" totalImagesPullingTime="3.248990824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:58:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:58:21.183384205 +0000 UTC m=+480.441635597" watchObservedRunningTime="2026-06-11 14:58:21.185043583 +0000 UTC m=+480.443294976" Jun 11 14:58:21.216835 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.216781 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm" podStartSLOduration=2.021414187 podStartE2EDuration="5.216765549s" totalImagesPullingTime="3.195351362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:58:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:58:21.215081165 +0000 UTC m=+480.473332560" watchObservedRunningTime="2026-06-11 14:58:21.216765549 +0000 UTC m=+480.475016976" Jun 11 14:58:21.298800 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.298767 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" Jun 11 14:58:21.343512 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.343480 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c24a5216-ccd3-49f0-91c1-5413998715d8-util\") pod \"c24a5216-ccd3-49f0-91c1-5413998715d8\" (UID: \"c24a5216-ccd3-49f0-91c1-5413998715d8\") " Jun 11 14:58:21.343512 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.343512 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqzch\" (UniqueName: \"kubernetes.io/projected/c24a5216-ccd3-49f0-91c1-5413998715d8-kube-api-access-gqzch\") pod \"c24a5216-ccd3-49f0-91c1-5413998715d8\" (UID: \"c24a5216-ccd3-49f0-91c1-5413998715d8\") " Jun 11 14:58:21.343696 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.343546 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c24a5216-ccd3-49f0-91c1-5413998715d8-bundle\") pod \"c24a5216-ccd3-49f0-91c1-5413998715d8\" (UID: \"c24a5216-ccd3-49f0-91c1-5413998715d8\") " Jun 11 14:58:21.344426 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.344405 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c24a5216-ccd3-49f0-91c1-5413998715d8-bundle" (OuterVolumeSpecName: "bundle") pod "c24a5216-ccd3-49f0-91c1-5413998715d8" (UID: "c24a5216-ccd3-49f0-91c1-5413998715d8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:58:21.345579 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.345557 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c24a5216-ccd3-49f0-91c1-5413998715d8-kube-api-access-gqzch" (OuterVolumeSpecName: "kube-api-access-gqzch") pod "c24a5216-ccd3-49f0-91c1-5413998715d8" (UID: "c24a5216-ccd3-49f0-91c1-5413998715d8"). InnerVolumeSpecName "kube-api-access-gqzch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:58:21.348635 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.348616 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c24a5216-ccd3-49f0-91c1-5413998715d8-util" (OuterVolumeSpecName: "util") pod "c24a5216-ccd3-49f0-91c1-5413998715d8" (UID: "c24a5216-ccd3-49f0-91c1-5413998715d8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:58:21.444330 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.444298 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c24a5216-ccd3-49f0-91c1-5413998715d8-util\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:58:21.444330 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.444324 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqzch\" (UniqueName: \"kubernetes.io/projected/c24a5216-ccd3-49f0-91c1-5413998715d8-kube-api-access-gqzch\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:58:21.444330 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:21.444334 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c24a5216-ccd3-49f0-91c1-5413998715d8-bundle\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:58:22.173249 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:22.173218 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" Jun 11 14:58:22.173249 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:22.173241 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh28v" event={"ID":"c24a5216-ccd3-49f0-91c1-5413998715d8","Type":"ContainerDied","Data":"7285a090d19d8b6e7163e9ad4ec54742a31b09d275f317b2eb829f67641585f3"} Jun 11 14:58:22.173645 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:22.173285 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7285a090d19d8b6e7163e9ad4ec54742a31b09d275f317b2eb829f67641585f3" Jun 11 14:58:27.203891 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.203858 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2"] Jun 11 14:58:27.204372 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.204166 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c24a5216-ccd3-49f0-91c1-5413998715d8" containerName="util" Jun 11 14:58:27.204372 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.204178 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24a5216-ccd3-49f0-91c1-5413998715d8" containerName="util" Jun 11 14:58:27.204372 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.204194 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c24a5216-ccd3-49f0-91c1-5413998715d8" containerName="extract" Jun 11 14:58:27.204372 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.204200 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24a5216-ccd3-49f0-91c1-5413998715d8" containerName="extract" Jun 11 14:58:27.204372 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.204208 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c24a5216-ccd3-49f0-91c1-5413998715d8" containerName="pull" Jun 11 14:58:27.204372 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.204213 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24a5216-ccd3-49f0-91c1-5413998715d8" containerName="pull" Jun 11 14:58:27.204372 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.204260 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c24a5216-ccd3-49f0-91c1-5413998715d8" containerName="extract" Jun 11 14:58:27.210049 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.210028 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" Jun 11 14:58:27.213121 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.213100 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:58:27.213224 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.213145 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gb8nl\"" Jun 11 14:58:27.214442 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.214422 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:58:27.229600 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.229576 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2"] Jun 11 14:58:27.292061 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.292000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hfvc\" (UniqueName: \"kubernetes.io/projected/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-kube-api-access-6hfvc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2\" (UID: \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" Jun 11 14:58:27.292245 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.292085 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2\" (UID: \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" Jun 11 14:58:27.292245 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.292136 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2\" (UID: \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" Jun 11 14:58:27.393242 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.393203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2\" (UID: \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" Jun 11 14:58:27.393417 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.393262 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2\" (UID: \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" Jun 11 14:58:27.393417 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.393317 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hfvc\" (UniqueName: \"kubernetes.io/projected/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-kube-api-access-6hfvc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2\" (UID: \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" Jun 11 14:58:27.393591 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.393571 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2\" (UID: \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" Jun 11 14:58:27.393656 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.393605 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2\" (UID: \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" Jun 11 14:58:27.404549 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.404520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hfvc\" (UniqueName: \"kubernetes.io/projected/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-kube-api-access-6hfvc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2\" (UID: \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" Jun 11 14:58:27.519177 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.519100 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" Jun 11 14:58:27.698293 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:27.698263 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2"] Jun 11 14:58:27.700636 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:58:27.700611 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97f6291_2fb8_4ebf_ac0a_b3d509afb5c5.slice/crio-cfc7d9274b54dbcde9eb55dec11bdbcc1c6706aedcd21fdead9c974e03d083f4 WatchSource:0}: Error finding container cfc7d9274b54dbcde9eb55dec11bdbcc1c6706aedcd21fdead9c974e03d083f4: Status 404 returned error can't find the container with id cfc7d9274b54dbcde9eb55dec11bdbcc1c6706aedcd21fdead9c974e03d083f4 Jun 11 14:58:28.198735 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:28.198703 2574 generic.go:356] "Generic (PLEG): container finished" podID="d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5" containerID="32d9827686e70d5a90ac50cee5f412e8ea8c6d434c18ddd9860f28628de5cadf" exitCode=0 Jun 11 14:58:28.198915 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:28.198786 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" event={"ID":"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5","Type":"ContainerDied","Data":"32d9827686e70d5a90ac50cee5f412e8ea8c6d434c18ddd9860f28628de5cadf"} Jun 11 14:58:28.198915 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:28.198830 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" event={"ID":"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5","Type":"ContainerStarted","Data":"cfc7d9274b54dbcde9eb55dec11bdbcc1c6706aedcd21fdead9c974e03d083f4"} Jun 11 14:58:29.266654 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:29.266624 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r"] Jun 11 14:58:29.269644 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:29.269627 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r" Jun 11 14:58:29.274852 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:29.274832 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 14:58:29.275142 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:29.275124 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-pvqc4\"" Jun 11 14:58:29.275463 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:29.275445 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 14:58:29.307334 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:29.307314 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/407a8502-b261-45a1-8472-72845e937f17-operator-config\") pod \"servicemesh-operator3-57f65f65fb-9nt6r\" (UID: \"407a8502-b261-45a1-8472-72845e937f17\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r" Jun 11 14:58:29.307422 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:29.307346 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkvsg\" (UniqueName: \"kubernetes.io/projected/407a8502-b261-45a1-8472-72845e937f17-kube-api-access-mkvsg\") pod \"servicemesh-operator3-57f65f65fb-9nt6r\" (UID: \"407a8502-b261-45a1-8472-72845e937f17\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r" Jun 11 14:58:29.359752 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:29.359563 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r"] Jun 11 14:58:29.407967 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:29.407938 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/407a8502-b261-45a1-8472-72845e937f17-operator-config\") pod \"servicemesh-operator3-57f65f65fb-9nt6r\" (UID: \"407a8502-b261-45a1-8472-72845e937f17\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r" Jun 11 14:58:29.408114 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:29.407982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkvsg\" (UniqueName: \"kubernetes.io/projected/407a8502-b261-45a1-8472-72845e937f17-kube-api-access-mkvsg\") pod \"servicemesh-operator3-57f65f65fb-9nt6r\" (UID: \"407a8502-b261-45a1-8472-72845e937f17\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r" Jun 11 14:58:29.410614 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:29.410588 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/407a8502-b261-45a1-8472-72845e937f17-operator-config\") pod \"servicemesh-operator3-57f65f65fb-9nt6r\" (UID: \"407a8502-b261-45a1-8472-72845e937f17\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r" Jun 11 14:58:29.421621 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:29.421598 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkvsg\" (UniqueName: \"kubernetes.io/projected/407a8502-b261-45a1-8472-72845e937f17-kube-api-access-mkvsg\") pod \"servicemesh-operator3-57f65f65fb-9nt6r\" (UID: \"407a8502-b261-45a1-8472-72845e937f17\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r" Jun 11 14:58:29.579344 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:29.579251 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r" Jun 11 14:58:29.725370 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:29.725347 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r"] Jun 11 14:58:29.728187 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:58:29.728161 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod407a8502_b261_45a1_8472_72845e937f17.slice/crio-5bf20eba4eb7051d1a4a29ada27c2cd1a51fa62bfb064b9a437a8d9a9d9ae35a WatchSource:0}: Error finding container 5bf20eba4eb7051d1a4a29ada27c2cd1a51fa62bfb064b9a437a8d9a9d9ae35a: Status 404 returned error can't find the container with id 5bf20eba4eb7051d1a4a29ada27c2cd1a51fa62bfb064b9a437a8d9a9d9ae35a Jun 11 14:58:30.214655 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:30.214620 2574 generic.go:356] "Generic (PLEG): container finished" podID="d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5" containerID="b9fa860742dcfbaa6e0c51e9fce4c6e223bed3c67e43b330431f5f996d46bb00" exitCode=0 Jun 11 14:58:30.214848 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:30.214695 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" event={"ID":"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5","Type":"ContainerDied","Data":"b9fa860742dcfbaa6e0c51e9fce4c6e223bed3c67e43b330431f5f996d46bb00"} Jun 11 14:58:30.216569 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:30.216543 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r" event={"ID":"407a8502-b261-45a1-8472-72845e937f17","Type":"ContainerStarted","Data":"5bf20eba4eb7051d1a4a29ada27c2cd1a51fa62bfb064b9a437a8d9a9d9ae35a"} Jun 11 14:58:31.226618 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:31.226554 2574 generic.go:356] "Generic (PLEG): container finished" podID="d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5" containerID="8857762f042f992f2f4259b29a1ac389c4b8136d858606d2af188222603ffaa1" exitCode=0 Jun 11 14:58:31.226618 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:31.226594 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" event={"ID":"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5","Type":"ContainerDied","Data":"8857762f042f992f2f4259b29a1ac389c4b8136d858606d2af188222603ffaa1"} Jun 11 14:58:32.857079 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:32.857051 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" Jun 11 14:58:32.939359 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:32.939338 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-bundle\") pod \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\" (UID: \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\") " Jun 11 14:58:32.939489 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:32.939444 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-util\") pod \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\" (UID: \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\") " Jun 11 14:58:32.939615 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:32.939520 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hfvc\" (UniqueName: \"kubernetes.io/projected/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-kube-api-access-6hfvc\") pod \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\" (UID: \"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5\") " Jun 11 14:58:32.940353 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:32.940328 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-bundle" (OuterVolumeSpecName: "bundle") pod "d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5" (UID: "d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:58:32.941625 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:32.941575 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-kube-api-access-6hfvc" (OuterVolumeSpecName: "kube-api-access-6hfvc") pod "d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5" (UID: "d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5"). InnerVolumeSpecName "kube-api-access-6hfvc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:58:32.945327 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:32.945306 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-util" (OuterVolumeSpecName: "util") pod "d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5" (UID: "d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:58:33.040676 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:33.040641 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-util\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:58:33.040676 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:33.040677 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hfvc\" (UniqueName: \"kubernetes.io/projected/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-kube-api-access-6hfvc\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:58:33.040866 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:33.040695 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5-bundle\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:58:33.238969 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:33.238915 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" Jun 11 14:58:33.239179 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:33.238905 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ax5dc2" event={"ID":"d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5","Type":"ContainerDied","Data":"cfc7d9274b54dbcde9eb55dec11bdbcc1c6706aedcd21fdead9c974e03d083f4"} Jun 11 14:58:33.239179 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:33.239070 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfc7d9274b54dbcde9eb55dec11bdbcc1c6706aedcd21fdead9c974e03d083f4" Jun 11 14:58:33.241366 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:33.241336 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r" event={"ID":"407a8502-b261-45a1-8472-72845e937f17","Type":"ContainerStarted","Data":"546c0c37ab8e9165029e5b106c0b5d3cb04d6d0ceac8fe660c935e582cc85040"} Jun 11 14:58:33.241555 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:33.241535 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r" Jun 11 14:58:33.269892 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:33.269811 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r" podStartSLOduration=1.100237037 podStartE2EDuration="4.269793703s" totalImagesPullingTime="3.169556666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:58:33.268210245 +0000 UTC m=+492.526461634" watchObservedRunningTime="2026-06-11 14:58:33.269793703 +0000 UTC m=+492.528045094" Jun 11 14:58:36.802208 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.802176 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-79f6976fb4-mp297"] Jun 11 14:58:36.802567 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.802485 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5" containerName="util" Jun 11 14:58:36.802567 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.802535 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5" containerName="util" Jun 11 14:58:36.802567 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.802545 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5" containerName="extract" Jun 11 14:58:36.802567 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.802554 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5" containerName="extract" Jun 11 14:58:36.802744 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.802571 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5" containerName="pull" Jun 11 14:58:36.802744 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.802578 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5" containerName="pull" Jun 11 14:58:36.802744 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.802666 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d97f6291-2fb8-4ebf-ac0a-b3d509afb5c5" containerName="extract" Jun 11 14:58:36.805748 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.805731 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-79f6976fb4-mp297" Jun 11 14:58:36.815641 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.815621 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xr46r\"" Jun 11 14:58:36.815891 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.815873 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 14:58:36.827760 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.827734 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-79f6976fb4-mp297"] Jun 11 14:58:36.873562 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.873530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dng55\" (UniqueName: \"kubernetes.io/projected/4ec0e07e-ff92-4211-9081-a1fad41c417e-kube-api-access-dng55\") pod \"dashboard-redirect-79f6976fb4-mp297\" (UID: \"4ec0e07e-ff92-4211-9081-a1fad41c417e\") " pod="opendatahub/dashboard-redirect-79f6976fb4-mp297" Jun 11 14:58:36.873708 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.873598 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4ec0e07e-ff92-4211-9081-a1fad41c417e-redirect-config\") pod \"dashboard-redirect-79f6976fb4-mp297\" (UID: \"4ec0e07e-ff92-4211-9081-a1fad41c417e\") " pod="opendatahub/dashboard-redirect-79f6976fb4-mp297" Jun 11 14:58:36.974516 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.974483 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4ec0e07e-ff92-4211-9081-a1fad41c417e-redirect-config\") pod \"dashboard-redirect-79f6976fb4-mp297\" (UID: \"4ec0e07e-ff92-4211-9081-a1fad41c417e\") " pod="opendatahub/dashboard-redirect-79f6976fb4-mp297" Jun 11 14:58:36.974707 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.974538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dng55\" (UniqueName: \"kubernetes.io/projected/4ec0e07e-ff92-4211-9081-a1fad41c417e-kube-api-access-dng55\") pod \"dashboard-redirect-79f6976fb4-mp297\" (UID: \"4ec0e07e-ff92-4211-9081-a1fad41c417e\") " pod="opendatahub/dashboard-redirect-79f6976fb4-mp297" Jun 11 14:58:36.975280 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.975255 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4ec0e07e-ff92-4211-9081-a1fad41c417e-redirect-config\") pod \"dashboard-redirect-79f6976fb4-mp297\" (UID: \"4ec0e07e-ff92-4211-9081-a1fad41c417e\") " pod="opendatahub/dashboard-redirect-79f6976fb4-mp297" Jun 11 14:58:36.984089 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:36.984068 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dng55\" (UniqueName: \"kubernetes.io/projected/4ec0e07e-ff92-4211-9081-a1fad41c417e-kube-api-access-dng55\") pod \"dashboard-redirect-79f6976fb4-mp297\" (UID: \"4ec0e07e-ff92-4211-9081-a1fad41c417e\") " pod="opendatahub/dashboard-redirect-79f6976fb4-mp297" Jun 11 14:58:37.115532 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:37.115432 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-79f6976fb4-mp297" Jun 11 14:58:37.246783 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:37.246760 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-79f6976fb4-mp297"] Jun 11 14:58:37.248709 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:58:37.248678 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec0e07e_ff92_4211_9081_a1fad41c417e.slice/crio-7d880da4172fcb8fde278c9cce9a0818af86a1562ccefd3e3e93c9dc00f1731f WatchSource:0}: Error finding container 7d880da4172fcb8fde278c9cce9a0818af86a1562ccefd3e3e93c9dc00f1731f: Status 404 returned error can't find the container with id 7d880da4172fcb8fde278c9cce9a0818af86a1562ccefd3e3e93c9dc00f1731f Jun 11 14:58:37.260351 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:37.260329 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-79f6976fb4-mp297" event={"ID":"4ec0e07e-ff92-4211-9081-a1fad41c417e","Type":"ContainerStarted","Data":"7d880da4172fcb8fde278c9cce9a0818af86a1562ccefd3e3e93c9dc00f1731f"} Jun 11 14:58:42.292018 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:42.291967 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-79f6976fb4-mp297" event={"ID":"4ec0e07e-ff92-4211-9081-a1fad41c417e","Type":"ContainerStarted","Data":"d13c7807e493a96bf5a2c3d488ce2c97edba031dcf235589852634dfb21f09de"} Jun 11 14:58:42.326345 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:42.326297 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-79f6976fb4-mp297" podStartSLOduration=1.6831140690000002 podStartE2EDuration="6.326282861s" totalImagesPullingTime="4.643168792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:58:42.317248845 +0000 UTC m=+501.575500246" watchObservedRunningTime="2026-06-11 14:58:42.326282861 +0000 UTC m=+501.584534252" Jun 11 14:58:44.247527 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:44.247497 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9nt6r" Jun 11 14:58:48.894786 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.894751 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28"] Jun 11 14:58:48.898328 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.898308 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:48.901268 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.901241 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 14:58:48.901392 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.901249 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 14:58:48.901392 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.901252 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 14:58:48.901392 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.901350 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-swklj\"" Jun 11 14:58:48.901602 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.901568 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 14:58:48.910225 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.910204 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28"] Jun 11 14:58:48.973177 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.973142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a473d25-5523-4d11-ac80-ec861a6c9eb9-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:48.973177 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.973181 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jcjq\" (UniqueName: \"kubernetes.io/projected/8a473d25-5523-4d11-ac80-ec861a6c9eb9-kube-api-access-9jcjq\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:48.973362 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.973201 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8a473d25-5523-4d11-ac80-ec861a6c9eb9-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:48.973362 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.973281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a473d25-5523-4d11-ac80-ec861a6c9eb9-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:48.973362 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.973326 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a473d25-5523-4d11-ac80-ec861a6c9eb9-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:48.973362 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.973344 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8a473d25-5523-4d11-ac80-ec861a6c9eb9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:48.973489 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:48.973369 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8a473d25-5523-4d11-ac80-ec861a6c9eb9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.074802 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.074765 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a473d25-5523-4d11-ac80-ec861a6c9eb9-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.074802 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.074801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8a473d25-5523-4d11-ac80-ec861a6c9eb9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.075074 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.074833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8a473d25-5523-4d11-ac80-ec861a6c9eb9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.075074 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.074876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a473d25-5523-4d11-ac80-ec861a6c9eb9-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.075074 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.074903 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jcjq\" (UniqueName: \"kubernetes.io/projected/8a473d25-5523-4d11-ac80-ec861a6c9eb9-kube-api-access-9jcjq\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.075074 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.074932 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8a473d25-5523-4d11-ac80-ec861a6c9eb9-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.075074 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.074977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a473d25-5523-4d11-ac80-ec861a6c9eb9-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.075602 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.075573 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8a473d25-5523-4d11-ac80-ec861a6c9eb9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.077243 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.077214 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a473d25-5523-4d11-ac80-ec861a6c9eb9-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.077469 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.077441 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a473d25-5523-4d11-ac80-ec861a6c9eb9-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.077707 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.077689 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8a473d25-5523-4d11-ac80-ec861a6c9eb9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.077789 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.077767 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8a473d25-5523-4d11-ac80-ec861a6c9eb9-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.083215 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.083186 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a473d25-5523-4d11-ac80-ec861a6c9eb9-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.083796 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.083775 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jcjq\" (UniqueName: \"kubernetes.io/projected/8a473d25-5523-4d11-ac80-ec861a6c9eb9-kube-api-access-9jcjq\") pod \"istiod-openshift-gateway-75c67f8887-rng28\" (UID: \"8a473d25-5523-4d11-ac80-ec861a6c9eb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.207734 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.207704 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:49.349224 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:49.349201 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28"] Jun 11 14:58:49.351516 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:58:49.351487 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a473d25_5523_4d11_ac80_ec861a6c9eb9.slice/crio-bc138cae281a4a93dd271595b9ec8e3b64dcbda225dd446a9ec035d4df5de9db WatchSource:0}: Error finding container bc138cae281a4a93dd271595b9ec8e3b64dcbda225dd446a9ec035d4df5de9db: Status 404 returned error can't find the container with id bc138cae281a4a93dd271595b9ec8e3b64dcbda225dd446a9ec035d4df5de9db Jun 11 14:58:50.334201 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:50.334159 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" event={"ID":"8a473d25-5523-4d11-ac80-ec861a6c9eb9","Type":"ContainerStarted","Data":"bc138cae281a4a93dd271595b9ec8e3b64dcbda225dd446a9ec035d4df5de9db"} Jun 11 14:58:52.036247 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:52.036209 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 11 14:58:52.036495 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:52.036294 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 11 14:58:52.175223 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:52.175192 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4kvvm" Jun 11 14:58:52.178583 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:52.178559 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-8hct7" Jun 11 14:58:52.345054 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:52.344945 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" event={"ID":"8a473d25-5523-4d11-ac80-ec861a6c9eb9","Type":"ContainerStarted","Data":"cb9089bbd7a4ce6b958510bbe6a09519e6bb7a7937016e57e1fc621af29892d3"} Jun 11 14:58:52.345054 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:52.345042 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:58:52.369915 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:52.369865 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" podStartSLOduration=1.6873588370000001 podStartE2EDuration="4.369848744s" totalImagesPullingTime="2.682489907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:58:52.367541887 +0000 UTC m=+511.625793289" watchObservedRunningTime="2026-06-11 14:58:52.369848744 +0000 UTC m=+511.628100135" Jun 11 14:58:53.353555 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:58:53.353522 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rng28" Jun 11 14:59:24.577047 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.576943 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6"] Jun 11 14:59:24.596287 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.596258 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" Jun 11 14:59:24.597284 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.597258 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6"] Jun 11 14:59:24.608602 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.608580 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 14:59:24.608713 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.608637 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4wlqd\"" Jun 11 14:59:24.609867 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.609849 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 14:59:24.669548 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.669518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b15ba50f-eee7-460f-87cc-2d7319ed0968-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6\" (UID: \"b15ba50f-eee7-460f-87cc-2d7319ed0968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" Jun 11 14:59:24.669548 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.669552 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg6fr\" (UniqueName: \"kubernetes.io/projected/b15ba50f-eee7-460f-87cc-2d7319ed0968-kube-api-access-rg6fr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6\" (UID: \"b15ba50f-eee7-460f-87cc-2d7319ed0968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" Jun 11 14:59:24.669775 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.669592 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b15ba50f-eee7-460f-87cc-2d7319ed0968-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6\" (UID: \"b15ba50f-eee7-460f-87cc-2d7319ed0968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" Jun 11 14:59:24.770848 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.770806 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b15ba50f-eee7-460f-87cc-2d7319ed0968-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6\" (UID: \"b15ba50f-eee7-460f-87cc-2d7319ed0968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" Jun 11 14:59:24.771069 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.770911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b15ba50f-eee7-460f-87cc-2d7319ed0968-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6\" (UID: \"b15ba50f-eee7-460f-87cc-2d7319ed0968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" Jun 11 14:59:24.771069 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.770939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg6fr\" (UniqueName: \"kubernetes.io/projected/b15ba50f-eee7-460f-87cc-2d7319ed0968-kube-api-access-rg6fr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6\" (UID: \"b15ba50f-eee7-460f-87cc-2d7319ed0968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" Jun 11 14:59:24.771250 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.771230 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b15ba50f-eee7-460f-87cc-2d7319ed0968-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6\" (UID: \"b15ba50f-eee7-460f-87cc-2d7319ed0968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" Jun 11 14:59:24.771308 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.771259 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b15ba50f-eee7-460f-87cc-2d7319ed0968-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6\" (UID: \"b15ba50f-eee7-460f-87cc-2d7319ed0968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" Jun 11 14:59:24.786124 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.786090 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg6fr\" (UniqueName: \"kubernetes.io/projected/b15ba50f-eee7-460f-87cc-2d7319ed0968-kube-api-access-rg6fr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6\" (UID: \"b15ba50f-eee7-460f-87cc-2d7319ed0968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" Jun 11 14:59:24.906078 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:24.905977 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" Jun 11 14:59:25.055385 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.055355 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6"] Jun 11 14:59:25.057907 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:59:25.057870 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15ba50f_eee7_460f_87cc_2d7319ed0968.slice/crio-406ea4f73444155e632e7c833ec7293385e6392814fe2bb9f306f045c906f071 WatchSource:0}: Error finding container 406ea4f73444155e632e7c833ec7293385e6392814fe2bb9f306f045c906f071: Status 404 returned error can't find the container with id 406ea4f73444155e632e7c833ec7293385e6392814fe2bb9f306f045c906f071 Jun 11 14:59:25.209536 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.209509 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns"] Jun 11 14:59:25.212822 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.212807 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" Jun 11 14:59:25.244816 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.244786 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns"] Jun 11 14:59:25.275945 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.275909 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4wtm\" (UniqueName: \"kubernetes.io/projected/fda62c81-58b8-4723-8bb8-e85ebfd34395-kube-api-access-j4wtm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns\" (UID: \"fda62c81-58b8-4723-8bb8-e85ebfd34395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" Jun 11 14:59:25.276131 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.275955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fda62c81-58b8-4723-8bb8-e85ebfd34395-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns\" (UID: \"fda62c81-58b8-4723-8bb8-e85ebfd34395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" Jun 11 14:59:25.276131 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.276046 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fda62c81-58b8-4723-8bb8-e85ebfd34395-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns\" (UID: \"fda62c81-58b8-4723-8bb8-e85ebfd34395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" Jun 11 14:59:25.376930 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.376892 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fda62c81-58b8-4723-8bb8-e85ebfd34395-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns\" (UID: \"fda62c81-58b8-4723-8bb8-e85ebfd34395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" Jun 11 14:59:25.377090 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.376943 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fda62c81-58b8-4723-8bb8-e85ebfd34395-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns\" (UID: \"fda62c81-58b8-4723-8bb8-e85ebfd34395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" Jun 11 14:59:25.377090 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.376996 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4wtm\" (UniqueName: \"kubernetes.io/projected/fda62c81-58b8-4723-8bb8-e85ebfd34395-kube-api-access-j4wtm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns\" (UID: \"fda62c81-58b8-4723-8bb8-e85ebfd34395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" Jun 11 14:59:25.377407 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.377384 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fda62c81-58b8-4723-8bb8-e85ebfd34395-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns\" (UID: \"fda62c81-58b8-4723-8bb8-e85ebfd34395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" Jun 11 14:59:25.377446 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.377381 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fda62c81-58b8-4723-8bb8-e85ebfd34395-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns\" (UID: \"fda62c81-58b8-4723-8bb8-e85ebfd34395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" Jun 11 14:59:25.398901 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.398867 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4wtm\" (UniqueName: \"kubernetes.io/projected/fda62c81-58b8-4723-8bb8-e85ebfd34395-kube-api-access-j4wtm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns\" (UID: \"fda62c81-58b8-4723-8bb8-e85ebfd34395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" Jun 11 14:59:25.508816 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.508716 2574 generic.go:356] "Generic (PLEG): container finished" podID="b15ba50f-eee7-460f-87cc-2d7319ed0968" containerID="1cd45dcc4afd934e3159c0fbe1a5b1a85d16f031dd5bb3e37b51bb51a8e16c4f" exitCode=0 Jun 11 14:59:25.508816 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.508790 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" event={"ID":"b15ba50f-eee7-460f-87cc-2d7319ed0968","Type":"ContainerDied","Data":"1cd45dcc4afd934e3159c0fbe1a5b1a85d16f031dd5bb3e37b51bb51a8e16c4f"} Jun 11 14:59:25.509073 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.508854 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" event={"ID":"b15ba50f-eee7-460f-87cc-2d7319ed0968","Type":"ContainerStarted","Data":"406ea4f73444155e632e7c833ec7293385e6392814fe2bb9f306f045c906f071"} Jun 11 14:59:25.528860 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.528836 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" Jun 11 14:59:25.687421 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.687397 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns"] Jun 11 14:59:25.689737 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:59:25.689712 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda62c81_58b8_4723_8bb8_e85ebfd34395.slice/crio-801c9d4ddf043d89c288c5b1bd3733ad701604f7ca4169a5417304dc06fd85e4 WatchSource:0}: Error finding container 801c9d4ddf043d89c288c5b1bd3733ad701604f7ca4169a5417304dc06fd85e4: Status 404 returned error can't find the container with id 801c9d4ddf043d89c288c5b1bd3733ad701604f7ca4169a5417304dc06fd85e4 Jun 11 14:59:25.798748 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.798720 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc"] Jun 11 14:59:25.802159 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.802139 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" Jun 11 14:59:25.817342 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.817320 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc"] Jun 11 14:59:25.880611 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.880582 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d221dfc2-e0ec-41a8-9988-c962aad3e43a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc\" (UID: \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" Jun 11 14:59:25.880768 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.880667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl57k\" (UniqueName: \"kubernetes.io/projected/d221dfc2-e0ec-41a8-9988-c962aad3e43a-kube-api-access-bl57k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc\" (UID: \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" Jun 11 14:59:25.880768 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.880729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d221dfc2-e0ec-41a8-9988-c962aad3e43a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc\" (UID: \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" Jun 11 14:59:25.981430 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.981395 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d221dfc2-e0ec-41a8-9988-c962aad3e43a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc\" (UID: \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" Jun 11 14:59:25.981628 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.981481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl57k\" (UniqueName: \"kubernetes.io/projected/d221dfc2-e0ec-41a8-9988-c962aad3e43a-kube-api-access-bl57k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc\" (UID: \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" Jun 11 14:59:25.981628 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.981519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d221dfc2-e0ec-41a8-9988-c962aad3e43a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc\" (UID: \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" Jun 11 14:59:25.981810 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.981788 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d221dfc2-e0ec-41a8-9988-c962aad3e43a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc\" (UID: \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" Jun 11 14:59:25.981895 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.981872 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d221dfc2-e0ec-41a8-9988-c962aad3e43a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc\" (UID: \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" Jun 11 14:59:25.994724 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:25.994697 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl57k\" (UniqueName: \"kubernetes.io/projected/d221dfc2-e0ec-41a8-9988-c962aad3e43a-kube-api-access-bl57k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc\" (UID: \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" Jun 11 14:59:26.155712 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.155636 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" Jun 11 14:59:26.359269 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.359236 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf"] Jun 11 14:59:26.378921 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.378898 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" Jun 11 14:59:26.383125 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.382971 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf"] Jun 11 14:59:26.436320 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.436296 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc"] Jun 11 14:59:26.437486 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:59:26.437465 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd221dfc2_e0ec_41a8_9988_c962aad3e43a.slice/crio-49c4748591fe5fe2790ba5c4d6d1ef14b6add126179cdd4b035e6398a3be4b9a WatchSource:0}: Error finding container 49c4748591fe5fe2790ba5c4d6d1ef14b6add126179cdd4b035e6398a3be4b9a: Status 404 returned error can't find the container with id 49c4748591fe5fe2790ba5c4d6d1ef14b6add126179cdd4b035e6398a3be4b9a Jun 11 14:59:26.487052 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.486981 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56e1ab7a-c840-46e8-81d7-9f0824035a95-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf\" (UID: \"56e1ab7a-c840-46e8-81d7-9f0824035a95\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" Jun 11 14:59:26.487156 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.487066 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56e1ab7a-c840-46e8-81d7-9f0824035a95-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf\" (UID: \"56e1ab7a-c840-46e8-81d7-9f0824035a95\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" Jun 11 14:59:26.487156 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.487138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqp7c\" (UniqueName: \"kubernetes.io/projected/56e1ab7a-c840-46e8-81d7-9f0824035a95-kube-api-access-rqp7c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf\" (UID: \"56e1ab7a-c840-46e8-81d7-9f0824035a95\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" Jun 11 14:59:26.516490 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.516457 2574 generic.go:356] "Generic (PLEG): container finished" podID="b15ba50f-eee7-460f-87cc-2d7319ed0968" containerID="ee3f2dc189b19b5dfccb7a92fc1c0a3c60b2ff09986c33350f593139e004da61" exitCode=0 Jun 11 14:59:26.516674 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.516546 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" event={"ID":"b15ba50f-eee7-460f-87cc-2d7319ed0968","Type":"ContainerDied","Data":"ee3f2dc189b19b5dfccb7a92fc1c0a3c60b2ff09986c33350f593139e004da61"} Jun 11 14:59:26.517941 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.517911 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" event={"ID":"d221dfc2-e0ec-41a8-9988-c962aad3e43a","Type":"ContainerStarted","Data":"49c4748591fe5fe2790ba5c4d6d1ef14b6add126179cdd4b035e6398a3be4b9a"} Jun 11 14:59:26.519351 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.519331 2574 generic.go:356] "Generic (PLEG): container finished" podID="fda62c81-58b8-4723-8bb8-e85ebfd34395" containerID="d05366fd64a497c0b149b8d4eea4965e89a93e969956789aa8a5d133bc0a2929" exitCode=0 Jun 11 14:59:26.519440 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.519414 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" event={"ID":"fda62c81-58b8-4723-8bb8-e85ebfd34395","Type":"ContainerDied","Data":"d05366fd64a497c0b149b8d4eea4965e89a93e969956789aa8a5d133bc0a2929"} Jun 11 14:59:26.519486 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.519452 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" event={"ID":"fda62c81-58b8-4723-8bb8-e85ebfd34395","Type":"ContainerStarted","Data":"801c9d4ddf043d89c288c5b1bd3733ad701604f7ca4169a5417304dc06fd85e4"} Jun 11 14:59:26.587643 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.587611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56e1ab7a-c840-46e8-81d7-9f0824035a95-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf\" (UID: \"56e1ab7a-c840-46e8-81d7-9f0824035a95\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" Jun 11 14:59:26.587797 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.587657 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56e1ab7a-c840-46e8-81d7-9f0824035a95-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf\" (UID: \"56e1ab7a-c840-46e8-81d7-9f0824035a95\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" Jun 11 14:59:26.588038 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.587993 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56e1ab7a-c840-46e8-81d7-9f0824035a95-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf\" (UID: \"56e1ab7a-c840-46e8-81d7-9f0824035a95\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" Jun 11 14:59:26.588138 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.588110 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqp7c\" (UniqueName: \"kubernetes.io/projected/56e1ab7a-c840-46e8-81d7-9f0824035a95-kube-api-access-rqp7c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf\" (UID: \"56e1ab7a-c840-46e8-81d7-9f0824035a95\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" Jun 11 14:59:26.588191 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.588166 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56e1ab7a-c840-46e8-81d7-9f0824035a95-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf\" (UID: \"56e1ab7a-c840-46e8-81d7-9f0824035a95\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" Jun 11 14:59:26.627694 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.627665 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqp7c\" (UniqueName: \"kubernetes.io/projected/56e1ab7a-c840-46e8-81d7-9f0824035a95-kube-api-access-rqp7c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf\" (UID: \"56e1ab7a-c840-46e8-81d7-9f0824035a95\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" Jun 11 14:59:26.704549 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.704473 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" Jun 11 14:59:26.867126 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:26.867099 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf"] Jun 11 14:59:26.870266 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:59:26.870237 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e1ab7a_c840_46e8_81d7_9f0824035a95.slice/crio-55b1dba55e7fd1eca298aa3c574286f254c1e3dd19a6623d229918f08c9d062f WatchSource:0}: Error finding container 55b1dba55e7fd1eca298aa3c574286f254c1e3dd19a6623d229918f08c9d062f: Status 404 returned error can't find the container with id 55b1dba55e7fd1eca298aa3c574286f254c1e3dd19a6623d229918f08c9d062f Jun 11 14:59:27.525931 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:27.525843 2574 generic.go:356] "Generic (PLEG): container finished" podID="56e1ab7a-c840-46e8-81d7-9f0824035a95" containerID="63c465bd3a6f7a6a2dce5707889bb36f35b1ec001f8dc73f11131241196d20e7" exitCode=0 Jun 11 14:59:27.526113 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:27.525934 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" event={"ID":"56e1ab7a-c840-46e8-81d7-9f0824035a95","Type":"ContainerDied","Data":"63c465bd3a6f7a6a2dce5707889bb36f35b1ec001f8dc73f11131241196d20e7"} Jun 11 14:59:27.526113 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:27.525990 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" event={"ID":"56e1ab7a-c840-46e8-81d7-9f0824035a95","Type":"ContainerStarted","Data":"55b1dba55e7fd1eca298aa3c574286f254c1e3dd19a6623d229918f08c9d062f"} Jun 11 14:59:27.528044 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:27.528023 2574 generic.go:356] "Generic (PLEG): container finished" podID="b15ba50f-eee7-460f-87cc-2d7319ed0968" containerID="6296e75e8c31d2dc4936329a10105c380521ab1a2d4ee41d47724834d7b251ce" exitCode=0 Jun 11 14:59:27.528156 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:27.528092 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" event={"ID":"b15ba50f-eee7-460f-87cc-2d7319ed0968","Type":"ContainerDied","Data":"6296e75e8c31d2dc4936329a10105c380521ab1a2d4ee41d47724834d7b251ce"} Jun 11 14:59:27.529517 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:27.529500 2574 generic.go:356] "Generic (PLEG): container finished" podID="d221dfc2-e0ec-41a8-9988-c962aad3e43a" containerID="ed8887cba4a1207295e8d9de045e69ef79de32296fe05c0650796f5db42c3b8f" exitCode=0 Jun 11 14:59:27.529600 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:27.529529 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" event={"ID":"d221dfc2-e0ec-41a8-9988-c962aad3e43a","Type":"ContainerDied","Data":"ed8887cba4a1207295e8d9de045e69ef79de32296fe05c0650796f5db42c3b8f"} Jun 11 14:59:27.531244 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:27.531223 2574 generic.go:356] "Generic (PLEG): container finished" podID="fda62c81-58b8-4723-8bb8-e85ebfd34395" containerID="44a8ecb73146673593e3d2dc440784cefacad8f9a39ec195c843d9afbf3bf1eb" exitCode=0 Jun 11 14:59:27.531334 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:27.531270 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" event={"ID":"fda62c81-58b8-4723-8bb8-e85ebfd34395","Type":"ContainerDied","Data":"44a8ecb73146673593e3d2dc440784cefacad8f9a39ec195c843d9afbf3bf1eb"} Jun 11 14:59:28.540364 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:28.540285 2574 generic.go:356] "Generic (PLEG): container finished" podID="56e1ab7a-c840-46e8-81d7-9f0824035a95" containerID="5f1bec15f226013f2df3cfe55142190e76004e2650d0faa84a11dcec05938f36" exitCode=0 Jun 11 14:59:28.540766 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:28.540359 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" event={"ID":"56e1ab7a-c840-46e8-81d7-9f0824035a95","Type":"ContainerDied","Data":"5f1bec15f226013f2df3cfe55142190e76004e2650d0faa84a11dcec05938f36"} Jun 11 14:59:28.542790 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:28.542766 2574 generic.go:356] "Generic (PLEG): container finished" podID="fda62c81-58b8-4723-8bb8-e85ebfd34395" containerID="cd04a0ae71b5d428402febb800b4a821dc8284acc6fdecc2f6e1fa6123296a8d" exitCode=0 Jun 11 14:59:28.542932 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:28.542851 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" event={"ID":"fda62c81-58b8-4723-8bb8-e85ebfd34395","Type":"ContainerDied","Data":"cd04a0ae71b5d428402febb800b4a821dc8284acc6fdecc2f6e1fa6123296a8d"} Jun 11 14:59:28.748315 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:28.748289 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" Jun 11 14:59:28.805911 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:28.805888 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg6fr\" (UniqueName: \"kubernetes.io/projected/b15ba50f-eee7-460f-87cc-2d7319ed0968-kube-api-access-rg6fr\") pod \"b15ba50f-eee7-460f-87cc-2d7319ed0968\" (UID: \"b15ba50f-eee7-460f-87cc-2d7319ed0968\") " Jun 11 14:59:28.806058 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:28.805918 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b15ba50f-eee7-460f-87cc-2d7319ed0968-bundle\") pod \"b15ba50f-eee7-460f-87cc-2d7319ed0968\" (UID: \"b15ba50f-eee7-460f-87cc-2d7319ed0968\") " Jun 11 14:59:28.806058 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:28.805937 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b15ba50f-eee7-460f-87cc-2d7319ed0968-util\") pod \"b15ba50f-eee7-460f-87cc-2d7319ed0968\" (UID: \"b15ba50f-eee7-460f-87cc-2d7319ed0968\") " Jun 11 14:59:28.806378 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:28.806348 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15ba50f-eee7-460f-87cc-2d7319ed0968-bundle" (OuterVolumeSpecName: "bundle") pod "b15ba50f-eee7-460f-87cc-2d7319ed0968" (UID: "b15ba50f-eee7-460f-87cc-2d7319ed0968"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:59:28.808342 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:28.808321 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b15ba50f-eee7-460f-87cc-2d7319ed0968-kube-api-access-rg6fr" (OuterVolumeSpecName: "kube-api-access-rg6fr") pod "b15ba50f-eee7-460f-87cc-2d7319ed0968" (UID: "b15ba50f-eee7-460f-87cc-2d7319ed0968"). InnerVolumeSpecName "kube-api-access-rg6fr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:59:28.810683 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:28.810664 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15ba50f-eee7-460f-87cc-2d7319ed0968-util" (OuterVolumeSpecName: "util") pod "b15ba50f-eee7-460f-87cc-2d7319ed0968" (UID: "b15ba50f-eee7-460f-87cc-2d7319ed0968"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:59:28.906896 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:28.906858 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg6fr\" (UniqueName: \"kubernetes.io/projected/b15ba50f-eee7-460f-87cc-2d7319ed0968-kube-api-access-rg6fr\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:59:28.906896 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:28.906889 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b15ba50f-eee7-460f-87cc-2d7319ed0968-bundle\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:59:28.906896 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:28.906899 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b15ba50f-eee7-460f-87cc-2d7319ed0968-util\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:59:29.552940 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.552859 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" Jun 11 14:59:29.553451 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.552860 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6" event={"ID":"b15ba50f-eee7-460f-87cc-2d7319ed0968","Type":"ContainerDied","Data":"406ea4f73444155e632e7c833ec7293385e6392814fe2bb9f306f045c906f071"} Jun 11 14:59:29.553451 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.552990 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="406ea4f73444155e632e7c833ec7293385e6392814fe2bb9f306f045c906f071" Jun 11 14:59:29.554775 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.554705 2574 generic.go:356] "Generic (PLEG): container finished" podID="d221dfc2-e0ec-41a8-9988-c962aad3e43a" containerID="75b9fd1afae7257cc47c1d9939ab23db1a66007507aa7e9ce93b61303828bca3" exitCode=0 Jun 11 14:59:29.554912 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.554795 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" event={"ID":"d221dfc2-e0ec-41a8-9988-c962aad3e43a","Type":"ContainerDied","Data":"75b9fd1afae7257cc47c1d9939ab23db1a66007507aa7e9ce93b61303828bca3"} Jun 11 14:59:29.557093 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.557073 2574 generic.go:356] "Generic (PLEG): container finished" podID="56e1ab7a-c840-46e8-81d7-9f0824035a95" containerID="0a4218f1e99e2a62ec9592ab8df5cc1c3de98b81b8adfe9f99261f8206b4cd0e" exitCode=0 Jun 11 14:59:29.557204 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.557100 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" event={"ID":"56e1ab7a-c840-46e8-81d7-9f0824035a95","Type":"ContainerDied","Data":"0a4218f1e99e2a62ec9592ab8df5cc1c3de98b81b8adfe9f99261f8206b4cd0e"} Jun 11 14:59:29.691428 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.691403 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" Jun 11 14:59:29.815611 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.815536 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fda62c81-58b8-4723-8bb8-e85ebfd34395-util\") pod \"fda62c81-58b8-4723-8bb8-e85ebfd34395\" (UID: \"fda62c81-58b8-4723-8bb8-e85ebfd34395\") " Jun 11 14:59:29.815740 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.815625 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4wtm\" (UniqueName: \"kubernetes.io/projected/fda62c81-58b8-4723-8bb8-e85ebfd34395-kube-api-access-j4wtm\") pod \"fda62c81-58b8-4723-8bb8-e85ebfd34395\" (UID: \"fda62c81-58b8-4723-8bb8-e85ebfd34395\") " Jun 11 14:59:29.815740 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.815664 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fda62c81-58b8-4723-8bb8-e85ebfd34395-bundle\") pod \"fda62c81-58b8-4723-8bb8-e85ebfd34395\" (UID: \"fda62c81-58b8-4723-8bb8-e85ebfd34395\") " Jun 11 14:59:29.816417 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.816385 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fda62c81-58b8-4723-8bb8-e85ebfd34395-bundle" (OuterVolumeSpecName: "bundle") pod "fda62c81-58b8-4723-8bb8-e85ebfd34395" (UID: "fda62c81-58b8-4723-8bb8-e85ebfd34395"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:59:29.817679 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.817652 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fda62c81-58b8-4723-8bb8-e85ebfd34395-kube-api-access-j4wtm" (OuterVolumeSpecName: "kube-api-access-j4wtm") pod "fda62c81-58b8-4723-8bb8-e85ebfd34395" (UID: "fda62c81-58b8-4723-8bb8-e85ebfd34395"). InnerVolumeSpecName "kube-api-access-j4wtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:59:29.821177 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.821153 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fda62c81-58b8-4723-8bb8-e85ebfd34395-util" (OuterVolumeSpecName: "util") pod "fda62c81-58b8-4723-8bb8-e85ebfd34395" (UID: "fda62c81-58b8-4723-8bb8-e85ebfd34395"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:59:29.917069 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.917034 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fda62c81-58b8-4723-8bb8-e85ebfd34395-bundle\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:59:29.917069 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.917061 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fda62c81-58b8-4723-8bb8-e85ebfd34395-util\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:59:29.917069 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:29.917070 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4wtm\" (UniqueName: \"kubernetes.io/projected/fda62c81-58b8-4723-8bb8-e85ebfd34395-kube-api-access-j4wtm\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:59:30.564113 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.564082 2574 generic.go:356] "Generic (PLEG): container finished" podID="d221dfc2-e0ec-41a8-9988-c962aad3e43a" containerID="9bbc8d1453edc2a00e010552f227563a6bffa31098e0691c0520633b586168f4" exitCode=0 Jun 11 14:59:30.564607 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.564180 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" event={"ID":"d221dfc2-e0ec-41a8-9988-c962aad3e43a","Type":"ContainerDied","Data":"9bbc8d1453edc2a00e010552f227563a6bffa31098e0691c0520633b586168f4"} Jun 11 14:59:30.565984 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.565968 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" Jun 11 14:59:30.566109 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.565994 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns" event={"ID":"fda62c81-58b8-4723-8bb8-e85ebfd34395","Type":"ContainerDied","Data":"801c9d4ddf043d89c288c5b1bd3733ad701604f7ca4169a5417304dc06fd85e4"} Jun 11 14:59:30.566109 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.566045 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="801c9d4ddf043d89c288c5b1bd3733ad701604f7ca4169a5417304dc06fd85e4" Jun 11 14:59:30.696845 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.696820 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" Jun 11 14:59:30.822849 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.822768 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56e1ab7a-c840-46e8-81d7-9f0824035a95-bundle\") pod \"56e1ab7a-c840-46e8-81d7-9f0824035a95\" (UID: \"56e1ab7a-c840-46e8-81d7-9f0824035a95\") " Jun 11 14:59:30.822849 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.822827 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56e1ab7a-c840-46e8-81d7-9f0824035a95-util\") pod \"56e1ab7a-c840-46e8-81d7-9f0824035a95\" (UID: \"56e1ab7a-c840-46e8-81d7-9f0824035a95\") " Jun 11 14:59:30.823092 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.822869 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqp7c\" (UniqueName: \"kubernetes.io/projected/56e1ab7a-c840-46e8-81d7-9f0824035a95-kube-api-access-rqp7c\") pod \"56e1ab7a-c840-46e8-81d7-9f0824035a95\" (UID: \"56e1ab7a-c840-46e8-81d7-9f0824035a95\") " Jun 11 14:59:30.823351 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.823321 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56e1ab7a-c840-46e8-81d7-9f0824035a95-bundle" (OuterVolumeSpecName: "bundle") pod "56e1ab7a-c840-46e8-81d7-9f0824035a95" (UID: "56e1ab7a-c840-46e8-81d7-9f0824035a95"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:59:30.824893 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.824869 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56e1ab7a-c840-46e8-81d7-9f0824035a95-kube-api-access-rqp7c" (OuterVolumeSpecName: "kube-api-access-rqp7c") pod "56e1ab7a-c840-46e8-81d7-9f0824035a95" (UID: "56e1ab7a-c840-46e8-81d7-9f0824035a95"). InnerVolumeSpecName "kube-api-access-rqp7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:59:30.828312 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.828279 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56e1ab7a-c840-46e8-81d7-9f0824035a95-util" (OuterVolumeSpecName: "util") pod "56e1ab7a-c840-46e8-81d7-9f0824035a95" (UID: "56e1ab7a-c840-46e8-81d7-9f0824035a95"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:59:30.924166 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.924132 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56e1ab7a-c840-46e8-81d7-9f0824035a95-util\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:59:30.924166 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.924158 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqp7c\" (UniqueName: \"kubernetes.io/projected/56e1ab7a-c840-46e8-81d7-9f0824035a95-kube-api-access-rqp7c\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:59:30.924166 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:30.924169 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56e1ab7a-c840-46e8-81d7-9f0824035a95-bundle\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:59:31.573137 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:31.573046 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" event={"ID":"56e1ab7a-c840-46e8-81d7-9f0824035a95","Type":"ContainerDied","Data":"55b1dba55e7fd1eca298aa3c574286f254c1e3dd19a6623d229918f08c9d062f"} Jun 11 14:59:31.573137 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:31.573069 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf" Jun 11 14:59:31.573137 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:31.573097 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55b1dba55e7fd1eca298aa3c574286f254c1e3dd19a6623d229918f08c9d062f" Jun 11 14:59:31.702521 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:31.702497 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" Jun 11 14:59:31.830250 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:31.830148 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl57k\" (UniqueName: \"kubernetes.io/projected/d221dfc2-e0ec-41a8-9988-c962aad3e43a-kube-api-access-bl57k\") pod \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\" (UID: \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\") " Jun 11 14:59:31.830250 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:31.830196 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d221dfc2-e0ec-41a8-9988-c962aad3e43a-bundle\") pod \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\" (UID: \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\") " Jun 11 14:59:31.830250 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:31.830233 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d221dfc2-e0ec-41a8-9988-c962aad3e43a-util\") pod \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\" (UID: \"d221dfc2-e0ec-41a8-9988-c962aad3e43a\") " Jun 11 14:59:31.830730 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:31.830704 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d221dfc2-e0ec-41a8-9988-c962aad3e43a-bundle" (OuterVolumeSpecName: "bundle") pod "d221dfc2-e0ec-41a8-9988-c962aad3e43a" (UID: "d221dfc2-e0ec-41a8-9988-c962aad3e43a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:59:31.832701 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:31.832679 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d221dfc2-e0ec-41a8-9988-c962aad3e43a-kube-api-access-bl57k" (OuterVolumeSpecName: "kube-api-access-bl57k") pod "d221dfc2-e0ec-41a8-9988-c962aad3e43a" (UID: "d221dfc2-e0ec-41a8-9988-c962aad3e43a"). InnerVolumeSpecName "kube-api-access-bl57k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:59:31.836544 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:31.836509 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d221dfc2-e0ec-41a8-9988-c962aad3e43a-util" (OuterVolumeSpecName: "util") pod "d221dfc2-e0ec-41a8-9988-c962aad3e43a" (UID: "d221dfc2-e0ec-41a8-9988-c962aad3e43a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:59:31.931109 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:31.931066 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d221dfc2-e0ec-41a8-9988-c962aad3e43a-util\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:59:31.931109 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:31.931102 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl57k\" (UniqueName: \"kubernetes.io/projected/d221dfc2-e0ec-41a8-9988-c962aad3e43a-kube-api-access-bl57k\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:59:31.931109 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:31.931114 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d221dfc2-e0ec-41a8-9988-c962aad3e43a-bundle\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 14:59:32.579313 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:32.579283 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" Jun 11 14:59:32.579313 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:32.579308 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc" event={"ID":"d221dfc2-e0ec-41a8-9988-c962aad3e43a","Type":"ContainerDied","Data":"49c4748591fe5fe2790ba5c4d6d1ef14b6add126179cdd4b035e6398a3be4b9a"} Jun 11 14:59:32.579728 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:32.579354 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49c4748591fe5fe2790ba5c4d6d1ef14b6add126179cdd4b035e6398a3be4b9a" Jun 11 14:59:50.204492 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204457 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds"] Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204752 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fda62c81-58b8-4723-8bb8-e85ebfd34395" containerName="util" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204763 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fda62c81-58b8-4723-8bb8-e85ebfd34395" containerName="util" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204773 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15ba50f-eee7-460f-87cc-2d7319ed0968" containerName="pull" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204779 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15ba50f-eee7-460f-87cc-2d7319ed0968" containerName="pull" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204787 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15ba50f-eee7-460f-87cc-2d7319ed0968" containerName="extract" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204793 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15ba50f-eee7-460f-87cc-2d7319ed0968" containerName="extract" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204800 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56e1ab7a-c840-46e8-81d7-9f0824035a95" containerName="pull" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204805 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="56e1ab7a-c840-46e8-81d7-9f0824035a95" containerName="pull" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204811 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15ba50f-eee7-460f-87cc-2d7319ed0968" containerName="util" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204817 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15ba50f-eee7-460f-87cc-2d7319ed0968" containerName="util" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204823 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56e1ab7a-c840-46e8-81d7-9f0824035a95" containerName="util" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204827 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="56e1ab7a-c840-46e8-81d7-9f0824035a95" containerName="util" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204835 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fda62c81-58b8-4723-8bb8-e85ebfd34395" containerName="pull" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204840 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fda62c81-58b8-4723-8bb8-e85ebfd34395" containerName="pull" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204853 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d221dfc2-e0ec-41a8-9988-c962aad3e43a" containerName="util" Jun 11 14:59:50.204854 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204858 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d221dfc2-e0ec-41a8-9988-c962aad3e43a" containerName="util" Jun 11 14:59:50.205358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204864 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fda62c81-58b8-4723-8bb8-e85ebfd34395" containerName="extract" Jun 11 14:59:50.205358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204869 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fda62c81-58b8-4723-8bb8-e85ebfd34395" containerName="extract" Jun 11 14:59:50.205358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204875 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56e1ab7a-c840-46e8-81d7-9f0824035a95" containerName="extract" Jun 11 14:59:50.205358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204879 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="56e1ab7a-c840-46e8-81d7-9f0824035a95" containerName="extract" Jun 11 14:59:50.205358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204885 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d221dfc2-e0ec-41a8-9988-c962aad3e43a" containerName="pull" Jun 11 14:59:50.205358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204889 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d221dfc2-e0ec-41a8-9988-c962aad3e43a" containerName="pull" Jun 11 14:59:50.205358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204901 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d221dfc2-e0ec-41a8-9988-c962aad3e43a" containerName="extract" Jun 11 14:59:50.205358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204905 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d221dfc2-e0ec-41a8-9988-c962aad3e43a" containerName="extract" Jun 11 14:59:50.205358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204953 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="56e1ab7a-c840-46e8-81d7-9f0824035a95" containerName="extract" Jun 11 14:59:50.205358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204961 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fda62c81-58b8-4723-8bb8-e85ebfd34395" containerName="extract" Jun 11 14:59:50.205358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204967 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b15ba50f-eee7-460f-87cc-2d7319ed0968" containerName="extract" Jun 11 14:59:50.205358 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.204974 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d221dfc2-e0ec-41a8-9988-c962aad3e43a" containerName="extract" Jun 11 14:59:50.206793 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.206778 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 14:59:50.209980 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.209951 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 14:59:50.209980 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.209975 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 14:59:50.210157 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.210043 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2j6w9\"" Jun 11 14:59:50.229128 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.229108 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds"] Jun 11 14:59:50.288602 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.288570 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5sgr\" (UniqueName: \"kubernetes.io/projected/c1ccf477-0cd2-4132-85f5-a85e13ec04d7-kube-api-access-g5sgr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n4tds\" (UID: \"c1ccf477-0cd2-4132-85f5-a85e13ec04d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 14:59:50.288749 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.288629 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1ccf477-0cd2-4132-85f5-a85e13ec04d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n4tds\" (UID: \"c1ccf477-0cd2-4132-85f5-a85e13ec04d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 14:59:50.390028 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.389980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5sgr\" (UniqueName: \"kubernetes.io/projected/c1ccf477-0cd2-4132-85f5-a85e13ec04d7-kube-api-access-g5sgr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n4tds\" (UID: \"c1ccf477-0cd2-4132-85f5-a85e13ec04d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 14:59:50.390190 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.390055 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1ccf477-0cd2-4132-85f5-a85e13ec04d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n4tds\" (UID: \"c1ccf477-0cd2-4132-85f5-a85e13ec04d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 14:59:50.390472 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.390453 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1ccf477-0cd2-4132-85f5-a85e13ec04d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n4tds\" (UID: \"c1ccf477-0cd2-4132-85f5-a85e13ec04d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 14:59:50.409913 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.409887 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5sgr\" (UniqueName: \"kubernetes.io/projected/c1ccf477-0cd2-4132-85f5-a85e13ec04d7-kube-api-access-g5sgr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n4tds\" (UID: \"c1ccf477-0cd2-4132-85f5-a85e13ec04d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 14:59:50.516874 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.516784 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 14:59:50.664332 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:50.664298 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds"] Jun 11 14:59:50.668110 ip-10-0-135-91 kubenswrapper[2574]: W0611 14:59:50.668080 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ccf477_0cd2_4132_85f5_a85e13ec04d7.slice/crio-2a54d7b594de0eecaca8a09a9164543e41367098b1f9387665349a30e5c33893 WatchSource:0}: Error finding container 2a54d7b594de0eecaca8a09a9164543e41367098b1f9387665349a30e5c33893: Status 404 returned error can't find the container with id 2a54d7b594de0eecaca8a09a9164543e41367098b1f9387665349a30e5c33893 Jun 11 14:59:51.683595 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:51.683559 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" event={"ID":"c1ccf477-0cd2-4132-85f5-a85e13ec04d7","Type":"ContainerStarted","Data":"2a54d7b594de0eecaca8a09a9164543e41367098b1f9387665349a30e5c33893"} Jun 11 14:59:57.718870 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:57.718829 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" event={"ID":"c1ccf477-0cd2-4132-85f5-a85e13ec04d7","Type":"ContainerStarted","Data":"b919e2ce7946d764367c2e3879898e2cb0d98ec2e3aab2d8a5321173b4500d8b"} Jun 11 14:59:57.719315 ip-10-0-135-91 kubenswrapper[2574]: I0611 14:59:57.718947 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 15:00:08.726494 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:08.726460 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 15:00:08.764863 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:08.764806 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" podStartSLOduration=12.70220995 podStartE2EDuration="18.764789816s" totalImagesPullingTime="6.062579866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:57.771537263 +0000 UTC m=+577.029788657" watchObservedRunningTime="2026-06-11 15:00:08.764789816 +0000 UTC m=+588.023041207" Jun 11 15:00:10.864370 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:10.864335 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds"] Jun 11 15:00:10.864819 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:10.864524 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" podUID="c1ccf477-0cd2-4132-85f5-a85e13ec04d7" containerName="manager" containerID="cri-o://b919e2ce7946d764367c2e3879898e2cb0d98ec2e3aab2d8a5321173b4500d8b" gracePeriod=2 Jun 11 15:00:10.880647 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:10.880618 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds"] Jun 11 15:00:10.899890 ip-10-0-135-91 kubenswrapper[2574]: E0611 15:00:10.899862 2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c1ccf477-0cd2-4132-85f5-a85e13ec04d7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-n4tds\": pods \"kuadrant-operator-controller-manager-8684c9ff49-n4tds\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 15:00:10.931233 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:10.931205 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5"] Jun 11 15:00:10.931582 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:10.931566 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1ccf477-0cd2-4132-85f5-a85e13ec04d7" containerName="manager" Jun 11 15:00:10.931659 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:10.931585 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1ccf477-0cd2-4132-85f5-a85e13ec04d7" containerName="manager" Jun 11 15:00:10.931717 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:10.931666 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1ccf477-0cd2-4132-85f5-a85e13ec04d7" containerName="manager" Jun 11 15:00:10.934666 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:10.934648 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" Jun 11 15:00:10.965304 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:10.965274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5730cfb8-53fb-429b-8ebe-49c4eb18a608-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hzcd5\" (UID: \"5730cfb8-53fb-429b-8ebe-49c4eb18a608\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" Jun 11 15:00:10.965404 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:10.965337 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vblvn\" (UniqueName: \"kubernetes.io/projected/5730cfb8-53fb-429b-8ebe-49c4eb18a608-kube-api-access-vblvn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hzcd5\" (UID: \"5730cfb8-53fb-429b-8ebe-49c4eb18a608\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" Jun 11 15:00:10.978483 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:10.978451 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5"] Jun 11 15:00:11.017239 ip-10-0-135-91 kubenswrapper[2574]: E0611 15:00:11.017202 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n4tds\" is forbidden: User \"system:node:ip-10-0-135-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-91.ec2.internal' and this object" podUID="c1ccf477-0cd2-4132-85f5-a85e13ec04d7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 15:00:11.065869 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.065831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5730cfb8-53fb-429b-8ebe-49c4eb18a608-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hzcd5\" (UID: \"5730cfb8-53fb-429b-8ebe-49c4eb18a608\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" Jun 11 15:00:11.066022 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.065919 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vblvn\" (UniqueName: \"kubernetes.io/projected/5730cfb8-53fb-429b-8ebe-49c4eb18a608-kube-api-access-vblvn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hzcd5\" (UID: \"5730cfb8-53fb-429b-8ebe-49c4eb18a608\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" Jun 11 15:00:11.066784 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.066753 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5730cfb8-53fb-429b-8ebe-49c4eb18a608-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hzcd5\" (UID: \"5730cfb8-53fb-429b-8ebe-49c4eb18a608\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" Jun 11 15:00:11.082290 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.082264 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vblvn\" (UniqueName: \"kubernetes.io/projected/5730cfb8-53fb-429b-8ebe-49c4eb18a608-kube-api-access-vblvn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hzcd5\" (UID: \"5730cfb8-53fb-429b-8ebe-49c4eb18a608\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" Jun 11 15:00:11.129981 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.129954 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 15:00:11.135315 ip-10-0-135-91 kubenswrapper[2574]: E0611 15:00:11.135286 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n4tds\" is forbidden: User \"system:node:ip-10-0-135-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-91.ec2.internal' and this object" podUID="c1ccf477-0cd2-4132-85f5-a85e13ec04d7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 15:00:11.166706 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.166680 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5sgr\" (UniqueName: \"kubernetes.io/projected/c1ccf477-0cd2-4132-85f5-a85e13ec04d7-kube-api-access-g5sgr\") pod \"c1ccf477-0cd2-4132-85f5-a85e13ec04d7\" (UID: \"c1ccf477-0cd2-4132-85f5-a85e13ec04d7\") " Jun 11 15:00:11.166810 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.166740 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1ccf477-0cd2-4132-85f5-a85e13ec04d7-extensions-socket-volume\") pod \"c1ccf477-0cd2-4132-85f5-a85e13ec04d7\" (UID: \"c1ccf477-0cd2-4132-85f5-a85e13ec04d7\") " Jun 11 15:00:11.167267 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.167237 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1ccf477-0cd2-4132-85f5-a85e13ec04d7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c1ccf477-0cd2-4132-85f5-a85e13ec04d7" (UID: "c1ccf477-0cd2-4132-85f5-a85e13ec04d7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:00:11.168776 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.168755 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1ccf477-0cd2-4132-85f5-a85e13ec04d7-kube-api-access-g5sgr" (OuterVolumeSpecName: "kube-api-access-g5sgr") pod "c1ccf477-0cd2-4132-85f5-a85e13ec04d7" (UID: "c1ccf477-0cd2-4132-85f5-a85e13ec04d7"). InnerVolumeSpecName "kube-api-access-g5sgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:00:11.181612 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.181586 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1ccf477-0cd2-4132-85f5-a85e13ec04d7" path="/var/lib/kubelet/pods/c1ccf477-0cd2-4132-85f5-a85e13ec04d7/volumes" Jun 11 15:00:11.182147 ip-10-0-135-91 kubenswrapper[2574]: E0611 15:00:11.182125 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n4tds\" is forbidden: User \"system:node:ip-10-0-135-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-91.ec2.internal' and this object" podUID="c1ccf477-0cd2-4132-85f5-a85e13ec04d7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 15:00:11.259662 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.259635 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" Jun 11 15:00:11.267982 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.267961 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1ccf477-0cd2-4132-85f5-a85e13ec04d7-extensions-socket-volume\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 15:00:11.267982 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.267981 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5sgr\" (UniqueName: \"kubernetes.io/projected/c1ccf477-0cd2-4132-85f5-a85e13ec04d7-kube-api-access-g5sgr\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 15:00:11.422609 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.422584 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5"] Jun 11 15:00:11.424412 ip-10-0-135-91 kubenswrapper[2574]: W0611 15:00:11.424390 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5730cfb8_53fb_429b_8ebe_49c4eb18a608.slice/crio-54de373769f292131641c01fc0fe0b9f6e0418ee6ddc068b2344e01b585c8bb0 WatchSource:0}: Error finding container 54de373769f292131641c01fc0fe0b9f6e0418ee6ddc068b2344e01b585c8bb0: Status 404 returned error can't find the container with id 54de373769f292131641c01fc0fe0b9f6e0418ee6ddc068b2344e01b585c8bb0 Jun 11 15:00:11.791661 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.791568 2574 generic.go:356] "Generic (PLEG): container finished" podID="c1ccf477-0cd2-4132-85f5-a85e13ec04d7" containerID="b919e2ce7946d764367c2e3879898e2cb0d98ec2e3aab2d8a5321173b4500d8b" exitCode=0 Jun 11 15:00:11.791661 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.791626 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4tds" Jun 11 15:00:11.791892 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.791677 2574 scope.go:117] "RemoveContainer" containerID="b919e2ce7946d764367c2e3879898e2cb0d98ec2e3aab2d8a5321173b4500d8b" Jun 11 15:00:11.795191 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.795165 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" event={"ID":"5730cfb8-53fb-429b-8ebe-49c4eb18a608","Type":"ContainerStarted","Data":"ed294d7ad78bbe9f225f7eb99c8d11063daa605d133f47381782bad024847162"} Jun 11 15:00:11.795390 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.795368 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" event={"ID":"5730cfb8-53fb-429b-8ebe-49c4eb18a608","Type":"ContainerStarted","Data":"54de373769f292131641c01fc0fe0b9f6e0418ee6ddc068b2344e01b585c8bb0"} Jun 11 15:00:11.803650 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.803630 2574 scope.go:117] "RemoveContainer" containerID="b919e2ce7946d764367c2e3879898e2cb0d98ec2e3aab2d8a5321173b4500d8b" Jun 11 15:00:11.803922 ip-10-0-135-91 kubenswrapper[2574]: E0611 15:00:11.803896 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b919e2ce7946d764367c2e3879898e2cb0d98ec2e3aab2d8a5321173b4500d8b\": container with ID starting with b919e2ce7946d764367c2e3879898e2cb0d98ec2e3aab2d8a5321173b4500d8b not found: ID does not exist" containerID="b919e2ce7946d764367c2e3879898e2cb0d98ec2e3aab2d8a5321173b4500d8b" Jun 11 15:00:11.803983 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.803933 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b919e2ce7946d764367c2e3879898e2cb0d98ec2e3aab2d8a5321173b4500d8b"} err="failed to get container status \"b919e2ce7946d764367c2e3879898e2cb0d98ec2e3aab2d8a5321173b4500d8b\": rpc error: code = NotFound desc = could not find container \"b919e2ce7946d764367c2e3879898e2cb0d98ec2e3aab2d8a5321173b4500d8b\": container with ID starting with b919e2ce7946d764367c2e3879898e2cb0d98ec2e3aab2d8a5321173b4500d8b not found: ID does not exist" Jun 11 15:00:11.819136 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:11.819095 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" podStartSLOduration=1.819081278 podStartE2EDuration="1.819081278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:11.816164738 +0000 UTC m=+591.074416130" watchObservedRunningTime="2026-06-11 15:00:11.819081278 +0000 UTC m=+591.077332727" Jun 11 15:00:12.801325 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:12.801300 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" Jun 11 15:00:21.138402 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:21.138378 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 15:00:21.139045 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:21.139027 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 15:00:23.809434 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:23.809402 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" Jun 11 15:00:40.980923 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:40.980846 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5"] Jun 11 15:00:40.982372 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:40.981104 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" podUID="5730cfb8-53fb-429b-8ebe-49c4eb18a608" containerName="manager" containerID="cri-o://ed294d7ad78bbe9f225f7eb99c8d11063daa605d133f47381782bad024847162" gracePeriod=10 Jun 11 15:00:41.226413 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.226389 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" Jun 11 15:00:41.315692 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.315592 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vblvn\" (UniqueName: \"kubernetes.io/projected/5730cfb8-53fb-429b-8ebe-49c4eb18a608-kube-api-access-vblvn\") pod \"5730cfb8-53fb-429b-8ebe-49c4eb18a608\" (UID: \"5730cfb8-53fb-429b-8ebe-49c4eb18a608\") " Jun 11 15:00:41.315849 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.315778 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5730cfb8-53fb-429b-8ebe-49c4eb18a608-extensions-socket-volume\") pod \"5730cfb8-53fb-429b-8ebe-49c4eb18a608\" (UID: \"5730cfb8-53fb-429b-8ebe-49c4eb18a608\") " Jun 11 15:00:41.316563 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.316526 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5730cfb8-53fb-429b-8ebe-49c4eb18a608-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5730cfb8-53fb-429b-8ebe-49c4eb18a608" (UID: "5730cfb8-53fb-429b-8ebe-49c4eb18a608"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:00:41.318614 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.318579 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5730cfb8-53fb-429b-8ebe-49c4eb18a608-kube-api-access-vblvn" (OuterVolumeSpecName: "kube-api-access-vblvn") pod "5730cfb8-53fb-429b-8ebe-49c4eb18a608" (UID: "5730cfb8-53fb-429b-8ebe-49c4eb18a608"). InnerVolumeSpecName "kube-api-access-vblvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:00:41.416912 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.416881 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vblvn\" (UniqueName: \"kubernetes.io/projected/5730cfb8-53fb-429b-8ebe-49c4eb18a608-kube-api-access-vblvn\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 15:00:41.416912 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.416907 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5730cfb8-53fb-429b-8ebe-49c4eb18a608-extensions-socket-volume\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 15:00:41.957982 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.957944 2574 generic.go:356] "Generic (PLEG): container finished" podID="5730cfb8-53fb-429b-8ebe-49c4eb18a608" containerID="ed294d7ad78bbe9f225f7eb99c8d11063daa605d133f47381782bad024847162" exitCode=0 Jun 11 15:00:41.958170 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.958023 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" Jun 11 15:00:41.958170 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.958034 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" event={"ID":"5730cfb8-53fb-429b-8ebe-49c4eb18a608","Type":"ContainerDied","Data":"ed294d7ad78bbe9f225f7eb99c8d11063daa605d133f47381782bad024847162"} Jun 11 15:00:41.958170 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.958115 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5" event={"ID":"5730cfb8-53fb-429b-8ebe-49c4eb18a608","Type":"ContainerDied","Data":"54de373769f292131641c01fc0fe0b9f6e0418ee6ddc068b2344e01b585c8bb0"} Jun 11 15:00:41.958170 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.958138 2574 scope.go:117] "RemoveContainer" containerID="ed294d7ad78bbe9f225f7eb99c8d11063daa605d133f47381782bad024847162" Jun 11 15:00:41.966846 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.966829 2574 scope.go:117] "RemoveContainer" containerID="ed294d7ad78bbe9f225f7eb99c8d11063daa605d133f47381782bad024847162" Jun 11 15:00:41.967122 ip-10-0-135-91 kubenswrapper[2574]: E0611 15:00:41.967100 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed294d7ad78bbe9f225f7eb99c8d11063daa605d133f47381782bad024847162\": container with ID starting with ed294d7ad78bbe9f225f7eb99c8d11063daa605d133f47381782bad024847162 not found: ID does not exist" containerID="ed294d7ad78bbe9f225f7eb99c8d11063daa605d133f47381782bad024847162" Jun 11 15:00:41.967207 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.967130 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed294d7ad78bbe9f225f7eb99c8d11063daa605d133f47381782bad024847162"} err="failed to get container status \"ed294d7ad78bbe9f225f7eb99c8d11063daa605d133f47381782bad024847162\": rpc error: code = NotFound desc = could not find container \"ed294d7ad78bbe9f225f7eb99c8d11063daa605d133f47381782bad024847162\": container with ID starting with ed294d7ad78bbe9f225f7eb99c8d11063daa605d133f47381782bad024847162 not found: ID does not exist" Jun 11 15:00:41.987133 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.987101 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5"] Jun 11 15:00:41.990675 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:41.990650 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hzcd5"] Jun 11 15:00:43.181064 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:43.181031 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5730cfb8-53fb-429b-8ebe-49c4eb18a608" path="/var/lib/kubelet/pods/5730cfb8-53fb-429b-8ebe-49c4eb18a608/volumes" Jun 11 15:00:59.963022 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:59.962977 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2ztml"] Jun 11 15:00:59.963378 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:59.963298 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5730cfb8-53fb-429b-8ebe-49c4eb18a608" containerName="manager" Jun 11 15:00:59.963378 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:59.963311 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5730cfb8-53fb-429b-8ebe-49c4eb18a608" containerName="manager" Jun 11 15:00:59.963378 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:59.963375 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5730cfb8-53fb-429b-8ebe-49c4eb18a608" containerName="manager" Jun 11 15:00:59.965710 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:59.965693 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" Jun 11 15:00:59.968901 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:59.968879 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 15:00:59.969071 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:59.968947 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 15:00:59.969071 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:59.969019 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 15:00:59.970299 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:59.970285 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4wlqd\"" Jun 11 15:00:59.976000 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:00:59.975983 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2ztml"] Jun 11 15:01:00.049015 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.048971 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2ztml"] Jun 11 15:01:00.069264 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.069233 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae-config-file\") pod \"limitador-limitador-64c94fd64f-2ztml\" (UID: \"7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" Jun 11 15:01:00.069408 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.069284 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhbmg\" (UniqueName: \"kubernetes.io/projected/7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae-kube-api-access-lhbmg\") pod \"limitador-limitador-64c94fd64f-2ztml\" (UID: \"7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" Jun 11 15:01:00.170364 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.170331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhbmg\" (UniqueName: \"kubernetes.io/projected/7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae-kube-api-access-lhbmg\") pod \"limitador-limitador-64c94fd64f-2ztml\" (UID: \"7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" Jun 11 15:01:00.170527 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.170390 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae-config-file\") pod \"limitador-limitador-64c94fd64f-2ztml\" (UID: \"7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" Jun 11 15:01:00.170975 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.170958 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae-config-file\") pod \"limitador-limitador-64c94fd64f-2ztml\" (UID: \"7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" Jun 11 15:01:00.178363 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.178339 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhbmg\" (UniqueName: \"kubernetes.io/projected/7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae-kube-api-access-lhbmg\") pod \"limitador-limitador-64c94fd64f-2ztml\" (UID: \"7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" Jun 11 15:01:00.231206 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.231119 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:01:00.233608 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.233586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xmgcf" Jun 11 15:01:00.245748 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.245724 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:01:00.276060 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.276031 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" Jun 11 15:01:00.289622 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.289594 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:01:00.372628 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.372594 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9ed59afb-6922-4634-b364-26ad348d5019-config-file\") pod \"limitador-limitador-54d6d988d5-xmgcf\" (UID: \"9ed59afb-6922-4634-b364-26ad348d5019\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xmgcf" Jun 11 15:01:00.372802 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.372692 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lq4z\" (UniqueName: \"kubernetes.io/projected/9ed59afb-6922-4634-b364-26ad348d5019-kube-api-access-8lq4z\") pod \"limitador-limitador-54d6d988d5-xmgcf\" (UID: \"9ed59afb-6922-4634-b364-26ad348d5019\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xmgcf" Jun 11 15:01:00.406858 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.406835 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2ztml"] Jun 11 15:01:00.408563 ip-10-0-135-91 kubenswrapper[2574]: W0611 15:01:00.408529 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bdc8d39_c649_4f7e_9f1b_da1c7bc91dae.slice/crio-af1e02b2c45d5ed85a3bc9b1e44b2038df1b5cfbbfb3bafe11280259cdc0a791 WatchSource:0}: Error finding container af1e02b2c45d5ed85a3bc9b1e44b2038df1b5cfbbfb3bafe11280259cdc0a791: Status 404 returned error can't find the container with id af1e02b2c45d5ed85a3bc9b1e44b2038df1b5cfbbfb3bafe11280259cdc0a791 Jun 11 15:01:00.473627 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.473598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9ed59afb-6922-4634-b364-26ad348d5019-config-file\") pod \"limitador-limitador-54d6d988d5-xmgcf\" (UID: \"9ed59afb-6922-4634-b364-26ad348d5019\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xmgcf" Jun 11 15:01:00.473759 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.473648 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lq4z\" (UniqueName: \"kubernetes.io/projected/9ed59afb-6922-4634-b364-26ad348d5019-kube-api-access-8lq4z\") pod \"limitador-limitador-54d6d988d5-xmgcf\" (UID: \"9ed59afb-6922-4634-b364-26ad348d5019\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xmgcf" Jun 11 15:01:00.474424 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.474394 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9ed59afb-6922-4634-b364-26ad348d5019-config-file\") pod \"limitador-limitador-54d6d988d5-xmgcf\" (UID: \"9ed59afb-6922-4634-b364-26ad348d5019\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xmgcf" Jun 11 15:01:00.483056 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.482953 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lq4z\" (UniqueName: \"kubernetes.io/projected/9ed59afb-6922-4634-b364-26ad348d5019-kube-api-access-8lq4z\") pod \"limitador-limitador-54d6d988d5-xmgcf\" (UID: \"9ed59afb-6922-4634-b364-26ad348d5019\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xmgcf" Jun 11 15:01:00.544586 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.544556 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xmgcf" Jun 11 15:01:00.672125 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:00.672102 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:01:00.674232 ip-10-0-135-91 kubenswrapper[2574]: W0611 15:01:00.674210 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed59afb_6922_4634_b364_26ad348d5019.slice/crio-9298844b75b91ca84ebea26800bae1231b8b3624964ddc420b62c6b0faba21fb WatchSource:0}: Error finding container 9298844b75b91ca84ebea26800bae1231b8b3624964ddc420b62c6b0faba21fb: Status 404 returned error can't find the container with id 9298844b75b91ca84ebea26800bae1231b8b3624964ddc420b62c6b0faba21fb Jun 11 15:01:01.061637 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:01.061577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xmgcf" event={"ID":"9ed59afb-6922-4634-b364-26ad348d5019","Type":"ContainerStarted","Data":"9298844b75b91ca84ebea26800bae1231b8b3624964ddc420b62c6b0faba21fb"} Jun 11 15:01:01.062881 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:01.062857 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" event={"ID":"7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae","Type":"ContainerStarted","Data":"af1e02b2c45d5ed85a3bc9b1e44b2038df1b5cfbbfb3bafe11280259cdc0a791"} Jun 11 15:01:04.082577 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:04.082540 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xmgcf" event={"ID":"9ed59afb-6922-4634-b364-26ad348d5019","Type":"ContainerStarted","Data":"a9924cb6f1115d254c606ee2ef69501897f441075d78a42d2ba178d8c668dea6"} Jun 11 15:01:04.083063 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:04.082611 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xmgcf" Jun 11 15:01:04.084092 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:04.084070 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" event={"ID":"7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae","Type":"ContainerStarted","Data":"6965b3f2bee94b253e063200af907fd3dfca9be20411fab72f22fca51e517728"} Jun 11 15:01:04.084255 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:04.084242 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" Jun 11 15:01:04.100482 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:04.100435 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-xmgcf" podStartSLOduration=1.223200508 podStartE2EDuration="4.100420999s" totalImagesPullingTime="2.877220491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:01:04.09867927 +0000 UTC m=+643.356930661" watchObservedRunningTime="2026-06-11 15:01:04.100420999 +0000 UTC m=+643.358672389" Jun 11 15:01:04.116936 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:04.116887 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" podStartSLOduration=1.962466755 podStartE2EDuration="5.116874494s" totalImagesPullingTime="3.154407739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:01:04.114244511 +0000 UTC m=+643.372495914" watchObservedRunningTime="2026-06-11 15:01:04.116874494 +0000 UTC m=+643.375125885" Jun 11 15:01:15.096397 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:15.096365 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xmgcf" Jun 11 15:01:15.096798 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:15.096433 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" Jun 11 15:01:15.167758 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:15.167723 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2ztml"] Jun 11 15:01:15.168124 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:15.167906 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" podUID="7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae" containerName="limitador" containerID="cri-o://6965b3f2bee94b253e063200af907fd3dfca9be20411fab72f22fca51e517728" gracePeriod=30 Jun 11 15:01:15.719628 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:15.719602 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" Jun 11 15:01:15.788814 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:15.788722 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae-config-file\") pod \"7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae\" (UID: \"7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae\") " Jun 11 15:01:15.788814 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:15.788805 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhbmg\" (UniqueName: \"kubernetes.io/projected/7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae-kube-api-access-lhbmg\") pod \"7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae\" (UID: \"7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae\") " Jun 11 15:01:15.789072 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:15.789051 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae-config-file" (OuterVolumeSpecName: "config-file") pod "7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae" (UID: "7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:01:15.790964 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:15.790930 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae-kube-api-access-lhbmg" (OuterVolumeSpecName: "kube-api-access-lhbmg") pod "7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae" (UID: "7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae"). InnerVolumeSpecName "kube-api-access-lhbmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:01:15.889929 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:15.889891 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhbmg\" (UniqueName: \"kubernetes.io/projected/7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae-kube-api-access-lhbmg\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 15:01:15.889929 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:15.889923 2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae-config-file\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 15:01:16.153431 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:16.153343 2574 generic.go:356] "Generic (PLEG): container finished" podID="7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae" containerID="6965b3f2bee94b253e063200af907fd3dfca9be20411fab72f22fca51e517728" exitCode=0 Jun 11 15:01:16.153431 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:16.153391 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" Jun 11 15:01:16.153902 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:16.153429 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" event={"ID":"7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae","Type":"ContainerDied","Data":"6965b3f2bee94b253e063200af907fd3dfca9be20411fab72f22fca51e517728"} Jun 11 15:01:16.153902 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:16.153486 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2ztml" event={"ID":"7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae","Type":"ContainerDied","Data":"af1e02b2c45d5ed85a3bc9b1e44b2038df1b5cfbbfb3bafe11280259cdc0a791"} Jun 11 15:01:16.153902 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:16.153518 2574 scope.go:117] "RemoveContainer" containerID="6965b3f2bee94b253e063200af907fd3dfca9be20411fab72f22fca51e517728" Jun 11 15:01:16.162361 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:16.162346 2574 scope.go:117] "RemoveContainer" containerID="6965b3f2bee94b253e063200af907fd3dfca9be20411fab72f22fca51e517728" Jun 11 15:01:16.162588 ip-10-0-135-91 kubenswrapper[2574]: E0611 15:01:16.162571 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6965b3f2bee94b253e063200af907fd3dfca9be20411fab72f22fca51e517728\": container with ID starting with 6965b3f2bee94b253e063200af907fd3dfca9be20411fab72f22fca51e517728 not found: ID does not exist" containerID="6965b3f2bee94b253e063200af907fd3dfca9be20411fab72f22fca51e517728" Jun 11 15:01:16.162657 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:16.162594 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6965b3f2bee94b253e063200af907fd3dfca9be20411fab72f22fca51e517728"} err="failed to get container status \"6965b3f2bee94b253e063200af907fd3dfca9be20411fab72f22fca51e517728\": rpc error: code = NotFound desc = could not find container \"6965b3f2bee94b253e063200af907fd3dfca9be20411fab72f22fca51e517728\": container with ID starting with 6965b3f2bee94b253e063200af907fd3dfca9be20411fab72f22fca51e517728 not found: ID does not exist" Jun 11 15:01:16.187585 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:16.187551 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2ztml"] Jun 11 15:01:16.200166 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:16.200140 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2ztml"] Jun 11 15:01:17.182174 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:17.182143 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae" path="/var/lib/kubelet/pods/7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae/volumes" Jun 11 15:01:21.777609 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.777570 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg"] Jun 11 15:01:21.778062 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.777902 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae" containerName="limitador" Jun 11 15:01:21.778062 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.777913 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae" containerName="limitador" Jun 11 15:01:21.778062 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.777967 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bdc8d39-c649-4f7e-9f1b-da1c7bc91dae" containerName="limitador" Jun 11 15:01:21.782809 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.782783 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg" Jun 11 15:01:21.786265 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.786246 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 11 15:01:21.786265 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.786258 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 11 15:01:21.787546 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.787524 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-ssrxf\"" Jun 11 15:01:21.787638 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.787544 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 11 15:01:21.792585 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.792561 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg"] Jun 11 15:01:21.834689 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.834652 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhrgs\" (UniqueName: \"kubernetes.io/projected/2770bbc5-9201-492c-82c0-d97874ec44f4-kube-api-access-jhrgs\") pod \"postgres-69fb4594cf-ghvpg\" (UID: \"2770bbc5-9201-492c-82c0-d97874ec44f4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg" Jun 11 15:01:21.834864 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.834698 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2770bbc5-9201-492c-82c0-d97874ec44f4-data\") pod \"postgres-69fb4594cf-ghvpg\" (UID: \"2770bbc5-9201-492c-82c0-d97874ec44f4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg" Jun 11 15:01:21.935759 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.935714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrgs\" (UniqueName: \"kubernetes.io/projected/2770bbc5-9201-492c-82c0-d97874ec44f4-kube-api-access-jhrgs\") pod \"postgres-69fb4594cf-ghvpg\" (UID: \"2770bbc5-9201-492c-82c0-d97874ec44f4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg" Jun 11 15:01:21.935759 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.935767 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2770bbc5-9201-492c-82c0-d97874ec44f4-data\") pod \"postgres-69fb4594cf-ghvpg\" (UID: \"2770bbc5-9201-492c-82c0-d97874ec44f4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg" Jun 11 15:01:21.936120 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.936104 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2770bbc5-9201-492c-82c0-d97874ec44f4-data\") pod \"postgres-69fb4594cf-ghvpg\" (UID: \"2770bbc5-9201-492c-82c0-d97874ec44f4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg" Jun 11 15:01:21.944846 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:21.944811 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhrgs\" (UniqueName: \"kubernetes.io/projected/2770bbc5-9201-492c-82c0-d97874ec44f4-kube-api-access-jhrgs\") pod \"postgres-69fb4594cf-ghvpg\" (UID: \"2770bbc5-9201-492c-82c0-d97874ec44f4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg" Jun 11 15:01:22.094374 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:22.094290 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg" Jun 11 15:01:22.233447 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:22.233416 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg"] Jun 11 15:01:22.235110 ip-10-0-135-91 kubenswrapper[2574]: W0611 15:01:22.235086 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2770bbc5_9201_492c_82c0_d97874ec44f4.slice/crio-72b8ce1d2c1ae2b65f4b0b19bef6b935bd31de1cd479f321684e6df8ff62c4d2 WatchSource:0}: Error finding container 72b8ce1d2c1ae2b65f4b0b19bef6b935bd31de1cd479f321684e6df8ff62c4d2: Status 404 returned error can't find the container with id 72b8ce1d2c1ae2b65f4b0b19bef6b935bd31de1cd479f321684e6df8ff62c4d2 Jun 11 15:01:23.195685 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:23.195650 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg" event={"ID":"2770bbc5-9201-492c-82c0-d97874ec44f4","Type":"ContainerStarted","Data":"72b8ce1d2c1ae2b65f4b0b19bef6b935bd31de1cd479f321684e6df8ff62c4d2"} Jun 11 15:01:25.208731 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:25.208688 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg" event={"ID":"2770bbc5-9201-492c-82c0-d97874ec44f4","Type":"ContainerStarted","Data":"1901d6e395ae3e3ca050c8bf4c38229cd4aa0d587ae0ecff433850eabda3078b"} Jun 11 15:01:25.209140 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:25.208920 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg" Jun 11 15:01:25.227184 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:25.227137 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg" podStartSLOduration=1.9411599210000001 podStartE2EDuration="4.227122297s" totalImagesPullingTime="2.285962376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:01:25.224720837 +0000 UTC m=+664.482972256" watchObservedRunningTime="2026-06-11 15:01:25.227122297 +0000 UTC m=+664.485373690" Jun 11 15:01:31.244128 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:31.244093 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-ghvpg" Jun 11 15:01:32.974225 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:32.974189 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk"] Jun 11 15:01:32.979133 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:32.979112 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" Jun 11 15:01:32.981942 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:32.981911 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 15:01:32.981942 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:32.981911 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gb8nl\"" Jun 11 15:01:32.983412 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:32.983396 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 15:01:32.987764 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:32.987740 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk"] Jun 11 15:01:33.023536 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:33.023501 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98176bd2-227f-4d69-89ee-c8e32b0f3003-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk\" (UID: \"98176bd2-227f-4d69-89ee-c8e32b0f3003\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" Jun 11 15:01:33.023536 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:33.023537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98176bd2-227f-4d69-89ee-c8e32b0f3003-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk\" (UID: \"98176bd2-227f-4d69-89ee-c8e32b0f3003\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" Jun 11 15:01:33.023743 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:33.023615 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxk7f\" (UniqueName: \"kubernetes.io/projected/98176bd2-227f-4d69-89ee-c8e32b0f3003-kube-api-access-sxk7f\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk\" (UID: \"98176bd2-227f-4d69-89ee-c8e32b0f3003\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" Jun 11 15:01:33.124703 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:33.124664 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98176bd2-227f-4d69-89ee-c8e32b0f3003-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk\" (UID: \"98176bd2-227f-4d69-89ee-c8e32b0f3003\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" Jun 11 15:01:33.124703 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:33.124706 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98176bd2-227f-4d69-89ee-c8e32b0f3003-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk\" (UID: \"98176bd2-227f-4d69-89ee-c8e32b0f3003\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" Jun 11 15:01:33.124894 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:33.124767 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxk7f\" (UniqueName: \"kubernetes.io/projected/98176bd2-227f-4d69-89ee-c8e32b0f3003-kube-api-access-sxk7f\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk\" (UID: \"98176bd2-227f-4d69-89ee-c8e32b0f3003\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" Jun 11 15:01:33.125166 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:33.125143 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98176bd2-227f-4d69-89ee-c8e32b0f3003-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk\" (UID: \"98176bd2-227f-4d69-89ee-c8e32b0f3003\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" Jun 11 15:01:33.125222 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:33.125151 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98176bd2-227f-4d69-89ee-c8e32b0f3003-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk\" (UID: \"98176bd2-227f-4d69-89ee-c8e32b0f3003\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" Jun 11 15:01:33.134184 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:33.134159 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxk7f\" (UniqueName: \"kubernetes.io/projected/98176bd2-227f-4d69-89ee-c8e32b0f3003-kube-api-access-sxk7f\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk\" (UID: \"98176bd2-227f-4d69-89ee-c8e32b0f3003\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" Jun 11 15:01:33.289356 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:33.289271 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" Jun 11 15:01:33.426366 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:33.426339 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk"] Jun 11 15:01:33.428207 ip-10-0-135-91 kubenswrapper[2574]: W0611 15:01:33.428180 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98176bd2_227f_4d69_89ee_c8e32b0f3003.slice/crio-a1875c2e61d89cefc5008e08adb7d24d26f7b18f3e2486e62a49488b8b6f7788 WatchSource:0}: Error finding container a1875c2e61d89cefc5008e08adb7d24d26f7b18f3e2486e62a49488b8b6f7788: Status 404 returned error can't find the container with id a1875c2e61d89cefc5008e08adb7d24d26f7b18f3e2486e62a49488b8b6f7788 Jun 11 15:01:34.268383 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:34.268350 2574 generic.go:356] "Generic (PLEG): container finished" podID="98176bd2-227f-4d69-89ee-c8e32b0f3003" containerID="95407925d490e13c41113932ebcc3b3c0063b7790b9c534a5db8cffc2aa7d58a" exitCode=0 Jun 11 15:01:34.268751 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:34.268437 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" event={"ID":"98176bd2-227f-4d69-89ee-c8e32b0f3003","Type":"ContainerDied","Data":"95407925d490e13c41113932ebcc3b3c0063b7790b9c534a5db8cffc2aa7d58a"} Jun 11 15:01:34.268751 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:34.268511 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" event={"ID":"98176bd2-227f-4d69-89ee-c8e32b0f3003","Type":"ContainerStarted","Data":"a1875c2e61d89cefc5008e08adb7d24d26f7b18f3e2486e62a49488b8b6f7788"} Jun 11 15:01:35.275945 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:35.275912 2574 generic.go:356] "Generic (PLEG): container finished" podID="98176bd2-227f-4d69-89ee-c8e32b0f3003" containerID="e94317136812983766a3a4421a483bcf459868c30dcdf5175b143ac3e06a682e" exitCode=0 Jun 11 15:01:35.276332 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:35.275973 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" event={"ID":"98176bd2-227f-4d69-89ee-c8e32b0f3003","Type":"ContainerDied","Data":"e94317136812983766a3a4421a483bcf459868c30dcdf5175b143ac3e06a682e"} Jun 11 15:01:36.284726 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:36.284678 2574 generic.go:356] "Generic (PLEG): container finished" podID="98176bd2-227f-4d69-89ee-c8e32b0f3003" containerID="8556c0b7ab670616c29ef4a45c0f58c7699cbe8a6f00d496194a6ca7a9e0cc7f" exitCode=0 Jun 11 15:01:36.285117 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:36.284766 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" event={"ID":"98176bd2-227f-4d69-89ee-c8e32b0f3003","Type":"ContainerDied","Data":"8556c0b7ab670616c29ef4a45c0f58c7699cbe8a6f00d496194a6ca7a9e0cc7f"} Jun 11 15:01:37.491991 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:37.491958 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" Jun 11 15:01:37.562395 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:37.562314 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxk7f\" (UniqueName: \"kubernetes.io/projected/98176bd2-227f-4d69-89ee-c8e32b0f3003-kube-api-access-sxk7f\") pod \"98176bd2-227f-4d69-89ee-c8e32b0f3003\" (UID: \"98176bd2-227f-4d69-89ee-c8e32b0f3003\") " Jun 11 15:01:37.562395 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:37.562388 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98176bd2-227f-4d69-89ee-c8e32b0f3003-util\") pod \"98176bd2-227f-4d69-89ee-c8e32b0f3003\" (UID: \"98176bd2-227f-4d69-89ee-c8e32b0f3003\") " Jun 11 15:01:37.562630 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:37.562439 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98176bd2-227f-4d69-89ee-c8e32b0f3003-bundle\") pod \"98176bd2-227f-4d69-89ee-c8e32b0f3003\" (UID: \"98176bd2-227f-4d69-89ee-c8e32b0f3003\") " Jun 11 15:01:37.562904 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:37.562879 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98176bd2-227f-4d69-89ee-c8e32b0f3003-bundle" (OuterVolumeSpecName: "bundle") pod "98176bd2-227f-4d69-89ee-c8e32b0f3003" (UID: "98176bd2-227f-4d69-89ee-c8e32b0f3003"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:01:37.564406 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:37.564384 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98176bd2-227f-4d69-89ee-c8e32b0f3003-kube-api-access-sxk7f" (OuterVolumeSpecName: "kube-api-access-sxk7f") pod "98176bd2-227f-4d69-89ee-c8e32b0f3003" (UID: "98176bd2-227f-4d69-89ee-c8e32b0f3003"). InnerVolumeSpecName "kube-api-access-sxk7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:01:37.568106 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:37.568068 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98176bd2-227f-4d69-89ee-c8e32b0f3003-util" (OuterVolumeSpecName: "util") pod "98176bd2-227f-4d69-89ee-c8e32b0f3003" (UID: "98176bd2-227f-4d69-89ee-c8e32b0f3003"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:01:37.662928 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:37.662891 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98176bd2-227f-4d69-89ee-c8e32b0f3003-util\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 15:01:37.662928 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:37.662921 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98176bd2-227f-4d69-89ee-c8e32b0f3003-bundle\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 15:01:37.662928 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:37.662933 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxk7f\" (UniqueName: \"kubernetes.io/projected/98176bd2-227f-4d69-89ee-c8e32b0f3003-kube-api-access-sxk7f\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 15:01:38.296799 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:38.296770 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" Jun 11 15:01:38.296995 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:38.296809 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wd5mk" event={"ID":"98176bd2-227f-4d69-89ee-c8e32b0f3003","Type":"ContainerDied","Data":"a1875c2e61d89cefc5008e08adb7d24d26f7b18f3e2486e62a49488b8b6f7788"} Jun 11 15:01:38.296995 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:38.296853 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1875c2e61d89cefc5008e08adb7d24d26f7b18f3e2486e62a49488b8b6f7788" Jun 11 15:01:40.989977 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:40.989946 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-4qkw5"] Jun 11 15:01:40.990371 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:40.990277 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98176bd2-227f-4d69-89ee-c8e32b0f3003" containerName="util" Jun 11 15:01:40.990371 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:40.990289 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="98176bd2-227f-4d69-89ee-c8e32b0f3003" containerName="util" Jun 11 15:01:40.990371 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:40.990304 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98176bd2-227f-4d69-89ee-c8e32b0f3003" containerName="extract" Jun 11 15:01:40.990371 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:40.990309 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="98176bd2-227f-4d69-89ee-c8e32b0f3003" containerName="extract" Jun 11 15:01:40.990371 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:40.990321 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98176bd2-227f-4d69-89ee-c8e32b0f3003" containerName="pull" Jun 11 15:01:40.990371 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:40.990326 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="98176bd2-227f-4d69-89ee-c8e32b0f3003" containerName="pull" Jun 11 15:01:40.990593 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:40.990381 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="98176bd2-227f-4d69-89ee-c8e32b0f3003" containerName="extract" Jun 11 15:01:40.992536 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:40.992511 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-4qkw5" Jun 11 15:01:40.995945 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:40.995926 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 15:01:40.997173 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:40.997149 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 15:01:40.997261 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:40.997231 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-nvt4k\"" Jun 11 15:01:41.005274 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:41.005254 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-4qkw5"] Jun 11 15:01:41.093311 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:41.093279 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw82p\" (UniqueName: \"kubernetes.io/projected/38f85792-7712-4f6a-9c9a-3d4bcdad8bd8-kube-api-access-mw82p\") pod \"keycloak-operator-d67dbbb48-4qkw5\" (UID: \"38f85792-7712-4f6a-9c9a-3d4bcdad8bd8\") " pod="keycloak-system/keycloak-operator-d67dbbb48-4qkw5" Jun 11 15:01:41.194083 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:41.194052 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw82p\" (UniqueName: \"kubernetes.io/projected/38f85792-7712-4f6a-9c9a-3d4bcdad8bd8-kube-api-access-mw82p\") pod \"keycloak-operator-d67dbbb48-4qkw5\" (UID: \"38f85792-7712-4f6a-9c9a-3d4bcdad8bd8\") " pod="keycloak-system/keycloak-operator-d67dbbb48-4qkw5" Jun 11 15:01:41.203684 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:41.203663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw82p\" (UniqueName: \"kubernetes.io/projected/38f85792-7712-4f6a-9c9a-3d4bcdad8bd8-kube-api-access-mw82p\") pod \"keycloak-operator-d67dbbb48-4qkw5\" (UID: \"38f85792-7712-4f6a-9c9a-3d4bcdad8bd8\") " pod="keycloak-system/keycloak-operator-d67dbbb48-4qkw5" Jun 11 15:01:41.302971 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:41.302888 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-4qkw5" Jun 11 15:01:41.438386 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:41.438354 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-4qkw5"] Jun 11 15:01:41.442372 ip-10-0-135-91 kubenswrapper[2574]: W0611 15:01:41.442343 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f85792_7712_4f6a_9c9a_3d4bcdad8bd8.slice/crio-40abb2692fe835fa2ed102850080789bda3503423e64708877d0dc0404ac796c WatchSource:0}: Error finding container 40abb2692fe835fa2ed102850080789bda3503423e64708877d0dc0404ac796c: Status 404 returned error can't find the container with id 40abb2692fe835fa2ed102850080789bda3503423e64708877d0dc0404ac796c Jun 11 15:01:41.443893 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:41.443874 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:01:42.322361 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:42.322321 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-4qkw5" event={"ID":"38f85792-7712-4f6a-9c9a-3d4bcdad8bd8","Type":"ContainerStarted","Data":"40abb2692fe835fa2ed102850080789bda3503423e64708877d0dc0404ac796c"} Jun 11 15:01:48.367115 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:48.366997 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-4qkw5" event={"ID":"38f85792-7712-4f6a-9c9a-3d4bcdad8bd8","Type":"ContainerStarted","Data":"58e4d49aec761dcef38ef37e324dd77b78cd8c70f397d69ea44b284d08cbf652"} Jun 11 15:01:48.387561 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:01:48.387512 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-4qkw5" podStartSLOduration=1.903724403 podStartE2EDuration="8.387498402s" totalImagesPullingTime="6.483773999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:01:48.385711041 +0000 UTC m=+687.643962431" watchObservedRunningTime="2026-06-11 15:01:48.387498402 +0000 UTC m=+687.645749857" Jun 11 15:03:09.340055 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:03:09.340017 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:04:16.712647 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:04:16.712611 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:04:25.296930 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:04:25.296898 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:04:33.110112 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:04:33.110077 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:04:57.399577 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:04:57.399541 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:05:01.701651 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:05:01.701613 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:05:07.614134 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:05:07.614098 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:05:21.175291 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:05:21.175214 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 15:05:21.177364 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:05:21.177339 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 15:08:31.015241 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:08:31.015195 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:08:41.307836 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:08:41.307801 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:08:50.251236 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:08:50.251201 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:09:01.307177 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:09:01.307141 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:09:09.712888 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:09:09.712853 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:09:20.646376 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:09:20.646335 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:09:53.399559 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:09:53.399472 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:09:57.843173 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:09:57.843135 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:10:21.221398 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:10:21.221368 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 15:10:21.224686 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:10:21.224664 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 15:10:37.034235 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:10:37.034197 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:10:52.384899 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:10:52.384868 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:11:32.216994 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:11:32.216954 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:11:48.712088 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:11:48.712053 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:12:03.711200 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:12:03.711167 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:12:20.009916 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:12:20.009877 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:13:21.506363 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:13:21.506329 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:13:30.406827 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:13:30.406795 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:13:47.307635 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:13:47.307597 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:13:55.718886 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:13:55.718848 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:14:13.204754 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:14:13.204669 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:14:21.907216 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:14:21.907180 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:14:54.201783 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:14:54.201751 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:15:00.149376 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:00.149333 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv"] Jun 11 15:15:00.152738 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:00.152712 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv" Jun 11 15:15:00.156103 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:00.156088 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-9x28t\"" Jun 11 15:15:00.166877 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:00.166842 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv"] Jun 11 15:15:00.173429 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:00.173404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqksr\" (UniqueName: \"kubernetes.io/projected/45d74476-d18c-47b8-9961-b23253abd135-kube-api-access-gqksr\") pod \"maas-api-key-cleanup-29686515-fj7qv\" (UID: \"45d74476-d18c-47b8-9961-b23253abd135\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv" Jun 11 15:15:00.274237 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:00.274206 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqksr\" (UniqueName: \"kubernetes.io/projected/45d74476-d18c-47b8-9961-b23253abd135-kube-api-access-gqksr\") pod \"maas-api-key-cleanup-29686515-fj7qv\" (UID: \"45d74476-d18c-47b8-9961-b23253abd135\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv" Jun 11 15:15:00.283355 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:00.283330 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqksr\" (UniqueName: \"kubernetes.io/projected/45d74476-d18c-47b8-9961-b23253abd135-kube-api-access-gqksr\") pod \"maas-api-key-cleanup-29686515-fj7qv\" (UID: \"45d74476-d18c-47b8-9961-b23253abd135\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv" Jun 11 15:15:00.462154 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:00.462126 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv" Jun 11 15:15:00.600802 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:00.600763 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv"] Jun 11 15:15:00.603443 ip-10-0-135-91 kubenswrapper[2574]: W0611 15:15:00.603413 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d74476_d18c_47b8_9961_b23253abd135.slice/crio-5e00d5b673534a3ba64f6e1f879e069d724c13310d04bf91c4cc908478ec68b8 WatchSource:0}: Error finding container 5e00d5b673534a3ba64f6e1f879e069d724c13310d04bf91c4cc908478ec68b8: Status 404 returned error can't find the container with id 5e00d5b673534a3ba64f6e1f879e069d724c13310d04bf91c4cc908478ec68b8 Jun 11 15:15:00.605264 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:00.605245 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:15:00.644261 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:00.644231 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv" event={"ID":"45d74476-d18c-47b8-9961-b23253abd135","Type":"ContainerStarted","Data":"5e00d5b673534a3ba64f6e1f879e069d724c13310d04bf91c4cc908478ec68b8"} Jun 11 15:15:02.906621 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:02.906586 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:15:04.670399 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:04.670356 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv" event={"ID":"45d74476-d18c-47b8-9961-b23253abd135","Type":"ContainerStarted","Data":"d382d843e5dd78ac730c68e0d6acab257167b914fd6e26831d165bf1fc519124"} Jun 11 15:15:04.688557 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:04.688501 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv" podStartSLOduration=1.5800149220000002 podStartE2EDuration="4.688487592s" totalImagesPullingTime="3.10847267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:15:04.686254565 +0000 UTC m=+1483.944505968" watchObservedRunningTime="2026-06-11 15:15:04.688487592 +0000 UTC m=+1483.946738982" Jun 11 15:15:11.007453 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:11.007417 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:15:19.605119 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:19.605083 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:15:21.262898 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:21.262871 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 15:15:21.267193 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:21.267173 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 15:15:27.904611 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:27.904572 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:15:36.507999 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:36.507961 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:15:40.495185 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:40.495155 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:15:53.398522 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:15:53.398486 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:16:00.011617 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:00.011582 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv"] Jun 11 15:16:00.012124 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:00.011765 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv" podUID="45d74476-d18c-47b8-9961-b23253abd135" containerName="cleanup" containerID="cri-o://d382d843e5dd78ac730c68e0d6acab257167b914fd6e26831d165bf1fc519124" gracePeriod=30 Jun 11 15:16:07.306265 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:07.306226 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:16:30.146345 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:30.146314 2574 generic.go:356] "Generic (PLEG): container finished" podID="45d74476-d18c-47b8-9961-b23253abd135" containerID="d382d843e5dd78ac730c68e0d6acab257167b914fd6e26831d165bf1fc519124" exitCode=137 Jun 11 15:16:30.146661 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:30.146352 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv" event={"ID":"45d74476-d18c-47b8-9961-b23253abd135","Type":"ContainerDied","Data":"d382d843e5dd78ac730c68e0d6acab257167b914fd6e26831d165bf1fc519124"} Jun 11 15:16:30.200596 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:30.200571 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv" Jun 11 15:16:30.353124 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:30.353039 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqksr\" (UniqueName: \"kubernetes.io/projected/45d74476-d18c-47b8-9961-b23253abd135-kube-api-access-gqksr\") pod \"45d74476-d18c-47b8-9961-b23253abd135\" (UID: \"45d74476-d18c-47b8-9961-b23253abd135\") " Jun 11 15:16:30.355183 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:30.355158 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d74476-d18c-47b8-9961-b23253abd135-kube-api-access-gqksr" (OuterVolumeSpecName: "kube-api-access-gqksr") pod "45d74476-d18c-47b8-9961-b23253abd135" (UID: "45d74476-d18c-47b8-9961-b23253abd135"). InnerVolumeSpecName "kube-api-access-gqksr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:16:30.454350 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:30.454302 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqksr\" (UniqueName: \"kubernetes.io/projected/45d74476-d18c-47b8-9961-b23253abd135-kube-api-access-gqksr\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 15:16:31.152883 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:31.152852 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv" event={"ID":"45d74476-d18c-47b8-9961-b23253abd135","Type":"ContainerDied","Data":"5e00d5b673534a3ba64f6e1f879e069d724c13310d04bf91c4cc908478ec68b8"} Jun 11 15:16:31.153423 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:31.152887 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv" Jun 11 15:16:31.153423 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:31.152912 2574 scope.go:117] "RemoveContainer" containerID="d382d843e5dd78ac730c68e0d6acab257167b914fd6e26831d165bf1fc519124" Jun 11 15:16:31.175656 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:31.175630 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv"] Jun 11 15:16:31.182747 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:31.182728 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686515-fj7qv"] Jun 11 15:16:33.181954 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:33.181916 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45d74476-d18c-47b8-9961-b23253abd135" path="/var/lib/kubelet/pods/45d74476-d18c-47b8-9961-b23253abd135/volumes" Jun 11 15:16:35.708825 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:35.708791 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:16:38.410096 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:38.410065 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:16:55.207193 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:16:55.207159 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:17:03.000245 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:17:03.000209 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:17:22.103131 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:17:22.103098 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:17:27.009072 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:17:27.009037 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:17:30.706177 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:17:30.706141 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:17:39.810056 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:17:39.810018 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:17:48.615924 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:17:48.615889 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:17:57.500037 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:17:57.499987 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:18:06.205894 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:18:06.205858 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:18:15.228607 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:18:15.228570 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:18:23.706872 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:18:23.706831 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:18:32.199311 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:18:32.199279 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:18:41.000504 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:18:41.000418 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:18:51.510042 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:18:51.509989 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:18:56.300795 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:18:56.300764 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:20:21.299603 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:20:21.299576 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 15:20:21.304592 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:20:21.304574 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 15:21:38.897733 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:21:38.897695 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:22:00.699862 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:22:00.699825 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:22:27.607131 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:22:27.607097 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:22:32.202163 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:22:32.202125 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:22:39.702716 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:22:39.702680 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:22:49.504579 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:22:49.504543 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:22:59.002122 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:22:59.002085 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:23:09.897355 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:23:09.897321 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:23:20.303768 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:23:20.303695 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:23:29.105931 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:23:29.105896 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:23:38.623489 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:23:38.623454 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:23:49.800184 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:23:49.800140 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:23:58.803414 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:23:58.803374 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:24:03.801248 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:24:03.801216 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:24:31.904536 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:24:31.904497 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:25:15.104016 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:25:15.103925 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:25:21.337120 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:25:21.337088 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 15:25:21.342923 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:25:21.342899 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 15:25:23.611150 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:25:23.611115 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:25:32.103902 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:25:32.103862 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:25:40.920555 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:25:40.920523 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:25:48.809929 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:25:48.809894 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:25:59.897714 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:25:59.897680 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:26:08.808546 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:26:08.808508 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:26:14.303146 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:26:14.303068 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:26:21.503219 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:26:21.503176 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:26:29.307745 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:26:29.307709 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:26:37.739822 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:26:37.739784 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:26:48.297624 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:26:48.297590 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:27:06.309967 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:27:06.309926 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:27:15.001990 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:27:15.001953 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:27:23.703197 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:27:23.703164 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:27:32.294996 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:27:32.294961 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:27:49.308126 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:27:49.308042 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:27:57.115251 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:27:57.115220 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:28:06.403496 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:28:06.403459 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:28:14.302311 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:28:14.302277 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:28:23.605586 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:28:23.605554 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:28:32.608957 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:28:32.608915 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:28:41.099944 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:28:41.099912 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:28:52.008290 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:28:52.008256 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:29:01.300282 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:29:01.300246 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:29:12.297805 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:29:12.297723 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:29:21.502425 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:29:21.502390 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:29:27.043659 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:29:27.043615 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:29:33.806615 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:29:33.806580 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:29:39.808809 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:29:39.808765 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:29:53.998367 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:29:53.998332 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:30:00.140642 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:00.140606 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx"] Jun 11 15:30:00.141086 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:00.140930 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d74476-d18c-47b8-9961-b23253abd135" containerName="cleanup" Jun 11 15:30:00.141086 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:00.140940 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d74476-d18c-47b8-9961-b23253abd135" containerName="cleanup" Jun 11 15:30:00.141086 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:00.141026 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="45d74476-d18c-47b8-9961-b23253abd135" containerName="cleanup" Jun 11 15:30:00.142801 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:00.142784 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx" Jun 11 15:30:00.145781 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:00.145758 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-9x28t\"" Jun 11 15:30:00.160351 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:00.160329 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx"] Jun 11 15:30:00.254317 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:00.254277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc68t\" (UniqueName: \"kubernetes.io/projected/f5c82704-a859-4fb4-bf07-15871aab659b-kube-api-access-xc68t\") pod \"maas-api-key-cleanup-29686530-vgczx\" (UID: \"f5c82704-a859-4fb4-bf07-15871aab659b\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx" Jun 11 15:30:00.355660 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:00.355602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc68t\" (UniqueName: \"kubernetes.io/projected/f5c82704-a859-4fb4-bf07-15871aab659b-kube-api-access-xc68t\") pod \"maas-api-key-cleanup-29686530-vgczx\" (UID: \"f5c82704-a859-4fb4-bf07-15871aab659b\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx" Jun 11 15:30:00.365656 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:00.365629 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc68t\" (UniqueName: \"kubernetes.io/projected/f5c82704-a859-4fb4-bf07-15871aab659b-kube-api-access-xc68t\") pod \"maas-api-key-cleanup-29686530-vgczx\" (UID: \"f5c82704-a859-4fb4-bf07-15871aab659b\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx" Jun 11 15:30:00.452945 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:00.452910 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx" Jun 11 15:30:00.587960 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:00.587937 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx"] Jun 11 15:30:00.590271 ip-10-0-135-91 kubenswrapper[2574]: W0611 15:30:00.590240 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c82704_a859_4fb4_bf07_15871aab659b.slice/crio-55c49148378dc4050bdefcf1dfb38c300e2e60a4d4b6b38467a25f37a06ef22f WatchSource:0}: Error finding container 55c49148378dc4050bdefcf1dfb38c300e2e60a4d4b6b38467a25f37a06ef22f: Status 404 returned error can't find the container with id 55c49148378dc4050bdefcf1dfb38c300e2e60a4d4b6b38467a25f37a06ef22f Jun 11 15:30:01.508375 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:01.508341 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx" event={"ID":"f5c82704-a859-4fb4-bf07-15871aab659b","Type":"ContainerStarted","Data":"0913ab38e4f1a469e521030ce9b54e5e37483726e7eaab7859622c013e0668a8"} Jun 11 15:30:01.508802 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:01.508392 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx" event={"ID":"f5c82704-a859-4fb4-bf07-15871aab659b","Type":"ContainerStarted","Data":"55c49148378dc4050bdefcf1dfb38c300e2e60a4d4b6b38467a25f37a06ef22f"} Jun 11 15:30:01.526165 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:01.526120 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx" podStartSLOduration=1.526105948 podStartE2EDuration="1.526105948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:30:01.522964291 +0000 UTC m=+2380.781215683" watchObservedRunningTime="2026-06-11 15:30:01.526105948 +0000 UTC m=+2380.784357339" Jun 11 15:30:02.701680 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:02.701642 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:30:12.104059 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:12.103998 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:30:18.609061 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:18.609030 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:30:21.371706 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:21.371676 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 15:30:21.379208 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:21.379186 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9j5j_8f20bd10-741c-44e0-96a4-16da9d9b73e5/ovn-acl-logging/0.log" Jun 11 15:30:42.028444 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:42.028371 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:30:54.209501 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:30:54.209458 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmgcf"] Jun 11 15:31:00.011536 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:00.011505 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx"] Jun 11 15:31:00.011934 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:00.011699 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx" podUID="f5c82704-a859-4fb4-bf07-15871aab659b" containerName="cleanup" containerID="cri-o://0913ab38e4f1a469e521030ce9b54e5e37483726e7eaab7859622c013e0668a8" gracePeriod=30 Jun 11 15:31:30.192077 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:30.192052 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx" Jun 11 15:31:30.319764 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:30.319671 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc68t\" (UniqueName: \"kubernetes.io/projected/f5c82704-a859-4fb4-bf07-15871aab659b-kube-api-access-xc68t\") pod \"f5c82704-a859-4fb4-bf07-15871aab659b\" (UID: \"f5c82704-a859-4fb4-bf07-15871aab659b\") " Jun 11 15:31:30.321743 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:30.321713 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5c82704-a859-4fb4-bf07-15871aab659b-kube-api-access-xc68t" (OuterVolumeSpecName: "kube-api-access-xc68t") pod "f5c82704-a859-4fb4-bf07-15871aab659b" (UID: "f5c82704-a859-4fb4-bf07-15871aab659b"). InnerVolumeSpecName "kube-api-access-xc68t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:31:30.420297 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:30.420260 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc68t\" (UniqueName: \"kubernetes.io/projected/f5c82704-a859-4fb4-bf07-15871aab659b-kube-api-access-xc68t\") on node \"ip-10-0-135-91.ec2.internal\" DevicePath \"\"" Jun 11 15:31:30.997354 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:30.997317 2574 generic.go:356] "Generic (PLEG): container finished" podID="f5c82704-a859-4fb4-bf07-15871aab659b" containerID="0913ab38e4f1a469e521030ce9b54e5e37483726e7eaab7859622c013e0668a8" exitCode=137 Jun 11 15:31:30.997547 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:30.997372 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx" Jun 11 15:31:30.997547 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:30.997401 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx" event={"ID":"f5c82704-a859-4fb4-bf07-15871aab659b","Type":"ContainerDied","Data":"0913ab38e4f1a469e521030ce9b54e5e37483726e7eaab7859622c013e0668a8"} Jun 11 15:31:30.997547 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:30.997477 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx" event={"ID":"f5c82704-a859-4fb4-bf07-15871aab659b","Type":"ContainerDied","Data":"55c49148378dc4050bdefcf1dfb38c300e2e60a4d4b6b38467a25f37a06ef22f"} Jun 11 15:31:30.997547 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:30.997500 2574 scope.go:117] "RemoveContainer" containerID="0913ab38e4f1a469e521030ce9b54e5e37483726e7eaab7859622c013e0668a8" Jun 11 15:31:31.006500 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:31.006483 2574 scope.go:117] "RemoveContainer" containerID="0913ab38e4f1a469e521030ce9b54e5e37483726e7eaab7859622c013e0668a8" Jun 11 15:31:31.006763 ip-10-0-135-91 kubenswrapper[2574]: E0611 15:31:31.006743 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0913ab38e4f1a469e521030ce9b54e5e37483726e7eaab7859622c013e0668a8\": container with ID starting with 0913ab38e4f1a469e521030ce9b54e5e37483726e7eaab7859622c013e0668a8 not found: ID does not exist" containerID="0913ab38e4f1a469e521030ce9b54e5e37483726e7eaab7859622c013e0668a8" Jun 11 15:31:31.006813 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:31.006772 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0913ab38e4f1a469e521030ce9b54e5e37483726e7eaab7859622c013e0668a8"} err="failed to get container status \"0913ab38e4f1a469e521030ce9b54e5e37483726e7eaab7859622c013e0668a8\": rpc error: code = NotFound desc = could not find container \"0913ab38e4f1a469e521030ce9b54e5e37483726e7eaab7859622c013e0668a8\": container with ID starting with 0913ab38e4f1a469e521030ce9b54e5e37483726e7eaab7859622c013e0668a8 not found: ID does not exist" Jun 11 15:31:31.020088 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:31.020065 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx"] Jun 11 15:31:31.023705 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:31.023677 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686530-vgczx"] Jun 11 15:31:31.181685 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:31.181653 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5c82704-a859-4fb4-bf07-15871aab659b" path="/var/lib/kubelet/pods/f5c82704-a859-4fb4-bf07-15871aab659b/volumes" Jun 11 15:31:32.312466 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:32.312437 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-79f6976fb4-mp297_4ec0e07e-ff92-4211-9081-a1fad41c417e/nginx/0.log" Jun 11 15:31:32.423868 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:32.423839 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-8hct7_113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d/manager/0.log" Jun 11 15:31:32.545532 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:32.545503 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-4kvvm_9b40a52f-90a6-4ddf-a537-257e361515a8/manager/0.log" Jun 11 15:31:32.782600 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:32.782574 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-xzb8h_3ef8c9bb-489a-446a-aa09-7a82646bb137/server/0.log" Jun 11 15:31:33.141463 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:33.141386 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58897f8c7f-m54rf_63daf9d7-8f0e-4182-acdd-9089813e3e58/copy-manifests/0.log" Jun 11 15:31:33.148812 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:33.148788 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58897f8c7f-m54rf_63daf9d7-8f0e-4182-acdd-9089813e3e58/manager/0.log" Jun 11 15:31:34.024331 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:34.024300 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6_b15ba50f-eee7-460f-87cc-2d7319ed0968/util/0.log" Jun 11 15:31:34.031278 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:34.031249 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6_b15ba50f-eee7-460f-87cc-2d7319ed0968/pull/0.log" Jun 11 15:31:34.038169 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:34.038146 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6_b15ba50f-eee7-460f-87cc-2d7319ed0968/extract/0.log" Jun 11 15:31:34.152740 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:34.152709 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf_56e1ab7a-c840-46e8-81d7-9f0824035a95/util/0.log" Jun 11 15:31:34.159598 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:34.159572 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf_56e1ab7a-c840-46e8-81d7-9f0824035a95/pull/0.log" Jun 11 15:31:34.168307 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:34.168282 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf_56e1ab7a-c840-46e8-81d7-9f0824035a95/extract/0.log" Jun 11 15:31:34.276056 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:34.275957 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns_fda62c81-58b8-4723-8bb8-e85ebfd34395/util/0.log" Jun 11 15:31:34.282341 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:34.282318 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns_fda62c81-58b8-4723-8bb8-e85ebfd34395/pull/0.log" Jun 11 15:31:34.289533 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:34.289516 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns_fda62c81-58b8-4723-8bb8-e85ebfd34395/extract/0.log" Jun 11 15:31:34.400642 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:34.400612 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc_d221dfc2-e0ec-41a8-9988-c962aad3e43a/util/0.log" Jun 11 15:31:34.407247 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:34.407223 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc_d221dfc2-e0ec-41a8-9988-c962aad3e43a/pull/0.log" Jun 11 15:31:34.413339 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:34.413325 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc_d221dfc2-e0ec-41a8-9988-c962aad3e43a/extract/0.log" Jun 11 15:31:35.269858 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:35.269827 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xmgcf_9ed59afb-6922-4634-b364-26ad348d5019/limitador/0.log" Jun 11 15:31:35.867138 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:35.867112 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rng28_8a473d25-5523-4d11-ac80-ec861a6c9eb9/discovery/0.log" Jun 11 15:31:36.085886 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:36.085858 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb8d84687-vb9r5_7e200669-911a-4727-99ba-d0428def4e7f/kube-auth-proxy/0.log" Jun 11 15:31:41.945377 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:41.945339 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n5kp2/must-gather-gznxp"] Jun 11 15:31:41.945776 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:41.945683 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5c82704-a859-4fb4-bf07-15871aab659b" containerName="cleanup" Jun 11 15:31:41.945776 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:41.945694 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5c82704-a859-4fb4-bf07-15871aab659b" containerName="cleanup" Jun 11 15:31:41.945776 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:41.945767 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5c82704-a859-4fb4-bf07-15871aab659b" containerName="cleanup" Jun 11 15:31:41.948282 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:41.948252 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5kp2/must-gather-gznxp" Jun 11 15:31:41.951194 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:41.951172 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n5kp2\"/\"default-dockercfg-z27gt\"" Jun 11 15:31:41.951356 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:41.951336 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5kp2\"/\"openshift-service-ca.crt\"" Jun 11 15:31:41.951426 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:41.951410 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5kp2\"/\"kube-root-ca.crt\"" Jun 11 15:31:41.960782 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:41.960762 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5kp2/must-gather-gznxp"] Jun 11 15:31:42.026520 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:42.026488 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b97fb65c-b194-4781-9e75-90ff1ac105d8-must-gather-output\") pod \"must-gather-gznxp\" (UID: \"b97fb65c-b194-4781-9e75-90ff1ac105d8\") " pod="openshift-must-gather-n5kp2/must-gather-gznxp" Jun 11 15:31:42.026698 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:42.026554 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6scrg\" (UniqueName: \"kubernetes.io/projected/b97fb65c-b194-4781-9e75-90ff1ac105d8-kube-api-access-6scrg\") pod \"must-gather-gznxp\" (UID: \"b97fb65c-b194-4781-9e75-90ff1ac105d8\") " pod="openshift-must-gather-n5kp2/must-gather-gznxp" Jun 11 15:31:42.127653 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:42.127617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b97fb65c-b194-4781-9e75-90ff1ac105d8-must-gather-output\") pod \"must-gather-gznxp\" (UID: \"b97fb65c-b194-4781-9e75-90ff1ac105d8\") " pod="openshift-must-gather-n5kp2/must-gather-gznxp" Jun 11 15:31:42.127848 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:42.127667 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6scrg\" (UniqueName: \"kubernetes.io/projected/b97fb65c-b194-4781-9e75-90ff1ac105d8-kube-api-access-6scrg\") pod \"must-gather-gznxp\" (UID: \"b97fb65c-b194-4781-9e75-90ff1ac105d8\") " pod="openshift-must-gather-n5kp2/must-gather-gznxp" Jun 11 15:31:42.128096 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:42.128074 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b97fb65c-b194-4781-9e75-90ff1ac105d8-must-gather-output\") pod \"must-gather-gznxp\" (UID: \"b97fb65c-b194-4781-9e75-90ff1ac105d8\") " pod="openshift-must-gather-n5kp2/must-gather-gznxp" Jun 11 15:31:42.136879 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:42.136854 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6scrg\" (UniqueName: \"kubernetes.io/projected/b97fb65c-b194-4781-9e75-90ff1ac105d8-kube-api-access-6scrg\") pod \"must-gather-gznxp\" (UID: \"b97fb65c-b194-4781-9e75-90ff1ac105d8\") " pod="openshift-must-gather-n5kp2/must-gather-gznxp" Jun 11 15:31:42.257874 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:42.257786 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5kp2/must-gather-gznxp" Jun 11 15:31:42.393908 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:42.393881 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5kp2/must-gather-gznxp"] Jun 11 15:31:42.395845 ip-10-0-135-91 kubenswrapper[2574]: W0611 15:31:42.395811 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb97fb65c_b194_4781_9e75_90ff1ac105d8.slice/crio-5dd8784f47e483bd4e85c3beeab6961431a0f919bf9b3075665b572903d5a348 WatchSource:0}: Error finding container 5dd8784f47e483bd4e85c3beeab6961431a0f919bf9b3075665b572903d5a348: Status 404 returned error can't find the container with id 5dd8784f47e483bd4e85c3beeab6961431a0f919bf9b3075665b572903d5a348 Jun 11 15:31:42.397741 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:42.397718 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:31:43.063612 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:43.063570 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5kp2/must-gather-gznxp" event={"ID":"b97fb65c-b194-4781-9e75-90ff1ac105d8","Type":"ContainerStarted","Data":"5dd8784f47e483bd4e85c3beeab6961431a0f919bf9b3075665b572903d5a348"} Jun 11 15:31:44.076350 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:44.075458 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5kp2/must-gather-gznxp" event={"ID":"b97fb65c-b194-4781-9e75-90ff1ac105d8","Type":"ContainerStarted","Data":"cd47fdeed100de3bf86c490a6275b85a51fbd84e85b4b2e9bc8a8bf9ae891959"} Jun 11 15:31:44.076350 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:44.075516 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5kp2/must-gather-gznxp" event={"ID":"b97fb65c-b194-4781-9e75-90ff1ac105d8","Type":"ContainerStarted","Data":"7fac503e5f9461a9fd2daf9a3b5d7424b81c755f2be19d5e821b57bfeef8d169"} Jun 11 15:31:44.095200 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:44.095139 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n5kp2/must-gather-gznxp" podStartSLOduration=2.150667961 podStartE2EDuration="3.095116547s" totalImagesPullingTime="944.448586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:31:44.09175737 +0000 UTC m=+2483.350008761" watchObservedRunningTime="2026-06-11 15:31:44.095116547 +0000 UTC m=+2483.353367939" Jun 11 15:31:45.125991 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:45.125956 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w48cb_1adc9c7a-52c0-4ecb-840d-d21120723856/global-pull-secret-syncer/0.log" Jun 11 15:31:45.243225 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:45.243199 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nrjxq_57919709-f632-4be9-b9c0-3ec7c5996df9/konnectivity-agent/0.log" Jun 11 15:31:45.262797 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:45.262768 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-91.ec2.internal_499b78f6b57b020e19855dcaf8481477/haproxy/0.log" Jun 11 15:31:49.518746 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:49.518710 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-9nt6r_407a8502-b261-45a1-8472-72845e937f17/sail-operator/0.log" Jun 11 15:31:50.133950 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:50.133902 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6_b15ba50f-eee7-460f-87cc-2d7319ed0968/extract/0.log" Jun 11 15:31:50.160540 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:50.160504 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6_b15ba50f-eee7-460f-87cc-2d7319ed0968/util/0.log" Jun 11 15:31:50.196929 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:50.196893 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759twlt6_b15ba50f-eee7-460f-87cc-2d7319ed0968/pull/0.log" Jun 11 15:31:50.254344 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:50.254309 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf_56e1ab7a-c840-46e8-81d7-9f0824035a95/extract/0.log" Jun 11 15:31:50.287146 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:50.287117 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf_56e1ab7a-c840-46e8-81d7-9f0824035a95/util/0.log" Jun 11 15:31:50.312919 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:50.312874 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ct9gf_56e1ab7a-c840-46e8-81d7-9f0824035a95/pull/0.log" Jun 11 15:31:50.351870 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:50.351845 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns_fda62c81-58b8-4723-8bb8-e85ebfd34395/extract/0.log" Jun 11 15:31:50.377539 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:50.377515 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns_fda62c81-58b8-4723-8bb8-e85ebfd34395/util/0.log" Jun 11 15:31:50.402954 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:50.402847 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nm7ns_fda62c81-58b8-4723-8bb8-e85ebfd34395/pull/0.log" Jun 11 15:31:50.430744 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:50.430663 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc_d221dfc2-e0ec-41a8-9988-c962aad3e43a/extract/0.log" Jun 11 15:31:50.453284 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:50.453167 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc_d221dfc2-e0ec-41a8-9988-c962aad3e43a/util/0.log" Jun 11 15:31:50.488204 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:50.488166 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2bnc_d221dfc2-e0ec-41a8-9988-c962aad3e43a/pull/0.log" Jun 11 15:31:51.059293 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:51.059239 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xmgcf_9ed59afb-6922-4634-b364-26ad348d5019/limitador/0.log" Jun 11 15:31:52.659728 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:52.659697 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ff5bd8a-2072-4159-bbd5-d0221432c351/alertmanager/0.log" Jun 11 15:31:52.695167 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:52.695138 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ff5bd8a-2072-4159-bbd5-d0221432c351/config-reloader/0.log" Jun 11 15:31:52.722379 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:52.722348 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ff5bd8a-2072-4159-bbd5-d0221432c351/kube-rbac-proxy-web/0.log" Jun 11 15:31:52.752358 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:52.752325 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ff5bd8a-2072-4159-bbd5-d0221432c351/kube-rbac-proxy/0.log" Jun 11 15:31:52.780215 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:52.780163 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ff5bd8a-2072-4159-bbd5-d0221432c351/kube-rbac-proxy-metric/0.log" Jun 11 15:31:52.806480 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:52.806450 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ff5bd8a-2072-4159-bbd5-d0221432c351/prom-label-proxy/0.log" Jun 11 15:31:52.832410 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:52.832383 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ff5bd8a-2072-4159-bbd5-d0221432c351/init-config-reloader/0.log" Jun 11 15:31:53.163973 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:53.163946 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8fbl9_189a3961-82b1-4794-93a1-a24a5956e97a/node-exporter/0.log" Jun 11 15:31:53.189942 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:53.189920 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8fbl9_189a3961-82b1-4794-93a1-a24a5956e97a/kube-rbac-proxy/0.log" Jun 11 15:31:53.214889 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:53.214863 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8fbl9_189a3961-82b1-4794-93a1-a24a5956e97a/init-textfile/0.log" Jun 11 15:31:53.721388 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:53.721349 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-6fjl5_122731c6-9e8b-457f-8bbe-d66426542a4e/prometheus-operator-admission-webhook/0.log" Jun 11 15:31:56.428972 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.428930 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-chcbp_9d4b67b4-d967-44e6-9664-f9d89be8156d/download-server/0.log" Jun 11 15:31:56.461120 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.461083 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx"] Jun 11 15:31:56.467028 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.466982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.477726 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.476889 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx"] Jun 11 15:31:56.565579 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.565542 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53d2472b-32e2-4211-97c4-24411c4c2fa3-proc\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.565771 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.565612 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53d2472b-32e2-4211-97c4-24411c4c2fa3-lib-modules\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.565771 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.565661 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53d2472b-32e2-4211-97c4-24411c4c2fa3-sys\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.565771 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.565685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53d2472b-32e2-4211-97c4-24411c4c2fa3-podres\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.565771 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.565721 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2989\" (UniqueName: \"kubernetes.io/projected/53d2472b-32e2-4211-97c4-24411c4c2fa3-kube-api-access-j2989\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.666464 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.666426 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53d2472b-32e2-4211-97c4-24411c4c2fa3-lib-modules\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.666654 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.666488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53d2472b-32e2-4211-97c4-24411c4c2fa3-sys\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.666654 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.666508 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53d2472b-32e2-4211-97c4-24411c4c2fa3-podres\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.666654 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.666536 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2989\" (UniqueName: \"kubernetes.io/projected/53d2472b-32e2-4211-97c4-24411c4c2fa3-kube-api-access-j2989\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.666654 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.666568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53d2472b-32e2-4211-97c4-24411c4c2fa3-proc\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.666654 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.666627 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53d2472b-32e2-4211-97c4-24411c4c2fa3-lib-modules\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.667047 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.666661 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53d2472b-32e2-4211-97c4-24411c4c2fa3-proc\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.667047 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.666665 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53d2472b-32e2-4211-97c4-24411c4c2fa3-podres\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.667047 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.666746 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53d2472b-32e2-4211-97c4-24411c4c2fa3-sys\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.676580 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.676549 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2989\" (UniqueName: \"kubernetes.io/projected/53d2472b-32e2-4211-97c4-24411c4c2fa3-kube-api-access-j2989\") pod \"perf-node-gather-daemonset-mr8wx\" (UID: \"53d2472b-32e2-4211-97c4-24411c4c2fa3\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.783881 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.783785 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:56.981868 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:56.980452 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx"] Jun 11 15:31:56.982586 ip-10-0-135-91 kubenswrapper[2574]: W0611 15:31:56.982554 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod53d2472b_32e2_4211_97c4_24411c4c2fa3.slice/crio-85da9f26d6b7ba5b68b2d52c25a36855004079783484e243c281630d7fc9b0cc WatchSource:0}: Error finding container 85da9f26d6b7ba5b68b2d52c25a36855004079783484e243c281630d7fc9b0cc: Status 404 returned error can't find the container with id 85da9f26d6b7ba5b68b2d52c25a36855004079783484e243c281630d7fc9b0cc Jun 11 15:31:57.187549 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:57.187509 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" event={"ID":"53d2472b-32e2-4211-97c4-24411c4c2fa3","Type":"ContainerStarted","Data":"94d7414ac2a100b95853c0fb3c215d382ed38d2f62a38cdd8fe3c0ccfd1601bf"} Jun 11 15:31:57.187728 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:57.187571 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" event={"ID":"53d2472b-32e2-4211-97c4-24411c4c2fa3","Type":"ContainerStarted","Data":"85da9f26d6b7ba5b68b2d52c25a36855004079783484e243c281630d7fc9b0cc"} Jun 11 15:31:57.187728 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:57.187638 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:31:57.206241 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:57.206186 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" podStartSLOduration=1.206169947 podStartE2EDuration="1.206169947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:31:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:31:57.203679859 +0000 UTC m=+2496.461931280" watchObservedRunningTime="2026-06-11 15:31:57.206169947 +0000 UTC m=+2496.464421380" Jun 11 15:31:58.291553 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:58.291495 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fdxrx_cb805cfa-5506-449e-810f-cbc624679eaa/dns/0.log" Jun 11 15:31:58.310561 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:58.310533 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fdxrx_cb805cfa-5506-449e-810f-cbc624679eaa/kube-rbac-proxy/0.log" Jun 11 15:31:58.443707 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:58.443681 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wgzcn_400743e8-75f6-41ed-a7d6-28b75105c435/dns-node-resolver/0.log" Jun 11 15:31:59.019025 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:31:59.018979 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d2dgr_f6330dcf-d467-4d44-890c-e4b689e5d451/node-ca/0.log" Jun 11 15:32:00.089979 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:00.089947 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rng28_8a473d25-5523-4d11-ac80-ec861a6c9eb9/discovery/0.log" Jun 11 15:32:00.138204 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:00.138173 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb8d84687-vb9r5_7e200669-911a-4727-99ba-d0428def4e7f/kube-auth-proxy/0.log" Jun 11 15:32:00.995238 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:00.995202 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h8lr6_321e1681-bcb6-413d-8d63-c64aacd4e352/serve-healthcheck-canary/0.log" Jun 11 15:32:01.711640 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:01.711617 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kfmz7_2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e/kube-rbac-proxy/0.log" Jun 11 15:32:01.732238 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:01.732199 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kfmz7_2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e/exporter/0.log" Jun 11 15:32:01.753442 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:01.753415 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kfmz7_2a37455a-2627-4ae7-8cb5-a7b3cc50ce8e/extractor/0.log" Jun 11 15:32:03.209485 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:03.209454 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-mr8wx" Jun 11 15:32:03.993557 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:03.993530 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-79f6976fb4-mp297_4ec0e07e-ff92-4211-9081-a1fad41c417e/nginx/0.log" Jun 11 15:32:04.018075 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:04.018041 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-8hct7_113f4a20-6ff2-4640-b6eb-6a9d2bb78f4d/manager/0.log" Jun 11 15:32:04.118046 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:04.118001 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-4kvvm_9b40a52f-90a6-4ddf-a537-257e361515a8/manager/0.log" Jun 11 15:32:04.249606 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:04.249526 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-xzb8h_3ef8c9bb-489a-446a-aa09-7a82646bb137/server/0.log" Jun 11 15:32:04.494059 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:04.494015 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58897f8c7f-m54rf_63daf9d7-8f0e-4182-acdd-9089813e3e58/manager/0.log" Jun 11 15:32:04.517357 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:04.517278 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58897f8c7f-m54rf_63daf9d7-8f0e-4182-acdd-9089813e3e58/copy-manifests/0.log" Jun 11 15:32:10.398163 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:10.398127 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rng28_8a473d25-5523-4d11-ac80-ec861a6c9eb9/discovery/0.log" Jun 11 15:32:10.423728 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:10.423650 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb8d84687-vb9r5_7e200669-911a-4727-99ba-d0428def4e7f/kube-auth-proxy/0.log" Jun 11 15:32:11.796809 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:11.796172 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rng28_8a473d25-5523-4d11-ac80-ec861a6c9eb9/discovery/0.log" Jun 11 15:32:11.825867 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:11.825839 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb8d84687-vb9r5_7e200669-911a-4727-99ba-d0428def4e7f/kube-auth-proxy/0.log" Jun 11 15:32:13.511139 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:13.511107 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skznz_5f4cfe08-2925-42b4-9c7d-43a438ec56ea/kube-multus-additional-cni-plugins/0.log" Jun 11 15:32:13.535759 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:13.535731 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skznz_5f4cfe08-2925-42b4-9c7d-43a438ec56ea/egress-router-binary-copy/0.log" Jun 11 15:32:13.557258 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:13.557231 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skznz_5f4cfe08-2925-42b4-9c7d-43a438ec56ea/cni-plugins/0.log" Jun 11 15:32:13.579982 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:13.579958 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skznz_5f4cfe08-2925-42b4-9c7d-43a438ec56ea/bond-cni-plugin/0.log" Jun 11 15:32:13.605916 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:13.605882 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skznz_5f4cfe08-2925-42b4-9c7d-43a438ec56ea/routeoverride-cni/0.log" Jun 11 15:32:13.628969 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:13.628940 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skznz_5f4cfe08-2925-42b4-9c7d-43a438ec56ea/whereabouts-cni-bincopy/0.log" Jun 11 15:32:13.634245 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:13.634221 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rng28_8a473d25-5523-4d11-ac80-ec861a6c9eb9/discovery/0.log" Jun 11 15:32:13.649030 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:13.648992 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skznz_5f4cfe08-2925-42b4-9c7d-43a438ec56ea/whereabouts-cni/0.log" Jun 11 15:32:13.660729 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:13.660703 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb8d84687-vb9r5_7e200669-911a-4727-99ba-d0428def4e7f/kube-auth-proxy/0.log" Jun 11 15:32:13.719717 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:13.719675 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sgfjr_ca9ef755-34a9-4bb6-8d5a-2b19abb89860/kube-multus/0.log" Jun 11 15:32:13.900868 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:13.900783 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q68m6_d6feb162-f5a6-4c90-b19a-829f3057794b/network-metrics-daemon/0.log" Jun 11 15:32:13.920600 ip-10-0-135-91 kubenswrapper[2574]: I0611 15:32:13.920575 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q68m6_d6feb162-f5a6-4c90-b19a-829f3057794b/kube-rbac-proxy/0.log"