Jun 11 21:20:28.101721 ip-10-0-143-27 systemd[1]: Starting Kubernetes Kubelet... Jun 11 21:20:28.543360 ip-10-0-143-27 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:20:28.543360 ip-10-0-143-27 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 21:20:28.543360 ip-10-0-143-27 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:20:28.543360 ip-10-0-143-27 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 21:20:28.543360 ip-10-0-143-27 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:20:28.546354 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.546259 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 21:20:28.550832 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550816 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:20:28.550832 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550832 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550836 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550839 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550842 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550845 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550848 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550850 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550854 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550858 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550861 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550864 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550866 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550869 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550872 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550875 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550878 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550880 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550884 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550888 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550894 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:20:28.550894 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550898 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550901 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550904 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550907 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550909 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550912 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550915 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550917 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550920 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550923 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550925 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550935 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550939 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550941 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550944 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550947 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550949 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550952 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550954 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550957 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:20:28.551369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550959 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550962 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550964 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550966 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550969 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550972 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550974 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550977 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550979 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550982 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550984 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550987 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550989 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550994 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.550998 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551001 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551004 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551008 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551011 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551014 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:20:28.551873 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551017 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551020 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551022 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551025 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551028 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551030 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551033 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551035 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551038 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551041 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551044 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551046 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551049 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551053 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551056 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551059 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551062 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551065 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551068 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:20:28.552369 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551070 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551073 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551076 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551078 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551081 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551083 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551086 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551089 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551092 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551094 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551097 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551099 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551102 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551105 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551107 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551110 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551112 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551115 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:20:28.552833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.551118 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:20:28.553413 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553392 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:20:28.553450 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553418 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:20:28.553450 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553422 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:20:28.553450 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553425 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:20:28.553450 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553428 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:20:28.553450 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553430 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:20:28.553450 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553433 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:20:28.553450 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553436 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:20:28.553450 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553438 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:20:28.553450 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553441 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:20:28.553450 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553444 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:20:28.553450 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553447 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:20:28.553450 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553450 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:20:28.553450 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553453 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:20:28.553450 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553456 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553459 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553462 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553464 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553467 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553469 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553472 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553475 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553477 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553480 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553482 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553485 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553487 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553491 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553495 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553498 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553501 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553504 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553507 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:20:28.553800 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553510 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553512 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553515 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553518 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553521 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553524 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553526 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553529 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553532 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553535 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553538 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553541 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553543 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553546 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553549 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553553 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553556 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553558 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553561 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553564 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:20:28.554251 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553567 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553570 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553572 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553575 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553577 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553581 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553585 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553588 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553593 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553595 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553598 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553600 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553604 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553606 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553609 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553611 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553614 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553616 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553619 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553621 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:20:28.554825 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553624 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553626 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553629 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553633 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553636 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553639 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553642 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553646 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553649 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553652 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553655 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553658 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553660 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553663 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553665 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553668 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553671 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553673 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553676 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:20:28.555321 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553678 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553681 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553683 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553686 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553688 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553691 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.553695 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554057 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554061 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554064 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554067 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554070 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554073 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554075 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554078 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554080 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554083 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554086 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554089 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554092 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:20:28.555824 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554095 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554098 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554101 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554103 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554106 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554109 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554111 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554113 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554116 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554119 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554121 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554124 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554126 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554129 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554131 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554134 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554136 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554139 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554142 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554145 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:20:28.556309 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554147 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554150 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554152 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554155 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554158 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554160 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554164 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554167 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554171 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554174 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554176 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554179 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554182 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554184 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554187 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554190 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554192 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554195 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554197 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554200 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:20:28.556805 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554202 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554205 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554207 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554210 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554212 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554215 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554217 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554220 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554223 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554225 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554228 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554232 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554235 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554238 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554240 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554243 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554245 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554248 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554250 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554253 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:20:28.557316 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554256 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554259 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554261 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554264 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554267 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554270 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554272 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554275 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554277 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554280 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554282 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554285 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554287 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554292 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554295 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554298 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554301 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554304 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554308 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:20:28.557819 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554312 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554315 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554318 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554321 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554323 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554326 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.554329 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554421 2581 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554431 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554440 2581 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554446 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554450 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554454 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554463 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554468 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554471 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554474 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554478 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554481 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554484 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554487 2581 flags.go:64] FLAG: --cgroup-root="" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554490 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554494 2581 flags.go:64] FLAG: --client-ca-file="" Jun 11 21:20:28.558275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554497 2581 flags.go:64] FLAG: --cloud-provider="external" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554500 2581 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554506 2581 flags.go:64] FLAG: --cluster-domain="" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554509 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554513 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554517 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554520 2581 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554524 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554528 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554531 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554535 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554538 2581 flags.go:64] FLAG: --contention-profiling="false" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554541 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554544 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554547 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554551 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554555 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554558 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554561 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554563 2581 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554567 2581 flags.go:64] FLAG: --enable-server="true" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554570 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554574 2581 flags.go:64] FLAG: --event-burst="100" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554577 2581 flags.go:64] FLAG: --event-qps="50" Jun 11 21:20:28.558868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554580 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554583 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554587 2581 flags.go:64] FLAG: --eviction-hard="" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554591 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554594 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554596 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554599 2581 flags.go:64] FLAG: --eviction-soft="" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554603 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554606 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554609 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554614 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554617 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554620 2581 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554622 2581 flags.go:64] FLAG: --feature-gates="" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554626 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554630 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554633 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554636 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554639 2581 flags.go:64] FLAG: --healthz-port="10248" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554642 2581 flags.go:64] FLAG: --help="false" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554645 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554648 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554651 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 21:20:28.559456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554654 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554658 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554662 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554664 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554667 2581 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554670 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554673 2581 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554675 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554679 2581 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554682 2581 flags.go:64] FLAG: --kube-reserved="" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554684 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554688 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554691 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554693 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554696 2581 flags.go:64] FLAG: --lock-file="" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554699 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554702 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554705 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554710 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554714 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554717 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554720 2581 flags.go:64] FLAG: --logging-format="text" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554723 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554726 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 21:20:28.560038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554729 2581 flags.go:64] FLAG: --manifest-url="" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554732 2581 flags.go:64] FLAG: --manifest-url-header="" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554736 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554740 2581 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554744 2581 flags.go:64] FLAG: --max-pods="110" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554747 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554750 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554753 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554756 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554759 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554762 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554765 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554773 2581 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554776 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554779 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554782 2581 flags.go:64] FLAG: --pod-cidr="" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554785 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554791 2581 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554794 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554797 2581 flags.go:64] FLAG: --pods-per-core="0" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554799 2581 flags.go:64] FLAG: --port="10250" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554802 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554806 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0384b9063615c5905" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554809 2581 flags.go:64] FLAG: --qos-reserved="" Jun 11 21:20:28.560640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554812 2581 flags.go:64] FLAG: --read-only-port="10255" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554815 2581 flags.go:64] FLAG: --register-node="true" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554818 2581 flags.go:64] FLAG: --register-with-taints="" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554823 2581 flags.go:64] FLAG: --registry-burst="10" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554826 2581 flags.go:64] FLAG: --registry-qps="5" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554829 2581 flags.go:64] FLAG: --reserved-cpus="" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554832 2581 flags.go:64] FLAG: --reserved-memory="" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554836 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554839 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554842 2581 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554845 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554849 2581 flags.go:64] FLAG: --runonce="false" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554852 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554855 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554858 2581 flags.go:64] FLAG: --seccomp-default="false" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554862 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554864 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554867 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554871 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554875 2581 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554878 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554881 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554884 2581 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554887 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554890 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 21:20:28.561220 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554893 2581 flags.go:64] FLAG: --system-cgroups="" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554896 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554901 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554903 2581 flags.go:64] FLAG: --tls-cert-file="" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554907 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554910 2581 flags.go:64] FLAG: --tls-min-version="" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554913 2581 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554915 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554918 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554921 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554933 2581 flags.go:64] FLAG: --v="2" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554937 2581 flags.go:64] FLAG: --version="false" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554942 2581 flags.go:64] FLAG: --vmodule="" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554951 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.554955 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555074 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555080 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555083 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555085 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555088 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555090 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555093 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555096 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:20:28.561959 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555098 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555101 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555103 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555106 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555109 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555112 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555114 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555117 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555120 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555122 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555125 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555127 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555130 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555132 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555135 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555138 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555140 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555143 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555145 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555149 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:20:28.562566 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555152 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555154 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555157 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555160 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555162 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555167 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555169 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555172 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555174 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555177 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555179 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555182 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555185 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555187 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555191 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555193 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555196 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555199 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555201 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:20:28.563342 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555204 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555207 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555209 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555213 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555217 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555220 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555223 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555225 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555228 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555231 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555234 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555237 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555242 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555245 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555248 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555251 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555253 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555256 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555260 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:20:28.564024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555263 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555265 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555268 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555271 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555273 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555276 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555278 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555281 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555284 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555287 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555290 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555292 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555296 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555299 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555301 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555304 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555306 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555309 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555312 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:20:28.564540 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555314 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555317 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555319 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555322 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555325 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555327 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555331 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555333 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555336 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555340 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555344 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555347 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555351 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.555354 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.556136 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:20:28.564999 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.564970 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 21:20:28.565385 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.564986 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 21:20:28.566026 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.566015 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 21:20:28.566059 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.566027 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 21:20:28.566090 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566085 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:20:28.566122 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566091 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:20:28.566122 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566095 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:20:28.566122 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566098 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:20:28.566122 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566102 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:20:28.566122 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566105 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:20:28.566122 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566108 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:20:28.566122 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566111 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:20:28.566122 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566114 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:20:28.566122 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566117 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:20:28.566122 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566120 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:20:28.566122 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566123 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:20:28.566122 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566126 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566130 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566133 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566136 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566138 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566142 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566144 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566147 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566150 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566152 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566155 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566158 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566161 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566164 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566166 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566169 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566172 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566175 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566177 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566180 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:20:28.566444 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566183 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566185 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566188 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566191 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566194 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566196 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566200 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566204 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566207 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566210 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566212 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566215 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566218 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566220 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566223 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566226 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566229 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566232 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566234 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:20:28.566930 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566237 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566240 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566243 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566246 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566249 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566252 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566254 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566257 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566260 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566263 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566265 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566268 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566271 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566274 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566277 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566280 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566282 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566285 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566288 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:20:28.567389 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566290 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566293 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566295 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566298 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566300 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566304 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566308 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566311 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566315 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566325 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566328 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566331 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566334 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566337 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566339 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566342 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566344 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566347 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566349 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:20:28.567882 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566352 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:20:28.568347 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566356 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:20:28.568347 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566359 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:20:28.568347 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566363 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:20:28.568347 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566366 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:20:28.568347 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566368 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:20:28.568347 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566371 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:20:28.568347 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566373 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:20:28.568347 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566376 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:20:28.568347 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566378 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:20:28.568347 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.566384 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:20:28.568347 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566526 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:20:28.568347 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566533 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:20:28.568347 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566538 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:20:28.568347 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566541 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566544 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566547 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566550 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566552 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566555 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566558 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566561 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566564 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566575 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566578 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566581 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566583 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566586 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566588 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566593 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566597 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566600 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566603 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566606 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:20:28.568748 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566609 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566612 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566614 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566617 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566619 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566622 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566625 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566628 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566631 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566633 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566636 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566639 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566641 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566644 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566647 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566649 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566652 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566655 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566657 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566660 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:20:28.569242 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566663 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566665 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566669 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566672 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566675 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566677 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566680 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566682 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566685 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566688 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566690 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566693 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566696 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566698 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566700 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566703 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566705 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566708 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566711 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566713 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:20:28.569806 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566716 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566718 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566721 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566724 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566726 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566729 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566731 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566734 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566736 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566739 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566742 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566745 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566747 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566750 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566752 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566755 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566758 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566760 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566763 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566765 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:20:28.570298 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566767 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566770 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566772 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566775 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566778 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566780 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566782 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566785 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566788 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566791 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566793 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566796 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566799 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566801 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566804 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:20:28.570864 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:28.566808 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:20:28.571278 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.566814 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:20:28.571278 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.566938 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 21:20:28.571278 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.569130 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 21:20:28.571278 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.570628 2581 server.go:1019] "Starting client certificate rotation" Jun 11 21:20:28.571278 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.570742 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 21:20:28.571278 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.570796 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 21:20:28.573447 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.573431 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 21:20:28.578763 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.578745 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 21:20:28.588844 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.588813 2581 log.go:25] "Validated CRI v1 runtime API" Jun 11 21:20:28.591816 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.591800 2581 log.go:25] "Validated CRI v1 image API" Jun 11 21:20:28.592535 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.592511 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 21:20:28.595266 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.595244 2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c38e97d6-6629-4109-8763-0ad3d5490379:/dev/nvme0n1p3 fa1efbe3-820d-480d-8492-161f016e6d81:/dev/nvme0n1p4] Jun 11 21:20:28.595345 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.595265 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 21:20:28.600780 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.600663 2581 manager.go:216] Machine: {Timestamp:2026-06-11 21:20:28.599095674 +0000 UTC m=+0.373035621 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096619 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a17d7d65599475a606cf5e5e6e99d SystemUUID:ec2a17d7-d655-9947-5a60-6cf5e5e6e99d BootID:b93bfa0f-3c03-494d-b447-1897e000fd94 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:90:72:b4:a3:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:90:72:b4:a3:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:dd:4c:50:6f:35 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 21:20:28.600780 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.600768 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 21:20:28.600942 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.600925 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 21:20:28.600942 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.600936 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 21:20:28.604412 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.604372 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 21:20:28.604928 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.604416 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-27.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 21:20:28.605713 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.605701 2581 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 21:20:28.605770 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.605719 2581 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 21:20:28.605770 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.605731 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 21:20:28.606657 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.606644 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 21:20:28.608282 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.608270 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 21:20:28.613460 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.613444 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 11 21:20:28.613750 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.613736 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 21:20:28.613811 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.613780 2581 kubelet.go:486] "Attempting to sync node with API server" Jun 11 21:20:28.613973 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.613961 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 21:20:28.614031 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.613989 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 21:20:28.614031 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.614020 2581 kubelet.go:398] "Adding apiserver pod source" Jun 11 21:20:28.614165 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.614035 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 21:20:28.615436 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.615391 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 21:20:28.615531 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.615445 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 21:20:28.618780 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.618760 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 21:20:28.620689 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.620674 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 21:20:28.620765 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.620713 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 21:20:28.620919 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.620907 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 21:20:28.620979 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.620927 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 21:20:28.620979 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.620936 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 21:20:28.620979 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.620945 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 21:20:28.620979 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.620957 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 21:20:28.620979 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.620965 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 21:20:28.621734 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.621724 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 21:20:28.621791 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.621736 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 21:20:28.621791 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.621752 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 21:20:28.621791 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.621761 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 21:20:28.621791 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.621774 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 21:20:28.621791 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.621786 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 21:20:28.623090 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.623079 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 21:20:28.623140 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.623093 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 21:20:28.625012 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.624985 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 21:20:28.625012 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.624984 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 21:20:28.625147 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.625025 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-27.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 21:20:28.626390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.626371 2581 server.go:1268] "Started kubelet" Jun 11 21:20:28.626498 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.626467 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 21:20:28.626616 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.626577 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 21:20:28.626693 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.626632 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 21:20:28.627136 ip-10-0-143-27 systemd[1]: Started Kubernetes Kubelet. Jun 11 21:20:28.628432 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.628254 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 21:20:28.628798 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.628784 2581 server.go:310] "Adding debug handlers to kubelet server" Jun 11 21:20:28.629852 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.629836 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k9jkl" Jun 11 21:20:28.633002 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.631695 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-27.ec2.internal.18b823a15fa44f24 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-27.ec2.internal,UID:ip-10-0-143-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-27.ec2.internal,},FirstTimestamp:2026-06-11 21:20:28.626341668 +0000 UTC m=+0.400281616,LastTimestamp:2026-06-11 21:20:28.626341668 +0000 UTC m=+0.400281616,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-27.ec2.internal,}" Jun 11 21:20:28.633364 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.633347 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 21:20:28.633364 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.633357 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 21:20:28.633518 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.633435 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Jun 11 21:20:28.634045 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.634024 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 21:20:28.634045 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.634045 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 21:20:28.634045 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.634153 2581 reconstruct.go:97] "Volume reconstruction finished" Jun 11 21:20:28.634045 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.634159 2581 reconciler.go:29] "Reconciler: start to sync state" Jun 11 21:20:28.634045 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.634176 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 21:20:28.634493 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.634340 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 21:20:28.634493 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.634353 2581 factory.go:55] Registering systemd factory Jun 11 21:20:28.634493 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.634362 2581 factory.go:223] Registration of the systemd container factory successfully Jun 11 21:20:28.634698 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.634680 2581 factory.go:153] Registering CRI-O factory Jun 11 21:20:28.634698 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.634698 2581 factory.go:223] Registration of the crio container factory successfully Jun 11 21:20:28.634838 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.634716 2581 factory.go:103] Registering Raw factory Jun 11 21:20:28.634838 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.634725 2581 manager.go:1196] Started watching for new ooms in manager Jun 11 21:20:28.635076 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.635063 2581 manager.go:349] Starting recovery of all containers Jun 11 21:20:28.635905 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.635850 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 21:20:28.641548 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.641525 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k9jkl" Jun 11 21:20:28.645048 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.642727 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 21:20:28.645048 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.643186 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 21:20:28.646468 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.646453 2581 manager.go:354] Recovery completed Jun 11 21:20:28.650559 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.650547 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:20:28.652715 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.652698 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:20:28.652783 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.652730 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:20:28.652783 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.652740 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:20:28.653279 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.653261 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 21:20:28.653279 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.653279 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 21:20:28.653379 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.653286 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:20:28.653379 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.653296 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 11 21:20:28.654074 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.654058 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:20:28.654126 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.654084 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:20:28.654126 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.654094 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:20:28.654515 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.654503 2581 policy_none.go:49] "None policy: Start" Jun 11 21:20:28.654555 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.654520 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 21:20:28.654555 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.654531 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 21:20:28.655434 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.655424 2581 policy_none.go:47] "Start" Jun 11 21:20:28.687018 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.687002 2581 manager.go:337] "Starting Device Plugin manager" Jun 11 21:20:28.701995 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.687038 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 21:20:28.701995 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.687048 2581 server.go:87] "Starting device plugin registration server" Jun 11 21:20:28.701995 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.687294 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 21:20:28.701995 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.687306 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 21:20:28.701995 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.687461 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 21:20:28.701995 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.687548 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 21:20:28.701995 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.687558 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 21:20:28.701995 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.688103 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 21:20:28.701995 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.688163 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-27.ec2.internal\" not found" Jun 11 21:20:28.701995 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.699679 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 21:20:28.701995 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.700879 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 21:20:28.701995 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.700918 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 21:20:28.701995 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.700938 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 21:20:28.701995 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.700980 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 21:20:28.702945 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.702929 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:20:28.787618 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.787584 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:20:28.788564 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.788545 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:20:28.788682 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.788578 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:20:28.788682 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.788592 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:20:28.788682 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.788627 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.796896 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.796842 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.796896 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.796869 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-27.ec2.internal\": node \"ip-10-0-143-27.ec2.internal\" not found" Jun 11 21:20:28.801755 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.801736 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal"] Jun 11 21:20:28.801825 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.801797 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:20:28.802644 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.802629 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:20:28.802699 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.802659 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:20:28.802699 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.802677 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:20:28.803908 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.803897 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:20:28.804027 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.804011 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.804087 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.804049 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:20:28.804625 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.804609 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:20:28.804625 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.804617 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:20:28.804776 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.804636 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:20:28.804776 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.804644 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:20:28.804776 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.804649 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:20:28.804776 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.804656 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:20:28.805825 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.805812 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.805870 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.805835 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:20:28.806498 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.806482 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:20:28.806613 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.806507 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:20:28.806613 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.806521 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:20:28.816303 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.816287 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Jun 11 21:20:28.831971 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.831946 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-27.ec2.internal\" not found" node="ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.834531 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.834513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/336f9fa0db438ecee932f82468114e02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal\" (UID: \"336f9fa0db438ecee932f82468114e02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.834633 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.834538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/336f9fa0db438ecee932f82468114e02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal\" (UID: \"336f9fa0db438ecee932f82468114e02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.834633 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.834563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/38e720e009b609e953d4b31cfb6f1c73-config\") pod \"kube-apiserver-proxy-ip-10-0-143-27.ec2.internal\" (UID: \"38e720e009b609e953d4b31cfb6f1c73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.836251 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.836234 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-27.ec2.internal\" not found" node="ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.916875 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:28.916849 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Jun 11 21:20:28.935450 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.935424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/38e720e009b609e953d4b31cfb6f1c73-config\") pod \"kube-apiserver-proxy-ip-10-0-143-27.ec2.internal\" (UID: \"38e720e009b609e953d4b31cfb6f1c73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.935517 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.935456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/336f9fa0db438ecee932f82468114e02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal\" (UID: \"336f9fa0db438ecee932f82468114e02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.935517 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.935476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/336f9fa0db438ecee932f82468114e02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal\" (UID: \"336f9fa0db438ecee932f82468114e02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.935581 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.935517 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/38e720e009b609e953d4b31cfb6f1c73-config\") pod \"kube-apiserver-proxy-ip-10-0-143-27.ec2.internal\" (UID: \"38e720e009b609e953d4b31cfb6f1c73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.935581 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.935533 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/336f9fa0db438ecee932f82468114e02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal\" (UID: \"336f9fa0db438ecee932f82468114e02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Jun 11 21:20:28.935581 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:28.935528 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/336f9fa0db438ecee932f82468114e02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal\" (UID: \"336f9fa0db438ecee932f82468114e02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Jun 11 21:20:29.017095 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:29.017050 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Jun 11 21:20:29.117831 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:29.117744 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Jun 11 21:20:29.134974 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.134946 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Jun 11 21:20:29.140092 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.140075 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" Jun 11 21:20:29.217935 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:29.217886 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Jun 11 21:20:29.318451 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:29.318394 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Jun 11 21:20:29.418950 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:29.418875 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Jun 11 21:20:29.519545 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:29.519516 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Jun 11 21:20:29.520556 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.520535 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:20:29.569820 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.569797 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 21:20:29.570456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.569928 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 21:20:29.570456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.569972 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 21:20:29.578453 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:29.578418 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e720e009b609e953d4b31cfb6f1c73.slice/crio-14915a29e53245f7e1ee515d4a7eaecb31169e1e6e204117a561fd48b3989928 WatchSource:0}: Error finding container 14915a29e53245f7e1ee515d4a7eaecb31169e1e6e204117a561fd48b3989928: Status 404 returned error can't find the container with id 14915a29e53245f7e1ee515d4a7eaecb31169e1e6e204117a561fd48b3989928 Jun 11 21:20:29.582962 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:29.582943 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336f9fa0db438ecee932f82468114e02.slice/crio-a877cd057202512277f33a26b37da9ac971cb61884dd4f33404b72e0d4157f22 WatchSource:0}: Error finding container a877cd057202512277f33a26b37da9ac971cb61884dd4f33404b72e0d4157f22: Status 404 returned error can't find the container with id a877cd057202512277f33a26b37da9ac971cb61884dd4f33404b72e0d4157f22 Jun 11 21:20:29.583158 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.583144 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:20:29.614831 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.614807 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:20:29.633772 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.633739 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Jun 11 21:20:29.633772 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.633756 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 21:20:29.648290 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.648258 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 21:15:28 +0000 UTC" deadline="2028-02-21 06:08:55.463050072 +0000 UTC" Jun 11 21:20:29.648290 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.648286 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14864h48m25.814767477s" Jun 11 21:20:29.649118 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.649103 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 21:20:29.650035 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.650022 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 21:20:29.652300 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.652287 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" Jun 11 21:20:29.660803 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.660791 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 21:20:29.675060 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.675014 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p6m2l" Jun 11 21:20:29.681992 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.681977 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p6m2l" Jun 11 21:20:29.704452 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.704388 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" event={"ID":"336f9fa0db438ecee932f82468114e02","Type":"ContainerStarted","Data":"a877cd057202512277f33a26b37da9ac971cb61884dd4f33404b72e0d4157f22"} Jun 11 21:20:29.705332 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:29.705307 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" event={"ID":"38e720e009b609e953d4b31cfb6f1c73","Type":"ContainerStarted","Data":"14915a29e53245f7e1ee515d4a7eaecb31169e1e6e204117a561fd48b3989928"} Jun 11 21:20:30.066661 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.066577 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:20:30.536108 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.536030 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:20:30.615420 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.615380 2581 apiserver.go:52] "Watching apiserver" Jun 11 21:20:30.622327 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.622304 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 21:20:30.622774 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.622748 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-xd2qc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal","openshift-multus/multus-g26gz","openshift-multus/network-metrics-daemon-k5xgg","openshift-cluster-node-tuning-operator/tuned-pqgcb","openshift-image-registry/node-ca-5478n","openshift-multus/multus-additional-cni-plugins-b9jlb","openshift-network-diagnostics/network-check-target-bxt48","openshift-network-operator/iptables-alerter-6zk9v","openshift-ovn-kubernetes/ovnkube-node-xhllk","kube-system/global-pull-secret-syncer-g45jc","kube-system/konnectivity-agent-zcw2n","kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4"] Jun 11 21:20:30.624702 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.624677 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.625824 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.625789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:30.625927 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:30.625870 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:30.627359 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.627026 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 21:20:30.627359 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.627072 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 21:20:30.627359 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.627303 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 21:20:30.627359 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.627315 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cxtdw\"" Jun 11 21:20:30.627656 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.627363 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 21:20:30.627656 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.627463 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 21:20:30.627656 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.627473 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.628363 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.628344 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:30.628482 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:30.628429 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:30.629680 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.629557 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5schf\"" Jun 11 21:20:30.629680 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.629622 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.629957 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.629941 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 21:20:30.631003 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.630982 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5478n" Jun 11 21:20:30.634456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.632482 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 21:20:30.634456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.632747 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:20:30.634456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.633035 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q4zb7\"" Jun 11 21:20:30.634456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.633309 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2rrjr\"" Jun 11 21:20:30.634456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.633440 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 21:20:30.634456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.633825 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 21:20:30.634456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.633998 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 21:20:30.636078 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.635776 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6zk9v" Jun 11 21:20:30.637555 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.637512 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.637860 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.637841 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:20:30.638024 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.637966 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 21:20:30.638089 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.638027 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 21:20:30.638588 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.638568 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4n4vq\"" Jun 11 21:20:30.639298 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.639283 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:30.639378 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:30.639338 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:30.639711 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.639694 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 21:20:30.639785 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.639756 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 21:20:30.639785 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.639761 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5qbn8\"" Jun 11 21:20:30.640000 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.639981 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 21:20:30.640520 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.640504 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.641981 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.641964 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xd2qc" Jun 11 21:20:30.642478 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.642458 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 21:20:30.642684 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.642467 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w7xwg\"" Jun 11 21:20:30.643019 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.642998 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 21:20:30.643095 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.642999 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 21:20:30.643183 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.643165 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zcw2n" Jun 11 21:20:30.643783 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.643764 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 21:20:30.643867 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.643816 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 21:20:30.643867 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.643841 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 21:20:30.644442 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.644427 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 21:20:30.644534 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.644481 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 21:20:30.644592 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.644573 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mcrl4\"" Jun 11 21:20:30.645197 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645180 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8253ee99-b103-44c9-a010-4dfe7bd592c5-cni-binary-copy\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.645296 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-multus-conf-dir\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.645296 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645233 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c69230f-56d8-4a47-99de-65e6ca8ace50-host\") pod \"node-ca-5478n\" (UID: \"1c69230f-56d8-4a47-99de-65e6ca8ace50\") " pod="openshift-image-registry/node-ca-5478n" Jun 11 21:20:30.645296 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645291 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfrgk\" (UniqueName: \"kubernetes.io/projected/1c69230f-56d8-4a47-99de-65e6ca8ace50-kube-api-access-qfrgk\") pod \"node-ca-5478n\" (UID: \"1c69230f-56d8-4a47-99de-65e6ca8ace50\") " pod="openshift-image-registry/node-ca-5478n" Jun 11 21:20:30.645461 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:30.645461 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645341 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38e4770b-2228-4dff-802c-db3c7594d72c-kubelet-config\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:30.645461 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645370 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 21:20:30.645461 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-var-lib-cni-multus\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.645461 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f9a2b45-8b15-4d0c-8846-e86b1b3629ee-host-slash\") pod \"iptables-alerter-6zk9v\" (UID: \"3f9a2b45-8b15-4d0c-8846-e86b1b3629ee\") " pod="openshift-network-operator/iptables-alerter-6zk9v" Jun 11 21:20:30.645461 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q7m8\" (UniqueName: \"kubernetes.io/projected/3f9a2b45-8b15-4d0c-8846-e86b1b3629ee-kube-api-access-8q7m8\") pod \"iptables-alerter-6zk9v\" (UID: \"3f9a2b45-8b15-4d0c-8846-e86b1b3629ee\") " pod="openshift-network-operator/iptables-alerter-6zk9v" Jun 11 21:20:30.645740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645475 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k4cdp\"" Jun 11 21:20:30.645740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645482 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-systemd\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.645740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-host\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.645740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645526 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a95ef77e-0ed6-41b7-ac1d-55b120e47925-cnibin\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.645740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a95ef77e-0ed6-41b7-ac1d-55b120e47925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.645740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645570 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38e4770b-2228-4dff-802c-db3c7594d72c-dbus\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:30.645740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645594 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-multus-cni-dir\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.645740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-etc-kubernetes\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.645740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645667 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtj2r\" (UniqueName: \"kubernetes.io/projected/8253ee99-b103-44c9-a010-4dfe7bd592c5-kube-api-access-rtj2r\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.645740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645679 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 21:20:30.645740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645710 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:30.645740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-system-cni-dir\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-os-release\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645811 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-multus-socket-dir-parent\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645860 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-hostroot\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-run-multus-certs\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645918 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f9a2b45-8b15-4d0c-8846-e86b1b3629ee-iptables-alerter-script\") pod \"iptables-alerter-6zk9v\" (UID: \"3f9a2b45-8b15-4d0c-8846-e86b1b3629ee\") " pod="openshift-network-operator/iptables-alerter-6zk9v" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gfwc\" (UniqueName: \"kubernetes.io/projected/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-kube-api-access-9gfwc\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a95ef77e-0ed6-41b7-ac1d-55b120e47925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-kubernetes\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.645995 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-sys\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-lib-modules\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm24k\" (UniqueName: \"kubernetes.io/projected/54960117-3e00-4227-bd41-1fb841d65cff-kube-api-access-sm24k\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646084 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a95ef77e-0ed6-41b7-ac1d-55b120e47925-os-release\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646122 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a95ef77e-0ed6-41b7-ac1d-55b120e47925-cni-binary-copy\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-cnibin\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646177 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-run-netns\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.646205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-var-lib-cni-bin\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8253ee99-b103-44c9-a010-4dfe7bd592c5-multus-daemon-config\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646245 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c69230f-56d8-4a47-99de-65e6ca8ace50-serviceca\") pod \"node-ca-5478n\" (UID: \"1c69230f-56d8-4a47-99de-65e6ca8ace50\") " pod="openshift-image-registry/node-ca-5478n" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-modprobe-d\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646307 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a95ef77e-0ed6-41b7-ac1d-55b120e47925-system-cni-dir\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-run-k8s-cni-cncf-io\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-sysconfig\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-run\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-var-lib-kubelet\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646456 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54960117-3e00-4227-bd41-1fb841d65cff-etc-tuned\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646476 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54960117-3e00-4227-bd41-1fb841d65cff-tmp\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646502 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a95ef77e-0ed6-41b7-ac1d-55b120e47925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646541 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmtw5\" (UniqueName: \"kubernetes.io/projected/a95ef77e-0ed6-41b7-ac1d-55b120e47925-kube-api-access-qmtw5\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-var-lib-kubelet\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646603 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-sysctl-d\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.646835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.646644 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-sysctl-conf\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.684448 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.684414 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:15:29 +0000 UTC" deadline="2028-02-16 21:34:42.512011098 +0000 UTC" Jun 11 21:20:30.684448 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.684448 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14760h14m11.827567889s" Jun 11 21:20:30.735994 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.735962 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 21:20:30.747076 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747046 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gfwc\" (UniqueName: \"kubernetes.io/projected/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-kube-api-access-9gfwc\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:30.747076 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7dcf034e-3c12-488a-a82f-98b3e1cc1e3f-agent-certs\") pod \"konnectivity-agent-zcw2n\" (UID: \"7dcf034e-3c12-488a-a82f-98b3e1cc1e3f\") " pod="kube-system/konnectivity-agent-zcw2n" Jun 11 21:20:30.747310 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-kubernetes\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.747310 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-lib-modules\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.747310 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747144 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm24k\" (UniqueName: \"kubernetes.io/projected/54960117-3e00-4227-bd41-1fb841d65cff-kube-api-access-sm24k\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.747310 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747189 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-kubernetes\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.747310 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747288 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk45d\" (UniqueName: \"kubernetes.io/projected/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-kube-api-access-lk45d\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a95ef77e-0ed6-41b7-ac1d-55b120e47925-cni-binary-copy\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747322 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-lib-modules\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747344 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-run-netns\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-var-lib-cni-bin\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747378 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-run-netns\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c69230f-56d8-4a47-99de-65e6ca8ace50-serviceca\") pod \"node-ca-5478n\" (UID: \"1c69230f-56d8-4a47-99de-65e6ca8ace50\") " pod="openshift-image-registry/node-ca-5478n" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-modprobe-d\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747430 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-var-lib-cni-bin\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747442 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-sysconfig\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54960117-3e00-4227-bd41-1fb841d65cff-etc-tuned\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747479 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-run-ovn\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747498 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a95ef77e-0ed6-41b7-ac1d-55b120e47925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747540 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-modprobe-d\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747544 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-sysconfig\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.747582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-sysctl-conf\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747597 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpbx2\" (UniqueName: \"kubernetes.io/projected/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-kube-api-access-cpbx2\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8253ee99-b103-44c9-a010-4dfe7bd592c5-cni-binary-copy\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-multus-conf-dir\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747670 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c69230f-56d8-4a47-99de-65e6ca8ace50-host\") pod \"node-ca-5478n\" (UID: \"1c69230f-56d8-4a47-99de-65e6ca8ace50\") " pod="openshift-image-registry/node-ca-5478n" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747689 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-sysctl-conf\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747695 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfrgk\" (UniqueName: \"kubernetes.io/projected/1c69230f-56d8-4a47-99de-65e6ca8ace50-kube-api-access-qfrgk\") pod \"node-ca-5478n\" (UID: \"1c69230f-56d8-4a47-99de-65e6ca8ace50\") " pod="openshift-image-registry/node-ca-5478n" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747754 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c69230f-56d8-4a47-99de-65e6ca8ace50-host\") pod \"node-ca-5478n\" (UID: \"1c69230f-56d8-4a47-99de-65e6ca8ace50\") " pod="openshift-image-registry/node-ca-5478n" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747839 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747946 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c69230f-56d8-4a47-99de-65e6ca8ace50-serviceca\") pod \"node-ca-5478n\" (UID: \"1c69230f-56d8-4a47-99de-65e6ca8ace50\") " pod="openshift-image-registry/node-ca-5478n" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38e4770b-2228-4dff-802c-db3c7594d72c-kubelet-config\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.747995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-var-lib-cni-multus\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748006 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a95ef77e-0ed6-41b7-ac1d-55b120e47925-cni-binary-copy\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748017 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38e4770b-2228-4dff-802c-db3c7594d72c-kubelet-config\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748005 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a95ef77e-0ed6-41b7-ac1d-55b120e47925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f9a2b45-8b15-4d0c-8846-e86b1b3629ee-host-slash\") pod \"iptables-alerter-6zk9v\" (UID: \"3f9a2b45-8b15-4d0c-8846-e86b1b3629ee\") " pod="openshift-network-operator/iptables-alerter-6zk9v" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748070 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-var-lib-cni-multus\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748082 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-multus-conf-dir\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.748390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748126 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f9a2b45-8b15-4d0c-8846-e86b1b3629ee-host-slash\") pod \"iptables-alerter-6zk9v\" (UID: \"3f9a2b45-8b15-4d0c-8846-e86b1b3629ee\") " pod="openshift-network-operator/iptables-alerter-6zk9v" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748133 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-systemd\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748183 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-host\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-registration-dir\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a95ef77e-0ed6-41b7-ac1d-55b120e47925-cnibin\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748235 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8253ee99-b103-44c9-a010-4dfe7bd592c5-cni-binary-copy\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748238 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-systemd\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748237 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-host\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a95ef77e-0ed6-41b7-ac1d-55b120e47925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748290 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a95ef77e-0ed6-41b7-ac1d-55b120e47925-cnibin\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748320 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38e4770b-2228-4dff-802c-db3c7594d72c-dbus\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748359 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748432 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-slash\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748446 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38e4770b-2228-4dff-802c-db3c7594d72c-dbus\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748452 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a95ef77e-0ed6-41b7-ac1d-55b120e47925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-run-openvswitch\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-env-overrides\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.749233 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-system-cni-dir\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748608 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-os-release\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-hostroot\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-run-multus-certs\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:30.748697 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5q8s\" (UniqueName: \"kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s\") pod \"network-check-target-bxt48\" (UID: \"acf283d0-9a2d-4736-b496-b433b3602e97\") " pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95b638f6-e8d8-46fb-821b-dc717ecf393d-hosts-file\") pod \"node-resolver-xd2qc\" (UID: \"95b638f6-e8d8-46fb-821b-dc717ecf393d\") " pod="openshift-dns/node-resolver-xd2qc" Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a95ef77e-0ed6-41b7-ac1d-55b120e47925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:30.748768 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret podName:38e4770b-2228-4dff-802c-db3c7594d72c nodeName:}" failed. No retries permitted until 2026-06-11 21:20:31.248748643 +0000 UTC m=+3.022688579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret") pod "global-pull-secret-syncer-g45jc" (UID: "38e4770b-2228-4dff-802c-db3c7594d72c") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-sys\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-socket-dir\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748842 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-systemd-units\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748861 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-run-netns\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-run-ovn-kubernetes\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.749989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748909 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7dcf034e-3c12-488a-a82f-98b3e1cc1e3f-konnectivity-ca\") pod \"konnectivity-agent-zcw2n\" (UID: \"7dcf034e-3c12-488a-a82f-98b3e1cc1e3f\") " pod="kube-system/konnectivity-agent-zcw2n" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a95ef77e-0ed6-41b7-ac1d-55b120e47925-os-release\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-cnibin\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8253ee99-b103-44c9-a010-4dfe7bd592c5-multus-daemon-config\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.748999 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-run\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-var-lib-kubelet\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-cni-netd\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95b638f6-e8d8-46fb-821b-dc717ecf393d-tmp-dir\") pod \"node-resolver-xd2qc\" (UID: \"95b638f6-e8d8-46fb-821b-dc717ecf393d\") " pod="openshift-dns/node-resolver-xd2qc" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749097 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a95ef77e-0ed6-41b7-ac1d-55b120e47925-system-cni-dir\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749114 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a95ef77e-0ed6-41b7-ac1d-55b120e47925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749124 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-run-k8s-cni-cncf-io\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749157 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54960117-3e00-4227-bd41-1fb841d65cff-tmp\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749172 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-run-k8s-cni-cncf-io\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-kubelet\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749220 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-system-cni-dir\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749237 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-node-log\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749253 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-cni-bin\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.750742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmtw5\" (UniqueName: \"kubernetes.io/projected/a95ef77e-0ed6-41b7-ac1d-55b120e47925-kube-api-access-qmtw5\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-var-lib-kubelet\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-sysctl-d\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-device-dir\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-log-socket\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749382 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-ovn-node-metrics-cert\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749428 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-sys-fs\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749430 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-sys\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749521 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-var-lib-openvswitch\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749546 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a95ef77e-0ed6-41b7-ac1d-55b120e47925-system-cni-dir\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749593 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-var-lib-kubelet\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749637 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-var-lib-kubelet\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749732 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-os-release\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749753 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-ovnkube-script-lib\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749756 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-host-run-multus-certs\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749797 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-hostroot\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.751271 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749881 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-run\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q7m8\" (UniqueName: \"kubernetes.io/projected/3f9a2b45-8b15-4d0c-8846-e86b1b3629ee-kube-api-access-8q7m8\") pod \"iptables-alerter-6zk9v\" (UID: \"3f9a2b45-8b15-4d0c-8846-e86b1b3629ee\") " pod="openshift-network-operator/iptables-alerter-6zk9v" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749942 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-etc-openvswitch\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.749962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-ovnkube-config\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-multus-cni-dir\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750040 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54960117-3e00-4227-bd41-1fb841d65cff-etc-sysctl-d\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750042 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a95ef77e-0ed6-41b7-ac1d-55b120e47925-os-release\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750061 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-etc-kubernetes\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750106 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-cnibin\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtj2r\" (UniqueName: \"kubernetes.io/projected/8253ee99-b103-44c9-a010-4dfe7bd592c5-kube-api-access-rtj2r\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750182 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-run-systemd\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750171 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-etc-kubernetes\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750184 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8253ee99-b103-44c9-a010-4dfe7bd592c5-multus-daemon-config\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750240 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-multus-cni-dir\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750287 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz7h2\" (UniqueName: \"kubernetes.io/projected/95b638f6-e8d8-46fb-821b-dc717ecf393d-kube-api-access-cz7h2\") pod \"node-resolver-xd2qc\" (UID: \"95b638f6-e8d8-46fb-821b-dc717ecf393d\") " pod="openshift-dns/node-resolver-xd2qc" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-multus-socket-dir-parent\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:30.750420 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:30.751853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f9a2b45-8b15-4d0c-8846-e86b1b3629ee-iptables-alerter-script\") pod \"iptables-alerter-6zk9v\" (UID: \"3f9a2b45-8b15-4d0c-8846-e86b1b3629ee\") " pod="openshift-network-operator/iptables-alerter-6zk9v" Jun 11 21:20:30.752348 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750444 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8253ee99-b103-44c9-a010-4dfe7bd592c5-multus-socket-dir-parent\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.752348 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:30.750558 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs podName:0e097be0-6ad1-4fea-9652-09fe7e0b89e1 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:31.250541276 +0000 UTC m=+3.024481214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs") pod "network-metrics-daemon-k5xgg" (UID: "0e097be0-6ad1-4fea-9652-09fe7e0b89e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:30.752348 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.750892 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f9a2b45-8b15-4d0c-8846-e86b1b3629ee-iptables-alerter-script\") pod \"iptables-alerter-6zk9v\" (UID: \"3f9a2b45-8b15-4d0c-8846-e86b1b3629ee\") " pod="openshift-network-operator/iptables-alerter-6zk9v" Jun 11 21:20:30.752348 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.751319 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54960117-3e00-4227-bd41-1fb841d65cff-etc-tuned\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.752348 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.751912 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54960117-3e00-4227-bd41-1fb841d65cff-tmp\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.760836 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.760809 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q7m8\" (UniqueName: \"kubernetes.io/projected/3f9a2b45-8b15-4d0c-8846-e86b1b3629ee-kube-api-access-8q7m8\") pod \"iptables-alerter-6zk9v\" (UID: \"3f9a2b45-8b15-4d0c-8846-e86b1b3629ee\") " pod="openshift-network-operator/iptables-alerter-6zk9v" Jun 11 21:20:30.760966 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.760816 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm24k\" (UniqueName: \"kubernetes.io/projected/54960117-3e00-4227-bd41-1fb841d65cff-kube-api-access-sm24k\") pod \"tuned-pqgcb\" (UID: \"54960117-3e00-4227-bd41-1fb841d65cff\") " pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.761209 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.761188 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gfwc\" (UniqueName: \"kubernetes.io/projected/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-kube-api-access-9gfwc\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:30.761332 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.761311 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtj2r\" (UniqueName: \"kubernetes.io/projected/8253ee99-b103-44c9-a010-4dfe7bd592c5-kube-api-access-rtj2r\") pod \"multus-g26gz\" (UID: \"8253ee99-b103-44c9-a010-4dfe7bd592c5\") " pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.761515 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.761474 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmtw5\" (UniqueName: \"kubernetes.io/projected/a95ef77e-0ed6-41b7-ac1d-55b120e47925-kube-api-access-qmtw5\") pod \"multus-additional-cni-plugins-b9jlb\" (UID: \"a95ef77e-0ed6-41b7-ac1d-55b120e47925\") " pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.762155 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.762138 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfrgk\" (UniqueName: \"kubernetes.io/projected/1c69230f-56d8-4a47-99de-65e6ca8ace50-kube-api-access-qfrgk\") pod \"node-ca-5478n\" (UID: \"1c69230f-56d8-4a47-99de-65e6ca8ace50\") " pod="openshift-image-registry/node-ca-5478n" Jun 11 21:20:30.850865 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.850785 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-registration-dir\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.850865 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.850825 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.850865 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.850864 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-slash\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.850888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-run-openvswitch\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.850908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-env-overrides\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.850957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.850961 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-registration-dir\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.850971 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.850983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5q8s\" (UniqueName: \"kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s\") pod \"network-check-target-bxt48\" (UID: \"acf283d0-9a2d-4736-b496-b433b3602e97\") " pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.850987 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-slash\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851007 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95b638f6-e8d8-46fb-821b-dc717ecf393d-hosts-file\") pod \"node-resolver-xd2qc\" (UID: \"95b638f6-e8d8-46fb-821b-dc717ecf393d\") " pod="openshift-dns/node-resolver-xd2qc" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851028 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851029 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-socket-dir\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851026 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-run-openvswitch\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-systemd-units\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851069 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95b638f6-e8d8-46fb-821b-dc717ecf393d-hosts-file\") pod \"node-resolver-xd2qc\" (UID: \"95b638f6-e8d8-46fb-821b-dc717ecf393d\") " pod="openshift-dns/node-resolver-xd2qc" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-run-netns\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-run-ovn-kubernetes\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851116 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-systemd-units\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851128 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7dcf034e-3c12-488a-a82f-98b3e1cc1e3f-konnectivity-ca\") pod \"konnectivity-agent-zcw2n\" (UID: \"7dcf034e-3c12-488a-a82f-98b3e1cc1e3f\") " pod="kube-system/konnectivity-agent-zcw2n" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851154 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-run-netns\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851163 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-socket-dir\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851165 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-run-ovn-kubernetes\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-cni-netd\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851196 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-cni-netd\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851214 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95b638f6-e8d8-46fb-821b-dc717ecf393d-tmp-dir\") pod \"node-resolver-xd2qc\" (UID: \"95b638f6-e8d8-46fb-821b-dc717ecf393d\") " pod="openshift-dns/node-resolver-xd2qc" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851241 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-kubelet\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-node-log\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-cni-bin\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-device-dir\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-log-socket\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851336 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-node-log\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851307 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-kubelet\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-ovn-node-metrics-cert\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851393 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-device-dir\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-sys-fs\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.851969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851450 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-log-socket\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-var-lib-openvswitch\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851486 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-var-lib-openvswitch\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-ovnkube-script-lib\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851505 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95b638f6-e8d8-46fb-821b-dc717ecf393d-tmp-dir\") pod \"node-resolver-xd2qc\" (UID: \"95b638f6-e8d8-46fb-821b-dc717ecf393d\") " pod="openshift-dns/node-resolver-xd2qc" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851343 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-cni-bin\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-etc-openvswitch\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851569 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-sys-fs\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851597 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-ovnkube-config\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851636 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-etc-openvswitch\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-run-systemd\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.851892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz7h2\" (UniqueName: \"kubernetes.io/projected/95b638f6-e8d8-46fb-821b-dc717ecf393d-kube-api-access-cz7h2\") pod \"node-resolver-xd2qc\" (UID: \"95b638f6-e8d8-46fb-821b-dc717ecf393d\") " pod="openshift-dns/node-resolver-xd2qc" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.852020 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7dcf034e-3c12-488a-a82f-98b3e1cc1e3f-konnectivity-ca\") pod \"konnectivity-agent-zcw2n\" (UID: \"7dcf034e-3c12-488a-a82f-98b3e1cc1e3f\") " pod="kube-system/konnectivity-agent-zcw2n" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.852276 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-env-overrides\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.852350 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-ovnkube-script-lib\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.852421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7dcf034e-3c12-488a-a82f-98b3e1cc1e3f-agent-certs\") pod \"konnectivity-agent-zcw2n\" (UID: \"7dcf034e-3c12-488a-a82f-98b3e1cc1e3f\") " pod="kube-system/konnectivity-agent-zcw2n" Jun 11 21:20:30.852720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.852443 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.853493 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.852888 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-run-systemd\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.853493 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.852945 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk45d\" (UniqueName: \"kubernetes.io/projected/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-kube-api-access-lk45d\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.853493 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.852966 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-ovnkube-config\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.853493 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.852987 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-run-ovn\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.853493 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.853022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbx2\" (UniqueName: \"kubernetes.io/projected/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-kube-api-access-cpbx2\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.853493 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.853232 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-run-ovn\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.855000 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.854520 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-ovn-node-metrics-cert\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.855120 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.855065 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7dcf034e-3c12-488a-a82f-98b3e1cc1e3f-agent-certs\") pod \"konnectivity-agent-zcw2n\" (UID: \"7dcf034e-3c12-488a-a82f-98b3e1cc1e3f\") " pod="kube-system/konnectivity-agent-zcw2n" Jun 11 21:20:30.856569 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:30.856548 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:20:30.856682 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:30.856575 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:20:30.856682 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:30.856589 2581 projected.go:196] Error preparing data for projected volume kube-api-access-d5q8s for pod openshift-network-diagnostics/network-check-target-bxt48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:30.856682 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:30.856664 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s podName:acf283d0-9a2d-4736-b496-b433b3602e97 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:31.356648763 +0000 UTC m=+3.130588711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d5q8s" (UniqueName: "kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s") pod "network-check-target-bxt48" (UID: "acf283d0-9a2d-4736-b496-b433b3602e97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:30.860012 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.859985 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz7h2\" (UniqueName: \"kubernetes.io/projected/95b638f6-e8d8-46fb-821b-dc717ecf393d-kube-api-access-cz7h2\") pod \"node-resolver-xd2qc\" (UID: \"95b638f6-e8d8-46fb-821b-dc717ecf393d\") " pod="openshift-dns/node-resolver-xd2qc" Jun 11 21:20:30.860897 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.860877 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpbx2\" (UniqueName: \"kubernetes.io/projected/7a8ba34a-1390-4eb9-ad6d-1a840147b3e5-kube-api-access-cpbx2\") pod \"aws-ebs-csi-driver-node-4dgm4\" (UID: \"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.861082 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.861063 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk45d\" (UniqueName: \"kubernetes.io/projected/2a3f8c72-9b49-4e04-8a55-558ecbc70a57-kube-api-access-lk45d\") pod \"ovnkube-node-xhllk\" (UID: \"2a3f8c72-9b49-4e04-8a55-558ecbc70a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.938870 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.938829 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b9jlb" Jun 11 21:20:30.946142 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.946122 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g26gz" Jun 11 21:20:30.952530 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.952510 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" Jun 11 21:20:30.959154 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.959135 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5478n" Jun 11 21:20:30.966708 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.966693 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6zk9v" Jun 11 21:20:30.974282 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.974265 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" Jun 11 21:20:30.980739 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.980713 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:30.988282 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.988267 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xd2qc" Jun 11 21:20:30.994857 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:30.994779 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zcw2n" Jun 11 21:20:31.255647 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.255562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:31.255647 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.255623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:31.255873 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:31.255716 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:31.255873 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:31.255738 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:31.255873 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:31.255784 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret podName:38e4770b-2228-4dff-802c-db3c7594d72c nodeName:}" failed. No retries permitted until 2026-06-11 21:20:32.255763179 +0000 UTC m=+4.029703121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret") pod "global-pull-secret-syncer-g45jc" (UID: "38e4770b-2228-4dff-802c-db3c7594d72c") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:31.255873 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:31.255806 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs podName:0e097be0-6ad1-4fea-9652-09fe7e0b89e1 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:32.255795092 +0000 UTC m=+4.029735036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs") pod "network-metrics-daemon-k5xgg" (UID: "0e097be0-6ad1-4fea-9652-09fe7e0b89e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:31.456841 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.456816 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5q8s\" (UniqueName: \"kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s\") pod \"network-check-target-bxt48\" (UID: \"acf283d0-9a2d-4736-b496-b433b3602e97\") " pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:31.456965 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:31.456953 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:20:31.457014 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:31.456969 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:20:31.457014 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:31.456979 2581 projected.go:196] Error preparing data for projected volume kube-api-access-d5q8s for pod openshift-network-diagnostics/network-check-target-bxt48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:31.457077 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:31.457026 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s podName:acf283d0-9a2d-4736-b496-b433b3602e97 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:32.457012664 +0000 UTC m=+4.230952597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5q8s" (UniqueName: "kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s") pod "network-check-target-bxt48" (UID: "acf283d0-9a2d-4736-b496-b433b3602e97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:31.465013 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:31.464803 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9a2b45_8b15_4d0c_8846_e86b1b3629ee.slice/crio-255b8a3d120747968e1e7f1dd5ddd51e4169a281f51165c19445ec1a5337679e WatchSource:0}: Error finding container 255b8a3d120747968e1e7f1dd5ddd51e4169a281f51165c19445ec1a5337679e: Status 404 returned error can't find the container with id 255b8a3d120747968e1e7f1dd5ddd51e4169a281f51165c19445ec1a5337679e Jun 11 21:20:31.466797 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:31.466774 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54960117_3e00_4227_bd41_1fb841d65cff.slice/crio-041fd9943f9b128c607befdb5d9fceb5601b9d535983983ac11776609f75c52b WatchSource:0}: Error finding container 041fd9943f9b128c607befdb5d9fceb5601b9d535983983ac11776609f75c52b: Status 404 returned error can't find the container with id 041fd9943f9b128c607befdb5d9fceb5601b9d535983983ac11776609f75c52b Jun 11 21:20:31.467663 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:31.467619 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c69230f_56d8_4a47_99de_65e6ca8ace50.slice/crio-9c0a29d76960fa60733dda29021f829cb77137d485789a47b73771dc1e1d9ea2 WatchSource:0}: Error finding container 9c0a29d76960fa60733dda29021f829cb77137d485789a47b73771dc1e1d9ea2: Status 404 returned error can't find the container with id 9c0a29d76960fa60733dda29021f829cb77137d485789a47b73771dc1e1d9ea2 Jun 11 21:20:31.468351 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:31.468221 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8253ee99_b103_44c9_a010_4dfe7bd592c5.slice/crio-fbce2cd8b2188dfcb268fa76169e05296873d13ccfbd4a573e394dac8fcedfff WatchSource:0}: Error finding container fbce2cd8b2188dfcb268fa76169e05296873d13ccfbd4a573e394dac8fcedfff: Status 404 returned error can't find the container with id fbce2cd8b2188dfcb268fa76169e05296873d13ccfbd4a573e394dac8fcedfff Jun 11 21:20:31.469478 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:31.469453 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a3f8c72_9b49_4e04_8a55_558ecbc70a57.slice/crio-150401b6fb5ea3b78921baca2ab921796200e8c50b698af88c3a436d1a572f96 WatchSource:0}: Error finding container 150401b6fb5ea3b78921baca2ab921796200e8c50b698af88c3a436d1a572f96: Status 404 returned error can't find the container with id 150401b6fb5ea3b78921baca2ab921796200e8c50b698af88c3a436d1a572f96 Jun 11 21:20:31.470969 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:31.470949 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b638f6_e8d8_46fb_821b_dc717ecf393d.slice/crio-7e6fc8814d753fb3bf79c2de45f04363d409fc0e5264c3ebca17e356731e0c18 WatchSource:0}: Error finding container 7e6fc8814d753fb3bf79c2de45f04363d409fc0e5264c3ebca17e356731e0c18: Status 404 returned error can't find the container with id 7e6fc8814d753fb3bf79c2de45f04363d409fc0e5264c3ebca17e356731e0c18 Jun 11 21:20:31.472229 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:31.472210 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8ba34a_1390_4eb9_ad6d_1a840147b3e5.slice/crio-0a367e7eb9127cea764fb41b3e4193f7ec9cecdcfcc26dd4babfdba88dbb0997 WatchSource:0}: Error finding container 0a367e7eb9127cea764fb41b3e4193f7ec9cecdcfcc26dd4babfdba88dbb0997: Status 404 returned error can't find the container with id 0a367e7eb9127cea764fb41b3e4193f7ec9cecdcfcc26dd4babfdba88dbb0997 Jun 11 21:20:31.474099 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:20:31.474008 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda95ef77e_0ed6_41b7_ac1d_55b120e47925.slice/crio-098fcfa6f502dc775d6a632900997aed606965cd89fa094ce9ff72309d372054 WatchSource:0}: Error finding container 098fcfa6f502dc775d6a632900997aed606965cd89fa094ce9ff72309d372054: Status 404 returned error can't find the container with id 098fcfa6f502dc775d6a632900997aed606965cd89fa094ce9ff72309d372054 Jun 11 21:20:31.684843 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.684795 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:15:29 +0000 UTC" deadline="2027-12-11 21:41:49.852321349 +0000 UTC" Jun 11 21:20:31.684843 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.684837 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13152h21m18.167486342s" Jun 11 21:20:31.709618 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.709590 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" event={"ID":"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5","Type":"ContainerStarted","Data":"0a367e7eb9127cea764fb41b3e4193f7ec9cecdcfcc26dd4babfdba88dbb0997"} Jun 11 21:20:31.710680 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.710655 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" event={"ID":"2a3f8c72-9b49-4e04-8a55-558ecbc70a57","Type":"ContainerStarted","Data":"150401b6fb5ea3b78921baca2ab921796200e8c50b698af88c3a436d1a572f96"} Jun 11 21:20:31.711719 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.711693 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" event={"ID":"54960117-3e00-4227-bd41-1fb841d65cff","Type":"ContainerStarted","Data":"041fd9943f9b128c607befdb5d9fceb5601b9d535983983ac11776609f75c52b"} Jun 11 21:20:31.712745 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.712723 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g26gz" event={"ID":"8253ee99-b103-44c9-a010-4dfe7bd592c5","Type":"ContainerStarted","Data":"fbce2cd8b2188dfcb268fa76169e05296873d13ccfbd4a573e394dac8fcedfff"} Jun 11 21:20:31.713949 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.713919 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5478n" event={"ID":"1c69230f-56d8-4a47-99de-65e6ca8ace50","Type":"ContainerStarted","Data":"9c0a29d76960fa60733dda29021f829cb77137d485789a47b73771dc1e1d9ea2"} Jun 11 21:20:31.714952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.714931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zcw2n" event={"ID":"7dcf034e-3c12-488a-a82f-98b3e1cc1e3f","Type":"ContainerStarted","Data":"cc8a19049408c8e14c6947d4f716dba09082b397728ed98a08d4300467da8f43"} Jun 11 21:20:31.715903 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.715877 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xd2qc" event={"ID":"95b638f6-e8d8-46fb-821b-dc717ecf393d","Type":"ContainerStarted","Data":"7e6fc8814d753fb3bf79c2de45f04363d409fc0e5264c3ebca17e356731e0c18"} Jun 11 21:20:31.716870 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.716844 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6zk9v" event={"ID":"3f9a2b45-8b15-4d0c-8846-e86b1b3629ee","Type":"ContainerStarted","Data":"255b8a3d120747968e1e7f1dd5ddd51e4169a281f51165c19445ec1a5337679e"} Jun 11 21:20:31.718763 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.718745 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" event={"ID":"38e720e009b609e953d4b31cfb6f1c73","Type":"ContainerStarted","Data":"c14ee89375b37e415368d0e9dbe70dd3a4ce7bf5bd100436b0035ee497f93139"} Jun 11 21:20:31.719876 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.719855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9jlb" event={"ID":"a95ef77e-0ed6-41b7-ac1d-55b120e47925","Type":"ContainerStarted","Data":"098fcfa6f502dc775d6a632900997aed606965cd89fa094ce9ff72309d372054"} Jun 11 21:20:31.731974 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:31.731925 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" podStartSLOduration=2.731912343 podStartE2EDuration="2.731912343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:31.731676372 +0000 UTC m=+3.505616329" watchObservedRunningTime="2026-06-11 21:20:31.731912343 +0000 UTC m=+3.505852301" Jun 11 21:20:32.039239 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:32.038997 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:20:32.263583 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:32.263550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:32.263757 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:32.263631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:32.263833 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:32.263779 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:32.263883 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:32.263847 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs podName:0e097be0-6ad1-4fea-9652-09fe7e0b89e1 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:34.263822886 +0000 UTC m=+6.037762821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs") pod "network-metrics-daemon-k5xgg" (UID: "0e097be0-6ad1-4fea-9652-09fe7e0b89e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:32.263947 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:32.263913 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:32.263997 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:32.263962 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret podName:38e4770b-2228-4dff-802c-db3c7594d72c nodeName:}" failed. No retries permitted until 2026-06-11 21:20:34.263934604 +0000 UTC m=+6.037874544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret") pod "global-pull-secret-syncer-g45jc" (UID: "38e4770b-2228-4dff-802c-db3c7594d72c") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:32.465467 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:32.465369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5q8s\" (UniqueName: \"kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s\") pod \"network-check-target-bxt48\" (UID: \"acf283d0-9a2d-4736-b496-b433b3602e97\") " pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:32.465640 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:32.465577 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:20:32.465640 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:32.465600 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:20:32.465640 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:32.465612 2581 projected.go:196] Error preparing data for projected volume kube-api-access-d5q8s for pod openshift-network-diagnostics/network-check-target-bxt48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:32.465784 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:32.465669 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s podName:acf283d0-9a2d-4736-b496-b433b3602e97 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:34.465652142 +0000 UTC m=+6.239592078 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5q8s" (UniqueName: "kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s") pod "network-check-target-bxt48" (UID: "acf283d0-9a2d-4736-b496-b433b3602e97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:32.710121 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:32.708991 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:32.710121 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:32.709187 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:32.710121 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:32.709686 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:32.710121 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:32.709835 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:32.710121 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:32.709940 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:32.710121 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:32.710061 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:32.739962 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:32.739887 2581 generic.go:356] "Generic (PLEG): container finished" podID="336f9fa0db438ecee932f82468114e02" containerID="6cf05b3eacf2cfaee35d3939fc88873a2a91afba982fd7a54210958208a81906" exitCode=0 Jun 11 21:20:32.740832 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:32.740805 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" event={"ID":"336f9fa0db438ecee932f82468114e02","Type":"ContainerDied","Data":"6cf05b3eacf2cfaee35d3939fc88873a2a91afba982fd7a54210958208a81906"} Jun 11 21:20:33.764743 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:33.764707 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" event={"ID":"336f9fa0db438ecee932f82468114e02","Type":"ContainerStarted","Data":"5d30835c1e10b33d29796c23b97097ac4e674eeb430104ebb9aec001ef6004d2"} Jun 11 21:20:33.779904 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:33.779850 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" podStartSLOduration=4.779829437 podStartE2EDuration="4.779829437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:33.77876027 +0000 UTC m=+5.552700251" watchObservedRunningTime="2026-06-11 21:20:33.779829437 +0000 UTC m=+5.553769394" Jun 11 21:20:34.279520 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:34.279484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:34.279697 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:34.279562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:34.279754 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:34.279696 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:34.279803 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:34.279761 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs podName:0e097be0-6ad1-4fea-9652-09fe7e0b89e1 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:38.279742848 +0000 UTC m=+10.053682784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs") pod "network-metrics-daemon-k5xgg" (UID: "0e097be0-6ad1-4fea-9652-09fe7e0b89e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:34.280161 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:34.280142 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:34.280228 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:34.280199 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret podName:38e4770b-2228-4dff-802c-db3c7594d72c nodeName:}" failed. No retries permitted until 2026-06-11 21:20:38.280183456 +0000 UTC m=+10.054123393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret") pod "global-pull-secret-syncer-g45jc" (UID: "38e4770b-2228-4dff-802c-db3c7594d72c") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:34.482702 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:34.481938 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5q8s\" (UniqueName: \"kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s\") pod \"network-check-target-bxt48\" (UID: \"acf283d0-9a2d-4736-b496-b433b3602e97\") " pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:34.482702 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:34.482164 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:20:34.482702 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:34.482187 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:20:34.482702 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:34.482201 2581 projected.go:196] Error preparing data for projected volume kube-api-access-d5q8s for pod openshift-network-diagnostics/network-check-target-bxt48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:34.482702 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:34.482260 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s podName:acf283d0-9a2d-4736-b496-b433b3602e97 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:38.482240586 +0000 UTC m=+10.256180543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5q8s" (UniqueName: "kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s") pod "network-check-target-bxt48" (UID: "acf283d0-9a2d-4736-b496-b433b3602e97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:34.702621 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:34.702543 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:34.702771 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:34.702555 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:34.702771 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:34.702683 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:34.702887 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:34.702808 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:34.702887 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:34.702868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:34.703000 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:34.702951 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:36.702211 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:36.702155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:36.703143 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:36.702155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:36.703143 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:36.702155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:36.703143 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:36.702864 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:36.703143 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:36.702990 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:36.703143 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:36.703107 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:38.313962 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:38.313690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:38.313962 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:38.313765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:38.313962 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:38.313901 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:38.313962 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:38.313961 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret podName:38e4770b-2228-4dff-802c-db3c7594d72c nodeName:}" failed. No retries permitted until 2026-06-11 21:20:46.313944747 +0000 UTC m=+18.087884686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret") pod "global-pull-secret-syncer-g45jc" (UID: "38e4770b-2228-4dff-802c-db3c7594d72c") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:38.314606 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:38.314009 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:38.314606 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:38.314095 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs podName:0e097be0-6ad1-4fea-9652-09fe7e0b89e1 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:46.314078029 +0000 UTC m=+18.088017970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs") pod "network-metrics-daemon-k5xgg" (UID: "0e097be0-6ad1-4fea-9652-09fe7e0b89e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:38.515678 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:38.515645 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5q8s\" (UniqueName: \"kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s\") pod \"network-check-target-bxt48\" (UID: \"acf283d0-9a2d-4736-b496-b433b3602e97\") " pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:38.515865 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:38.515810 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:20:38.515865 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:38.515840 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:20:38.515865 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:38.515853 2581 projected.go:196] Error preparing data for projected volume kube-api-access-d5q8s for pod openshift-network-diagnostics/network-check-target-bxt48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:38.516027 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:38.515918 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s podName:acf283d0-9a2d-4736-b496-b433b3602e97 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:46.515898361 +0000 UTC m=+18.289838294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5q8s" (UniqueName: "kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s") pod "network-check-target-bxt48" (UID: "acf283d0-9a2d-4736-b496-b433b3602e97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:38.702142 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:38.702064 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:38.702293 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:38.702166 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:38.702723 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:38.702493 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:38.702723 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:38.702519 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:38.702723 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:38.702596 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:38.702723 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:38.702684 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:40.701440 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:40.701351 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:40.701440 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:40.701380 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:40.702081 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:40.701512 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:40.702081 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:40.701620 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:40.702081 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:40.701695 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:40.702081 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:40.701781 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:42.701379 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:42.701342 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:42.701379 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:42.701371 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:42.701906 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:42.701342 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:42.701906 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:42.701490 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:42.701906 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:42.701572 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:42.701906 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:42.701665 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:44.701481 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:44.701451 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:44.701481 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:44.701466 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:44.701999 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:44.701459 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:44.701999 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:44.701580 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:44.701999 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:44.701647 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:44.701999 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:44.701752 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:46.377677 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:46.377641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:46.378127 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:46.377701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:46.378127 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:46.377804 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:46.378127 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:46.377805 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:46.378127 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:46.377872 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs podName:0e097be0-6ad1-4fea-9652-09fe7e0b89e1 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:02.377853139 +0000 UTC m=+34.151793075 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs") pod "network-metrics-daemon-k5xgg" (UID: "0e097be0-6ad1-4fea-9652-09fe7e0b89e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:46.378127 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:46.377915 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret podName:38e4770b-2228-4dff-802c-db3c7594d72c nodeName:}" failed. No retries permitted until 2026-06-11 21:21:02.377883998 +0000 UTC m=+34.151823946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret") pod "global-pull-secret-syncer-g45jc" (UID: "38e4770b-2228-4dff-802c-db3c7594d72c") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:46.579990 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:46.579903 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5q8s\" (UniqueName: \"kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s\") pod \"network-check-target-bxt48\" (UID: \"acf283d0-9a2d-4736-b496-b433b3602e97\") " pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:46.580170 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:46.580090 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:20:46.580170 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:46.580115 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:20:46.580170 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:46.580132 2581 projected.go:196] Error preparing data for projected volume kube-api-access-d5q8s for pod openshift-network-diagnostics/network-check-target-bxt48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:46.580309 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:46.580197 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s podName:acf283d0-9a2d-4736-b496-b433b3602e97 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:02.580178661 +0000 UTC m=+34.354118654 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5q8s" (UniqueName: "kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s") pod "network-check-target-bxt48" (UID: "acf283d0-9a2d-4736-b496-b433b3602e97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:46.702083 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:46.702047 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:46.702263 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:46.702053 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:46.702263 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:46.702184 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:46.702263 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:46.702196 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:46.702436 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:46.702342 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:46.702487 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:46.702452 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:48.702518 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:48.702489 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:48.702982 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:48.702590 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:48.702982 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:48.702668 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:48.702982 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:48.702771 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:48.702982 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:48.702802 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:48.702982 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:48.702873 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:50.705055 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.704683 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:50.705055 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.704732 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:50.705760 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:50.705069 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:50.705760 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:50.705140 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:50.705760 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.704732 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:50.705760 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:50.705215 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:50.802372 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.802340 2581 generic.go:356] "Generic (PLEG): container finished" podID="a95ef77e-0ed6-41b7-ac1d-55b120e47925" containerID="d3188fe220c83b6b2694ad575e5231598456eafbd0c641cf25aaa92b25df1ed5" exitCode=0 Jun 11 21:20:50.802582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.802442 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9jlb" event={"ID":"a95ef77e-0ed6-41b7-ac1d-55b120e47925","Type":"ContainerDied","Data":"d3188fe220c83b6b2694ad575e5231598456eafbd0c641cf25aaa92b25df1ed5"} Jun 11 21:20:50.804278 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.804250 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" event={"ID":"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5","Type":"ContainerStarted","Data":"f232dfa9bcc9f59b23ed1e9fa9f94cc729b3285624ce5405afde4c21cff6ef8c"} Jun 11 21:20:50.807562 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.807540 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:20:50.807996 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.807971 2581 generic.go:356] "Generic (PLEG): container finished" podID="2a3f8c72-9b49-4e04-8a55-558ecbc70a57" containerID="af6b94cfa9a4a5e3222f3964712f80bea4349f36841f9d2b54dc69820fe280ff" exitCode=1 Jun 11 21:20:50.808109 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.808001 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" event={"ID":"2a3f8c72-9b49-4e04-8a55-558ecbc70a57","Type":"ContainerStarted","Data":"21613e9fa368b211cde319f423306a4f6af12f15f108933c53378b64e3a8ec19"} Jun 11 21:20:50.808109 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.808084 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" event={"ID":"2a3f8c72-9b49-4e04-8a55-558ecbc70a57","Type":"ContainerStarted","Data":"54b97de3158a1ab99da008b98715df8d8075367edf4b779acec38b5f9bd9b83c"} Jun 11 21:20:50.808222 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.808132 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" event={"ID":"2a3f8c72-9b49-4e04-8a55-558ecbc70a57","Type":"ContainerStarted","Data":"f138b03005f1e5b7f7e4e7bd9f3f174555a7fa45aeb8a1681a3964d65aba527b"} Jun 11 21:20:50.808222 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.808178 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" event={"ID":"2a3f8c72-9b49-4e04-8a55-558ecbc70a57","Type":"ContainerStarted","Data":"ae3ec2e45b7287d320626e7aafbfc996975331d2203c72e4a683bd80799221bd"} Jun 11 21:20:50.808222 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.808215 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" event={"ID":"2a3f8c72-9b49-4e04-8a55-558ecbc70a57","Type":"ContainerDied","Data":"af6b94cfa9a4a5e3222f3964712f80bea4349f36841f9d2b54dc69820fe280ff"} Jun 11 21:20:50.808341 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.808263 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" event={"ID":"2a3f8c72-9b49-4e04-8a55-558ecbc70a57","Type":"ContainerStarted","Data":"d72a8f11e192cce538ed052e80646840e81f24b5c5f37ec064070f8da6d686b9"} Jun 11 21:20:50.809740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.809719 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" event={"ID":"54960117-3e00-4227-bd41-1fb841d65cff","Type":"ContainerStarted","Data":"5b4f1e8beebfe0fe2f08693a341f3ed3b6ca7a8a853f161b60b41feb7457de74"} Jun 11 21:20:50.811269 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.811247 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g26gz" event={"ID":"8253ee99-b103-44c9-a010-4dfe7bd592c5","Type":"ContainerStarted","Data":"fb5258c5218a1435ec11ee22f1eac77f4d2c7a4c71635c962b1353f6179c0346"} Jun 11 21:20:50.812850 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.812818 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5478n" event={"ID":"1c69230f-56d8-4a47-99de-65e6ca8ace50","Type":"ContainerStarted","Data":"6083d476978241b45d87a989aa92fd258ccc4277aa3ac65349bec84a32edc812"} Jun 11 21:20:50.814325 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.814307 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zcw2n" event={"ID":"7dcf034e-3c12-488a-a82f-98b3e1cc1e3f","Type":"ContainerStarted","Data":"b740d411bcfd4d4e4e71ae15519741afff007e5a356f0c3af1893afe4d656afa"} Jun 11 21:20:50.815785 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.815757 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xd2qc" event={"ID":"95b638f6-e8d8-46fb-821b-dc717ecf393d","Type":"ContainerStarted","Data":"b6dfb3a400f87b5ea7c39965d2b7ee45d72e139b1707c570aa90dbbe771dcaee"} Jun 11 21:20:50.855206 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.855148 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zcw2n" podStartSLOduration=12.856666807 podStartE2EDuration="22.855128334s" totalImagesPullingTime="9.998461527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:50.839361647 +0000 UTC m=+22.613301604" watchObservedRunningTime="2026-06-11 21:20:50.855128334 +0000 UTC m=+22.629068293" Jun 11 21:20:50.870100 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.870060 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g26gz" podStartSLOduration=4.582004774 podStartE2EDuration="22.870046176s" totalImagesPullingTime="18.288041402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:50.854583676 +0000 UTC m=+22.628523634" watchObservedRunningTime="2026-06-11 21:20:50.870046176 +0000 UTC m=+22.643986132" Jun 11 21:20:50.870248 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.870180 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pqgcb" podStartSLOduration=4.665162782 podStartE2EDuration="22.870175085s" totalImagesPullingTime="18.205012303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:50.869680157 +0000 UTC m=+22.643620148" watchObservedRunningTime="2026-06-11 21:20:50.870175085 +0000 UTC m=+22.644115040" Jun 11 21:20:50.882705 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.882663 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5478n" podStartSLOduration=12.872276354 podStartE2EDuration="22.882654975s" totalImagesPullingTime="10.010378621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:50.882472371 +0000 UTC m=+22.656412327" watchObservedRunningTime="2026-06-11 21:20:50.882654975 +0000 UTC m=+22.656594932" Jun 11 21:20:50.895330 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:50.895290 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xd2qc" podStartSLOduration=4.694602859 podStartE2EDuration="22.895282382s" totalImagesPullingTime="18.200679523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:50.894914306 +0000 UTC m=+22.668854261" watchObservedRunningTime="2026-06-11 21:20:50.895282382 +0000 UTC m=+22.669222337" Jun 11 21:20:51.316231 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:51.316204 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zcw2n" Jun 11 21:20:51.316795 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:51.316777 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zcw2n" Jun 11 21:20:51.334773 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:51.334739 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 21:20:51.703547 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:51.703456 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T21:20:51.334767184Z","UUID":"b1dc1786-d42c-489b-8309-4c290b7dfb27","Handler":null,"Name":"","Endpoint":""} Jun 11 21:20:51.705061 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:51.705036 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 21:20:51.705451 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:51.705095 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 21:20:51.821298 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:51.820765 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6zk9v" event={"ID":"3f9a2b45-8b15-4d0c-8846-e86b1b3629ee","Type":"ContainerStarted","Data":"8201d4bc023a12c1950beeb10748d378db4187862a40332ac45f979eed947196"} Jun 11 21:20:51.824430 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:51.823981 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" event={"ID":"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5","Type":"ContainerStarted","Data":"336298627d542e5c072387a7073af4263cc013ce85ed9779cd0b6daf406a47be"} Jun 11 21:20:51.824854 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:51.824833 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zcw2n" Jun 11 21:20:51.825395 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:51.825368 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zcw2n" Jun 11 21:20:51.849606 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:51.849496 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6zk9v" podStartSLOduration=13.836060605 podStartE2EDuration="23.849472057s" totalImagesPullingTime="10.013411452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:51.834972178 +0000 UTC m=+23.608912136" watchObservedRunningTime="2026-06-11 21:20:51.849472057 +0000 UTC m=+23.623412014" Jun 11 21:20:52.706101 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:52.705877 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:52.706499 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:52.705916 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:52.706499 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:52.705928 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:52.706499 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:52.706231 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:52.706499 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:52.706364 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:52.706499 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:52.706469 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:52.828599 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:52.828561 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" event={"ID":"7a8ba34a-1390-4eb9-ad6d-1a840147b3e5","Type":"ContainerStarted","Data":"b21d3dad505642db7cfa37cc61a1c4c24c1342a778a1071f505b44686887ae45"} Jun 11 21:20:52.831684 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:52.831663 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:20:52.832182 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:52.832153 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" event={"ID":"2a3f8c72-9b49-4e04-8a55-558ecbc70a57","Type":"ContainerStarted","Data":"69a8f1c1278d911923e79ba85afb4b1e81b56451d7a73709c0d4d14e4a110ca9"} Jun 11 21:20:52.846215 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:52.846177 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4dgm4" podStartSLOduration=12.67842494 podStartE2EDuration="24.846163803s" totalImagesPullingTime="12.167738863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:52.845785172 +0000 UTC m=+24.619725140" watchObservedRunningTime="2026-06-11 21:20:52.846163803 +0000 UTC m=+24.620103756" Jun 11 21:20:54.705256 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:54.705220 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:54.705256 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:54.705243 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:54.706044 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:54.705232 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:54.706044 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:54.705375 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:54.706044 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:54.705500 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:54.706044 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:54.705568 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:55.841312 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:55.841128 2581 generic.go:356] "Generic (PLEG): container finished" podID="a95ef77e-0ed6-41b7-ac1d-55b120e47925" containerID="f71cd184bd722abbbd7a73641b875f9c2d797805b129262e070846651866409d" exitCode=0 Jun 11 21:20:55.841933 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:55.841212 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9jlb" event={"ID":"a95ef77e-0ed6-41b7-ac1d-55b120e47925","Type":"ContainerDied","Data":"f71cd184bd722abbbd7a73641b875f9c2d797805b129262e070846651866409d"} Jun 11 21:20:55.844778 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:55.844759 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:20:55.845127 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:55.845108 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" event={"ID":"2a3f8c72-9b49-4e04-8a55-558ecbc70a57","Type":"ContainerStarted","Data":"f649d2e935203501b45d378b45716e1e4319f63736ed9b14a15b87de6fe2227c"} Jun 11 21:20:55.845311 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:55.845290 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:55.845367 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:55.845355 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:55.845587 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:55.845569 2581 scope.go:117] "RemoveContainer" containerID="af6b94cfa9a4a5e3222f3964712f80bea4349f36841f9d2b54dc69820fe280ff" Jun 11 21:20:55.861700 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:55.861675 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:56.701366 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:56.701333 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:56.701502 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:56.701337 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:56.701502 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:56.701346 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:56.701502 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:56.701480 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:56.701630 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:56.701530 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:56.701740 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:56.701633 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:56.849956 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:56.849721 2581 generic.go:356] "Generic (PLEG): container finished" podID="a95ef77e-0ed6-41b7-ac1d-55b120e47925" containerID="35b0537a2d80eb5e30ef4814c0ab7e358d2dbfbb5525aae345352a1a7cb7b6d5" exitCode=0 Jun 11 21:20:56.849956 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:56.849805 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9jlb" event={"ID":"a95ef77e-0ed6-41b7-ac1d-55b120e47925","Type":"ContainerDied","Data":"35b0537a2d80eb5e30ef4814c0ab7e358d2dbfbb5525aae345352a1a7cb7b6d5"} Jun 11 21:20:56.853945 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:56.853928 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:20:56.854301 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:56.854280 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" event={"ID":"2a3f8c72-9b49-4e04-8a55-558ecbc70a57","Type":"ContainerStarted","Data":"5e67c3a3d8d648390b760d460f7ee0c0d44f2e865fc5ccc2adbf1dba9478a6b9"} Jun 11 21:20:56.854612 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:56.854594 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:56.870904 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:56.870880 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:20:56.896074 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:56.896014 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" podStartSLOduration=10.640233292 podStartE2EDuration="28.895997489s" totalImagesPullingTime="18.255764197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:56.895323539 +0000 UTC m=+28.669263528" watchObservedRunningTime="2026-06-11 21:20:56.895997489 +0000 UTC m=+28.669937445" Jun 11 21:20:57.001804 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:57.001776 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g45jc"] Jun 11 21:20:57.001973 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:57.001868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:57.002016 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:57.001963 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:57.005198 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:57.005134 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bxt48"] Jun 11 21:20:57.005328 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:57.005253 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:57.005382 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:57.005337 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:57.005821 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:57.005789 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k5xgg"] Jun 11 21:20:57.005916 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:57.005884 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:57.006012 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:57.005993 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:20:57.859226 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:57.859135 2581 generic.go:356] "Generic (PLEG): container finished" podID="a95ef77e-0ed6-41b7-ac1d-55b120e47925" containerID="8b0525faa52ce96cd250b815e6e61e1f8155902335960699b7e5a32d72de2de5" exitCode=0 Jun 11 21:20:57.859610 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:57.859216 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9jlb" event={"ID":"a95ef77e-0ed6-41b7-ac1d-55b120e47925","Type":"ContainerDied","Data":"8b0525faa52ce96cd250b815e6e61e1f8155902335960699b7e5a32d72de2de5"} Jun 11 21:20:58.702324 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:58.702287 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:20:58.702509 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:58.702396 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:20:58.702509 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:58.702448 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:20:58.702509 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:58.702487 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:20:58.702692 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:20:58.702513 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:20:58.702692 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:20:58.702604 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:21:00.701780 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:00.701742 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:21:00.702508 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:00.701850 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:21:00.702508 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:00.701744 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:21:00.702508 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:00.701889 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:21:00.702508 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:00.701982 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:21:00.702508 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:00.702060 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:21:02.398070 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:02.398027 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:21:02.398631 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:02.398111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:21:02.398631 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:02.398200 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:21:02.398631 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:02.398226 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:21:02.398631 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:02.398291 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret podName:38e4770b-2228-4dff-802c-db3c7594d72c nodeName:}" failed. No retries permitted until 2026-06-11 21:21:34.398270346 +0000 UTC m=+66.172210302 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret") pod "global-pull-secret-syncer-g45jc" (UID: "38e4770b-2228-4dff-802c-db3c7594d72c") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:21:02.398631 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:02.398312 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs podName:0e097be0-6ad1-4fea-9652-09fe7e0b89e1 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:34.398303481 +0000 UTC m=+66.172243417 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs") pod "network-metrics-daemon-k5xgg" (UID: "0e097be0-6ad1-4fea-9652-09fe7e0b89e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:21:02.599540 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:02.599505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5q8s\" (UniqueName: \"kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s\") pod \"network-check-target-bxt48\" (UID: \"acf283d0-9a2d-4736-b496-b433b3602e97\") " pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:21:02.599787 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:02.599702 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:21:02.599787 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:02.599722 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:21:02.599787 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:02.599732 2581 projected.go:196] Error preparing data for projected volume kube-api-access-d5q8s for pod openshift-network-diagnostics/network-check-target-bxt48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:21:02.599787 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:02.599788 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s podName:acf283d0-9a2d-4736-b496-b433b3602e97 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:34.599773529 +0000 UTC m=+66.373713463 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5q8s" (UniqueName: "kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s") pod "network-check-target-bxt48" (UID: "acf283d0-9a2d-4736-b496-b433b3602e97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:21:02.701897 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:02.701813 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:21:02.702206 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:02.701820 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:21:02.702206 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:02.701919 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g45jc" podUID="38e4770b-2228-4dff-802c-db3c7594d72c" Jun 11 21:21:02.702206 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:02.701817 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:21:02.702206 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:02.701997 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:21:02.702206 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:02.702095 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxt48" podUID="acf283d0-9a2d-4736-b496-b433b3602e97" Jun 11 21:21:03.877356 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:03.877324 2581 generic.go:356] "Generic (PLEG): container finished" podID="a95ef77e-0ed6-41b7-ac1d-55b120e47925" containerID="134ad72bc270432cc0770b7d77957f4c67fdc6ad4d5fe2d0585846791a9eca73" exitCode=0 Jun 11 21:21:03.877997 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:03.877387 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9jlb" event={"ID":"a95ef77e-0ed6-41b7-ac1d-55b120e47925","Type":"ContainerDied","Data":"134ad72bc270432cc0770b7d77957f4c67fdc6ad4d5fe2d0585846791a9eca73"} Jun 11 21:21:04.009754 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.009715 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeReady" Jun 11 21:21:04.009982 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.009874 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 21:21:04.053010 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.052977 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8vn6m"] Jun 11 21:21:04.064072 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.064047 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5l5kw"] Jun 11 21:21:04.064205 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.064186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:04.067027 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.066996 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 21:21:04.067172 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.067095 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x2227\"" Jun 11 21:21:04.067228 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.067005 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 21:21:04.076467 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.076447 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5l5kw"] Jun 11 21:21:04.076566 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.076475 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8vn6m"] Jun 11 21:21:04.076566 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.076549 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5l5kw" Jun 11 21:21:04.078835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.078813 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 21:21:04.078993 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.078964 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 21:21:04.079110 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.079022 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 21:21:04.079297 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.079277 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-94xrb\"" Jun 11 21:21:04.211699 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.211611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bcfddbf-7cfb-4f14-8fa4-89e702554ddb-cert\") pod \"ingress-canary-5l5kw\" (UID: \"3bcfddbf-7cfb-4f14-8fa4-89e702554ddb\") " pod="openshift-ingress-canary/ingress-canary-5l5kw" Jun 11 21:21:04.211699 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.211648 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:04.211699 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.211675 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cddedd15-ffbc-40cc-9327-b496b9474e62-config-volume\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:04.211902 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.211706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swhlz\" (UniqueName: \"kubernetes.io/projected/cddedd15-ffbc-40cc-9327-b496b9474e62-kube-api-access-swhlz\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:04.211902 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.211752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9ll2\" (UniqueName: \"kubernetes.io/projected/3bcfddbf-7cfb-4f14-8fa4-89e702554ddb-kube-api-access-p9ll2\") pod \"ingress-canary-5l5kw\" (UID: \"3bcfddbf-7cfb-4f14-8fa4-89e702554ddb\") " pod="openshift-ingress-canary/ingress-canary-5l5kw" Jun 11 21:21:04.211902 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.211803 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cddedd15-ffbc-40cc-9327-b496b9474e62-tmp-dir\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:04.313036 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.313003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bcfddbf-7cfb-4f14-8fa4-89e702554ddb-cert\") pod \"ingress-canary-5l5kw\" (UID: \"3bcfddbf-7cfb-4f14-8fa4-89e702554ddb\") " pod="openshift-ingress-canary/ingress-canary-5l5kw" Jun 11 21:21:04.313036 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.313039 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:04.313267 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.313056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cddedd15-ffbc-40cc-9327-b496b9474e62-config-volume\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:04.313267 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.313081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swhlz\" (UniqueName: \"kubernetes.io/projected/cddedd15-ffbc-40cc-9327-b496b9474e62-kube-api-access-swhlz\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:04.313267 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.313121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9ll2\" (UniqueName: \"kubernetes.io/projected/3bcfddbf-7cfb-4f14-8fa4-89e702554ddb-kube-api-access-p9ll2\") pod \"ingress-canary-5l5kw\" (UID: \"3bcfddbf-7cfb-4f14-8fa4-89e702554ddb\") " pod="openshift-ingress-canary/ingress-canary-5l5kw" Jun 11 21:21:04.313267 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.313156 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cddedd15-ffbc-40cc-9327-b496b9474e62-tmp-dir\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:04.313267 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:04.313154 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:21:04.313267 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:04.313241 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls podName:cddedd15-ffbc-40cc-9327-b496b9474e62 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:04.813222364 +0000 UTC m=+36.587162318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls") pod "dns-default-8vn6m" (UID: "cddedd15-ffbc-40cc-9327-b496b9474e62") : secret "dns-default-metrics-tls" not found Jun 11 21:21:04.313745 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.313577 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cddedd15-ffbc-40cc-9327-b496b9474e62-tmp-dir\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:04.313809 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.313710 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cddedd15-ffbc-40cc-9327-b496b9474e62-config-volume\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:04.317567 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.317547 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bcfddbf-7cfb-4f14-8fa4-89e702554ddb-cert\") pod \"ingress-canary-5l5kw\" (UID: \"3bcfddbf-7cfb-4f14-8fa4-89e702554ddb\") " pod="openshift-ingress-canary/ingress-canary-5l5kw" Jun 11 21:21:04.321360 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.321337 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swhlz\" (UniqueName: \"kubernetes.io/projected/cddedd15-ffbc-40cc-9327-b496b9474e62-kube-api-access-swhlz\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:04.321635 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.321615 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9ll2\" (UniqueName: \"kubernetes.io/projected/3bcfddbf-7cfb-4f14-8fa4-89e702554ddb-kube-api-access-p9ll2\") pod \"ingress-canary-5l5kw\" (UID: \"3bcfddbf-7cfb-4f14-8fa4-89e702554ddb\") " pod="openshift-ingress-canary/ingress-canary-5l5kw" Jun 11 21:21:04.428571 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.428535 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5l5kw" Jun 11 21:21:04.642231 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.642197 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5l5kw"] Jun 11 21:21:04.646441 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:21:04.646396 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bcfddbf_7cfb_4f14_8fa4_89e702554ddb.slice/crio-c4e57fff4949d125908ca3a77d50c82891cbc0ac2bed4eb17db517b93da0377e WatchSource:0}: Error finding container c4e57fff4949d125908ca3a77d50c82891cbc0ac2bed4eb17db517b93da0377e: Status 404 returned error can't find the container with id c4e57fff4949d125908ca3a77d50c82891cbc0ac2bed4eb17db517b93da0377e Jun 11 21:21:04.702101 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.702058 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:21:04.702101 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.702082 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:21:04.702341 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.702065 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:21:04.705631 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.705590 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 21:21:04.705631 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.705606 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l7p7b\"" Jun 11 21:21:04.705834 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.705600 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 21:21:04.705834 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.705600 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tj6vl\"" Jun 11 21:21:04.705834 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.705617 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 21:21:04.705834 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.705600 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 21:21:04.815786 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.815700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:04.815935 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:04.815883 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:21:04.815975 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:04.815939 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls podName:cddedd15-ffbc-40cc-9327-b496b9474e62 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:05.815923723 +0000 UTC m=+37.589863657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls") pod "dns-default-8vn6m" (UID: "cddedd15-ffbc-40cc-9327-b496b9474e62") : secret "dns-default-metrics-tls" not found Jun 11 21:21:04.882732 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.882700 2581 generic.go:356] "Generic (PLEG): container finished" podID="a95ef77e-0ed6-41b7-ac1d-55b120e47925" containerID="edb02127ccaa79f718add46a8e5e8ea01a3cdea7efe9362b23cf93fb061127d0" exitCode=0 Jun 11 21:21:04.883184 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.882782 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9jlb" event={"ID":"a95ef77e-0ed6-41b7-ac1d-55b120e47925","Type":"ContainerDied","Data":"edb02127ccaa79f718add46a8e5e8ea01a3cdea7efe9362b23cf93fb061127d0"} Jun 11 21:21:04.883881 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:04.883855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5l5kw" event={"ID":"3bcfddbf-7cfb-4f14-8fa4-89e702554ddb","Type":"ContainerStarted","Data":"c4e57fff4949d125908ca3a77d50c82891cbc0ac2bed4eb17db517b93da0377e"} Jun 11 21:21:05.823398 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:05.823199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:05.823398 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:05.823385 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:21:05.823625 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:05.823483 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls podName:cddedd15-ffbc-40cc-9327-b496b9474e62 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:07.823461805 +0000 UTC m=+39.597401744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls") pod "dns-default-8vn6m" (UID: "cddedd15-ffbc-40cc-9327-b496b9474e62") : secret "dns-default-metrics-tls" not found Jun 11 21:21:05.890318 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:05.890287 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9jlb" event={"ID":"a95ef77e-0ed6-41b7-ac1d-55b120e47925","Type":"ContainerStarted","Data":"f56f200159a6cd6d8e8ac1d74dc7a8877ffbb7850ffe99a94c4f1bca4f922c0f"} Jun 11 21:21:05.914826 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:05.914771 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b9jlb" podStartSLOduration=8.952613096 podStartE2EDuration="37.914753542s" totalImagesPullingTime="28.962140446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:21:05.914182807 +0000 UTC m=+37.688122757" watchObservedRunningTime="2026-06-11 21:21:05.914753542 +0000 UTC m=+37.688693499" Jun 11 21:21:06.894199 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:06.894159 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5l5kw" event={"ID":"3bcfddbf-7cfb-4f14-8fa4-89e702554ddb","Type":"ContainerStarted","Data":"f5bf34c5d1326c251fda28eab238af2a3e2a1bdc7ba51bc2bb786e1fa7e86438"} Jun 11 21:21:06.909192 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:06.909118 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5l5kw" podStartSLOduration=1.042319804 podStartE2EDuration="2.909102801s" totalImagesPullingTime="1.866782997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:21:06.9078572 +0000 UTC m=+38.681797157" watchObservedRunningTime="2026-06-11 21:21:06.909102801 +0000 UTC m=+38.683042756" Jun 11 21:21:07.841159 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:07.841118 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:07.841336 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:07.841273 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:21:07.841336 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:07.841332 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls podName:cddedd15-ffbc-40cc-9327-b496b9474e62 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:11.841314646 +0000 UTC m=+43.615254600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls") pod "dns-default-8vn6m" (UID: "cddedd15-ffbc-40cc-9327-b496b9474e62") : secret "dns-default-metrics-tls" not found Jun 11 21:21:11.866022 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:11.865981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:11.866674 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:11.866136 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:21:11.866674 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:11.866197 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls podName:cddedd15-ffbc-40cc-9327-b496b9474e62 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:19.866183369 +0000 UTC m=+51.640123308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls") pod "dns-default-8vn6m" (UID: "cddedd15-ffbc-40cc-9327-b496b9474e62") : secret "dns-default-metrics-tls" not found Jun 11 21:21:19.918551 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:19.918504 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:19.919153 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:19.918693 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:21:19.919153 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:19.918778 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls podName:cddedd15-ffbc-40cc-9327-b496b9474e62 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:35.918758432 +0000 UTC m=+67.692698370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls") pod "dns-default-8vn6m" (UID: "cddedd15-ffbc-40cc-9327-b496b9474e62") : secret "dns-default-metrics-tls" not found Jun 11 21:21:28.872586 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:28.872558 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xhllk" Jun 11 21:21:34.413057 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.413013 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:21:34.413057 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.413069 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:21:34.415736 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.415715 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 21:21:34.415905 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.415894 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 21:21:34.423835 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:34.423817 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 21:21:34.423900 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:34.423892 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs podName:0e097be0-6ad1-4fea-9652-09fe7e0b89e1 nodeName:}" failed. No retries permitted until 2026-06-11 21:22:38.423873554 +0000 UTC m=+130.197813504 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs") pod "network-metrics-daemon-k5xgg" (UID: "0e097be0-6ad1-4fea-9652-09fe7e0b89e1") : secret "metrics-daemon-secret" not found Jun 11 21:21:34.427226 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.427202 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38e4770b-2228-4dff-802c-db3c7594d72c-original-pull-secret\") pod \"global-pull-secret-syncer-g45jc\" (UID: \"38e4770b-2228-4dff-802c-db3c7594d72c\") " pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:21:34.613985 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.613954 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5q8s\" (UniqueName: \"kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s\") pod \"network-check-target-bxt48\" (UID: \"acf283d0-9a2d-4736-b496-b433b3602e97\") " pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:21:34.616926 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.616899 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 21:21:34.627272 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.627253 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 21:21:34.637574 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.637548 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5q8s\" (UniqueName: \"kubernetes.io/projected/acf283d0-9a2d-4736-b496-b433b3602e97-kube-api-access-d5q8s\") pod \"network-check-target-bxt48\" (UID: \"acf283d0-9a2d-4736-b496-b433b3602e97\") " pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:21:34.715821 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.715767 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tj6vl\"" Jun 11 21:21:34.722599 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.722585 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:21:34.722689 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.722674 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g45jc" Jun 11 21:21:34.882845 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.882817 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bxt48"] Jun 11 21:21:34.885608 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:21:34.885583 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf283d0_9a2d_4736_b496_b433b3602e97.slice/crio-6f5f41c30047eb8ed091877dd3d1fe017dc3ef04985f4484c76dd8529ea1c82c WatchSource:0}: Error finding container 6f5f41c30047eb8ed091877dd3d1fe017dc3ef04985f4484c76dd8529ea1c82c: Status 404 returned error can't find the container with id 6f5f41c30047eb8ed091877dd3d1fe017dc3ef04985f4484c76dd8529ea1c82c Jun 11 21:21:34.900380 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.900359 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g45jc"] Jun 11 21:21:34.903198 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:21:34.903177 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e4770b_2228_4dff_802c_db3c7594d72c.slice/crio-c689d933ed2e1484ee831fb4ecb0bd6c356c56c0155dd3b81f2e34feb0d9e7db WatchSource:0}: Error finding container c689d933ed2e1484ee831fb4ecb0bd6c356c56c0155dd3b81f2e34feb0d9e7db: Status 404 returned error can't find the container with id c689d933ed2e1484ee831fb4ecb0bd6c356c56c0155dd3b81f2e34feb0d9e7db Jun 11 21:21:34.958778 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.958748 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g45jc" event={"ID":"38e4770b-2228-4dff-802c-db3c7594d72c","Type":"ContainerStarted","Data":"c689d933ed2e1484ee831fb4ecb0bd6c356c56c0155dd3b81f2e34feb0d9e7db"} Jun 11 21:21:34.959802 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:34.959774 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bxt48" event={"ID":"acf283d0-9a2d-4736-b496-b433b3602e97","Type":"ContainerStarted","Data":"6f5f41c30047eb8ed091877dd3d1fe017dc3ef04985f4484c76dd8529ea1c82c"} Jun 11 21:21:35.922438 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:35.922161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:21:35.922438 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:35.922337 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:21:35.922438 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:21:35.922397 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls podName:cddedd15-ffbc-40cc-9327-b496b9474e62 nodeName:}" failed. No retries permitted until 2026-06-11 21:22:07.922380119 +0000 UTC m=+99.696320055 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls") pod "dns-default-8vn6m" (UID: "cddedd15-ffbc-40cc-9327-b496b9474e62") : secret "dns-default-metrics-tls" not found Jun 11 21:21:39.974967 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:39.974915 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g45jc" event={"ID":"38e4770b-2228-4dff-802c-db3c7594d72c","Type":"ContainerStarted","Data":"e3a3e336f812d43c18bc5c7372a4372c98e04638f6aea4a7b73a2b3b53621fe8"} Jun 11 21:21:39.976391 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:39.976361 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bxt48" event={"ID":"acf283d0-9a2d-4736-b496-b433b3602e97","Type":"ContainerStarted","Data":"3f87efe8fa4547f1790f91b258994dca0af7a69dea91a6e651c911c3741f5cbd"} Jun 11 21:21:39.976527 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:39.976421 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:21:39.990310 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:39.990266 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g45jc" podStartSLOduration=67.131954134 podStartE2EDuration="1m11.990251428s" totalImagesPullingTime="4.858297294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:21:39.98987192 +0000 UTC m=+71.763811879" watchObservedRunningTime="2026-06-11 21:21:39.990251428 +0000 UTC m=+71.764191383" Jun 11 21:21:40.005862 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:21:40.005811 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bxt48" podStartSLOduration=67.130339905 podStartE2EDuration="1m12.00579247s" totalImagesPullingTime="4.875452565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:21:40.005331641 +0000 UTC m=+71.779271597" watchObservedRunningTime="2026-06-11 21:21:40.00579247 +0000 UTC m=+71.779732427" Jun 11 21:22:07.940273 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:22:07.940240 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:22:07.940748 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:22:07.940375 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:22:07.940748 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:22:07.940452 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls podName:cddedd15-ffbc-40cc-9327-b496b9474e62 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:11.940438412 +0000 UTC m=+163.714378346 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls") pod "dns-default-8vn6m" (UID: "cddedd15-ffbc-40cc-9327-b496b9474e62") : secret "dns-default-metrics-tls" not found Jun 11 21:22:10.981559 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:22:10.981528 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bxt48" Jun 11 21:22:38.431179 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:22:38.431132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:22:38.431705 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:22:38.431249 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 21:22:38.431705 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:22:38.431303 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs podName:0e097be0-6ad1-4fea-9652-09fe7e0b89e1 nodeName:}" failed. No retries permitted until 2026-06-11 21:24:40.431288793 +0000 UTC m=+252.205228727 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs") pod "network-metrics-daemon-k5xgg" (UID: "0e097be0-6ad1-4fea-9652-09fe7e0b89e1") : secret "metrics-daemon-secret" not found Jun 11 21:23:07.123837 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:07.123778 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8vn6m" podUID="cddedd15-ffbc-40cc-9327-b496b9474e62" Jun 11 21:23:07.173745 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:07.173707 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vn6m" Jun 11 21:23:07.718032 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:07.717983 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-k5xgg" podUID="0e097be0-6ad1-4fea-9652-09fe7e0b89e1" Jun 11 21:23:11.955849 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:11.955773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:23:11.956286 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:11.955884 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:23:11.956286 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:11.955962 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls podName:cddedd15-ffbc-40cc-9327-b496b9474e62 nodeName:}" failed. No retries permitted until 2026-06-11 21:25:13.955950721 +0000 UTC m=+285.729890655 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls") pod "dns-default-8vn6m" (UID: "cddedd15-ffbc-40cc-9327-b496b9474e62") : secret "dns-default-metrics-tls" not found Jun 11 21:23:21.339850 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.339812 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh"] Jun 11 21:23:21.341543 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.341523 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" Jun 11 21:23:21.344023 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.344001 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 21:23:21.344156 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.344044 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 21:23:21.344156 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.344132 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:23:21.344539 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.344522 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 21:23:21.344993 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.344975 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ccsxn\"" Jun 11 21:23:21.356711 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.356689 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh"] Jun 11 21:23:21.420282 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.420244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xdtw\" (UniqueName: \"kubernetes.io/projected/29bb2707-c217-4af7-bed1-b2a0800942ec-kube-api-access-6xdtw\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nhxxh\" (UID: \"29bb2707-c217-4af7-bed1-b2a0800942ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" Jun 11 21:23:21.420282 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.420282 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29bb2707-c217-4af7-bed1-b2a0800942ec-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nhxxh\" (UID: \"29bb2707-c217-4af7-bed1-b2a0800942ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" Jun 11 21:23:21.420531 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.420312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29bb2707-c217-4af7-bed1-b2a0800942ec-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nhxxh\" (UID: \"29bb2707-c217-4af7-bed1-b2a0800942ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" Jun 11 21:23:21.439503 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.439477 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-xd9h4"] Jun 11 21:23:21.441176 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.441161 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-xd9h4" Jun 11 21:23:21.443645 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.443614 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 21:23:21.443774 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.443697 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-zl8nl"] Jun 11 21:23:21.443774 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.443756 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gvrwv\"" Jun 11 21:23:21.443894 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.443759 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:23:21.445095 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.445080 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h"] Jun 11 21:23:21.445237 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.445221 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.446799 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.446782 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" Jun 11 21:23:21.448202 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.448120 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 21:23:21.448600 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.448582 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 21:23:21.448791 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.448779 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 21:23:21.448867 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.448816 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 21:23:21.448926 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.448920 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 21:23:21.449060 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.449043 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kh4xc\"" Jun 11 21:23:21.451025 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.451006 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:23:21.453633 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.453602 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 21:23:21.453729 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.453602 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nxp7b\"" Jun 11 21:23:21.457546 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.457461 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-xd9h4"] Jun 11 21:23:21.457775 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.457754 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 21:23:21.458463 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.458444 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h"] Jun 11 21:23:21.459351 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.459332 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-zl8nl"] Jun 11 21:23:21.521465 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.521430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29bb2707-c217-4af7-bed1-b2a0800942ec-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nhxxh\" (UID: \"29bb2707-c217-4af7-bed1-b2a0800942ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" Jun 11 21:23:21.521653 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.521530 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xdtw\" (UniqueName: \"kubernetes.io/projected/29bb2707-c217-4af7-bed1-b2a0800942ec-kube-api-access-6xdtw\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nhxxh\" (UID: \"29bb2707-c217-4af7-bed1-b2a0800942ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" Jun 11 21:23:21.521653 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.521562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29bb2707-c217-4af7-bed1-b2a0800942ec-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nhxxh\" (UID: \"29bb2707-c217-4af7-bed1-b2a0800942ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" Jun 11 21:23:21.521653 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.521588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvtwk\" (UniqueName: \"kubernetes.io/projected/6a05d46a-3e83-441f-aeb3-391fe0481fe4-kube-api-access-tvtwk\") pod \"volume-data-source-validator-bd4ccd799-xd9h4\" (UID: \"6a05d46a-3e83-441f-aeb3-391fe0481fe4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-xd9h4" Jun 11 21:23:21.522026 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.522006 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29bb2707-c217-4af7-bed1-b2a0800942ec-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nhxxh\" (UID: \"29bb2707-c217-4af7-bed1-b2a0800942ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" Jun 11 21:23:21.523689 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.523664 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29bb2707-c217-4af7-bed1-b2a0800942ec-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nhxxh\" (UID: \"29bb2707-c217-4af7-bed1-b2a0800942ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" Jun 11 21:23:21.534570 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.534550 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-8jrp2"] Jun 11 21:23:21.536369 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.536354 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" Jun 11 21:23:21.537310 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.537281 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xdtw\" (UniqueName: \"kubernetes.io/projected/29bb2707-c217-4af7-bed1-b2a0800942ec-kube-api-access-6xdtw\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nhxxh\" (UID: \"29bb2707-c217-4af7-bed1-b2a0800942ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" Jun 11 21:23:21.538425 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.538394 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 21:23:21.538501 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.538439 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rk8p6\"" Jun 11 21:23:21.538635 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.538622 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 21:23:21.541506 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.541458 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-595dc98f7b-hphqq"] Jun 11 21:23:21.543130 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.543116 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:21.545506 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.545489 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 21:23:21.545600 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.545508 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 21:23:21.545784 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.545765 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j4rsd\"" Jun 11 21:23:21.545890 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.545828 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 21:23:21.546016 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.546000 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 21:23:21.546124 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.546105 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 21:23:21.546191 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.546136 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 21:23:21.547501 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.547473 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-8jrp2"] Jun 11 21:23:21.556804 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.556782 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-595dc98f7b-hphqq"] Jun 11 21:23:21.622306 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.622276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-serving-cert\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.622480 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.622312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jwfv\" (UniqueName: \"kubernetes.io/projected/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-kube-api-access-6jwfv\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.622480 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.622334 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8jrp2\" (UID: \"98aa7006-7fc7-4375-8d9f-51a8f9e0171a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" Jun 11 21:23:21.622480 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.622395 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz7xt\" (UniqueName: \"kubernetes.io/projected/2a596ed4-5b47-4e8a-820d-d712ee82797f-kube-api-access-vz7xt\") pod \"cluster-samples-operator-9547488fd-f8d4h\" (UID: \"2a596ed4-5b47-4e8a-820d-d712ee82797f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" Jun 11 21:23:21.622613 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.622493 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.622613 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.622524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvtwk\" (UniqueName: \"kubernetes.io/projected/6a05d46a-3e83-441f-aeb3-391fe0481fe4-kube-api-access-tvtwk\") pod \"volume-data-source-validator-bd4ccd799-xd9h4\" (UID: \"6a05d46a-3e83-441f-aeb3-391fe0481fe4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-xd9h4" Jun 11 21:23:21.622613 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.622578 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-tmp\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.622717 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.622610 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.622717 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.622635 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-nginx-conf\") pod \"networking-console-plugin-867b76cb74-8jrp2\" (UID: \"98aa7006-7fc7-4375-8d9f-51a8f9e0171a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" Jun 11 21:23:21.622717 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.622654 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-f8d4h\" (UID: \"2a596ed4-5b47-4e8a-820d-d712ee82797f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" Jun 11 21:23:21.622717 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.622675 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-snapshots\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.630565 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.630546 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvtwk\" (UniqueName: \"kubernetes.io/projected/6a05d46a-3e83-441f-aeb3-391fe0481fe4-kube-api-access-tvtwk\") pod \"volume-data-source-validator-bd4ccd799-xd9h4\" (UID: \"6a05d46a-3e83-441f-aeb3-391fe0481fe4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-xd9h4" Jun 11 21:23:21.650479 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.650443 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" Jun 11 21:23:21.723697 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.723589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz7xt\" (UniqueName: \"kubernetes.io/projected/2a596ed4-5b47-4e8a-820d-d712ee82797f-kube-api-access-vz7xt\") pod \"cluster-samples-operator-9547488fd-f8d4h\" (UID: \"2a596ed4-5b47-4e8a-820d-d712ee82797f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" Jun 11 21:23:21.723697 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.723624 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.723697 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.723662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-tmp\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.724059 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724007 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.724059 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-nginx-conf\") pod \"networking-console-plugin-867b76cb74-8jrp2\" (UID: \"98aa7006-7fc7-4375-8d9f-51a8f9e0171a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" Jun 11 21:23:21.724059 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724054 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-tmp\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.724277 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-f8d4h\" (UID: \"2a596ed4-5b47-4e8a-820d-d712ee82797f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" Jun 11 21:23:21.724277 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724111 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-default-certificate\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:21.724277 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:21.724277 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724165 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-snapshots\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.724277 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:21.724277 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzjzn\" (UniqueName: \"kubernetes.io/projected/197e0956-cb50-413d-8ace-dac9967f2a80-kube-api-access-bzjzn\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:21.724277 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:21.724225 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:23:21.724277 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724260 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-stats-auth\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:21.724695 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:21.724293 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls podName:2a596ed4-5b47-4e8a-820d-d712ee82797f nodeName:}" failed. No retries permitted until 2026-06-11 21:23:22.224274854 +0000 UTC m=+173.998214789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls") pod "cluster-samples-operator-9547488fd-f8d4h" (UID: "2a596ed4-5b47-4e8a-820d-d712ee82797f") : secret "samples-operator-tls" not found Jun 11 21:23:21.724695 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-serving-cert\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.724695 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jwfv\" (UniqueName: \"kubernetes.io/projected/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-kube-api-access-6jwfv\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.724695 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724380 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8jrp2\" (UID: \"98aa7006-7fc7-4375-8d9f-51a8f9e0171a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" Jun 11 21:23:21.724695 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:21.724529 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 21:23:21.724695 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:21.724586 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert podName:98aa7006-7fc7-4375-8d9f-51a8f9e0171a nodeName:}" failed. No retries permitted until 2026-06-11 21:23:22.224572312 +0000 UTC m=+173.998512261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-8jrp2" (UID: "98aa7006-7fc7-4375-8d9f-51a8f9e0171a") : secret "networking-console-plugin-cert" not found Jun 11 21:23:21.724996 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724696 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-nginx-conf\") pod \"networking-console-plugin-867b76cb74-8jrp2\" (UID: \"98aa7006-7fc7-4375-8d9f-51a8f9e0171a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" Jun 11 21:23:21.724996 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.724737 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.725099 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.725077 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-snapshots\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.725173 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.725127 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.727232 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.727199 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-serving-cert\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.732860 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.732839 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jwfv\" (UniqueName: \"kubernetes.io/projected/cbfce66f-8c70-4439-96bf-0fa73ae1a6af-kube-api-access-6jwfv\") pod \"insights-operator-5bbd86d6bd-zl8nl\" (UID: \"cbfce66f-8c70-4439-96bf-0fa73ae1a6af\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.733003 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.732988 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz7xt\" (UniqueName: \"kubernetes.io/projected/2a596ed4-5b47-4e8a-820d-d712ee82797f-kube-api-access-vz7xt\") pod \"cluster-samples-operator-9547488fd-f8d4h\" (UID: \"2a596ed4-5b47-4e8a-820d-d712ee82797f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" Jun 11 21:23:21.752309 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.752287 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-xd9h4" Jun 11 21:23:21.760060 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.760040 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" Jun 11 21:23:21.771676 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.771655 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh"] Jun 11 21:23:21.774611 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:23:21.774580 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29bb2707_c217_4af7_bed1_b2a0800942ec.slice/crio-0a09db1613f61d3c9d863ff12df0d1cc26ed067866ca03123d09b5764f6ccaab WatchSource:0}: Error finding container 0a09db1613f61d3c9d863ff12df0d1cc26ed067866ca03123d09b5764f6ccaab: Status 404 returned error can't find the container with id 0a09db1613f61d3c9d863ff12df0d1cc26ed067866ca03123d09b5764f6ccaab Jun 11 21:23:21.824914 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.824866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-default-certificate\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:21.825084 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.824920 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:21.825084 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.824954 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:21.825084 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.824979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzjzn\" (UniqueName: \"kubernetes.io/projected/197e0956-cb50-413d-8ace-dac9967f2a80-kube-api-access-bzjzn\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:21.825084 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.825022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-stats-auth\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:21.825084 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:21.825063 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:23:21.825357 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:21.825132 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle podName:197e0956-cb50-413d-8ace-dac9967f2a80 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:22.325106799 +0000 UTC m=+174.099046733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle") pod "router-default-595dc98f7b-hphqq" (UID: "197e0956-cb50-413d-8ace-dac9967f2a80") : configmap references non-existent config key: service-ca.crt Jun 11 21:23:21.825357 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:21.825162 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs podName:197e0956-cb50-413d-8ace-dac9967f2a80 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:22.325151735 +0000 UTC m=+174.099091673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs") pod "router-default-595dc98f7b-hphqq" (UID: "197e0956-cb50-413d-8ace-dac9967f2a80") : secret "router-metrics-certs-default" not found Jun 11 21:23:21.827420 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.827386 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-default-certificate\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:21.827610 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.827551 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-stats-auth\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:21.833109 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.833088 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzjzn\" (UniqueName: \"kubernetes.io/projected/197e0956-cb50-413d-8ace-dac9967f2a80-kube-api-access-bzjzn\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:21.876687 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.876624 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-xd9h4"] Jun 11 21:23:21.880008 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:23:21.879984 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a05d46a_3e83_441f_aeb3_391fe0481fe4.slice/crio-889328c97d969b8a42fe1c56743608a3f7233c5961799fb6c893786c9528bf9b WatchSource:0}: Error finding container 889328c97d969b8a42fe1c56743608a3f7233c5961799fb6c893786c9528bf9b: Status 404 returned error can't find the container with id 889328c97d969b8a42fe1c56743608a3f7233c5961799fb6c893786c9528bf9b Jun 11 21:23:21.895585 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:21.895560 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-zl8nl"] Jun 11 21:23:21.898261 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:23:21.898239 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbfce66f_8c70_4439_96bf_0fa73ae1a6af.slice/crio-35637af4fd26712d4928ae386e18a4e312854b0d52e095ed63c54b8c84d540df WatchSource:0}: Error finding container 35637af4fd26712d4928ae386e18a4e312854b0d52e095ed63c54b8c84d540df: Status 404 returned error can't find the container with id 35637af4fd26712d4928ae386e18a4e312854b0d52e095ed63c54b8c84d540df Jun 11 21:23:22.208788 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:22.208694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" event={"ID":"29bb2707-c217-4af7-bed1-b2a0800942ec","Type":"ContainerStarted","Data":"0a09db1613f61d3c9d863ff12df0d1cc26ed067866ca03123d09b5764f6ccaab"} Jun 11 21:23:22.209557 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:22.209523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" event={"ID":"cbfce66f-8c70-4439-96bf-0fa73ae1a6af","Type":"ContainerStarted","Data":"35637af4fd26712d4928ae386e18a4e312854b0d52e095ed63c54b8c84d540df"} Jun 11 21:23:22.210462 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:22.210443 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-xd9h4" event={"ID":"6a05d46a-3e83-441f-aeb3-391fe0481fe4","Type":"ContainerStarted","Data":"889328c97d969b8a42fe1c56743608a3f7233c5961799fb6c893786c9528bf9b"} Jun 11 21:23:22.227776 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:22.227751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-f8d4h\" (UID: \"2a596ed4-5b47-4e8a-820d-d712ee82797f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" Jun 11 21:23:22.227913 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:22.227895 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:23:22.227959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:22.227913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8jrp2\" (UID: \"98aa7006-7fc7-4375-8d9f-51a8f9e0171a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" Jun 11 21:23:22.228002 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:22.227962 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls podName:2a596ed4-5b47-4e8a-820d-d712ee82797f nodeName:}" failed. No retries permitted until 2026-06-11 21:23:23.227944319 +0000 UTC m=+175.001884253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls") pod "cluster-samples-operator-9547488fd-f8d4h" (UID: "2a596ed4-5b47-4e8a-820d-d712ee82797f") : secret "samples-operator-tls" not found Jun 11 21:23:22.228048 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:22.228025 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 21:23:22.228088 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:22.228071 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert podName:98aa7006-7fc7-4375-8d9f-51a8f9e0171a nodeName:}" failed. No retries permitted until 2026-06-11 21:23:23.228058431 +0000 UTC m=+175.001998382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-8jrp2" (UID: "98aa7006-7fc7-4375-8d9f-51a8f9e0171a") : secret "networking-console-plugin-cert" not found Jun 11 21:23:22.328773 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:22.328743 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:22.328930 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:22.328780 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:22.328930 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:22.328906 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:23:22.329034 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:22.328957 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs podName:197e0956-cb50-413d-8ace-dac9967f2a80 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:23.328943994 +0000 UTC m=+175.102883938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs") pod "router-default-595dc98f7b-hphqq" (UID: "197e0956-cb50-413d-8ace-dac9967f2a80") : secret "router-metrics-certs-default" not found Jun 11 21:23:22.329034 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:22.328971 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle podName:197e0956-cb50-413d-8ace-dac9967f2a80 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:23.328965993 +0000 UTC m=+175.102905927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle") pod "router-default-595dc98f7b-hphqq" (UID: "197e0956-cb50-413d-8ace-dac9967f2a80") : configmap references non-existent config key: service-ca.crt Jun 11 21:23:22.702343 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:22.702045 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:23:23.215198 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:23.215140 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-xd9h4" event={"ID":"6a05d46a-3e83-441f-aeb3-391fe0481fe4","Type":"ContainerStarted","Data":"eb23c4f318942d55be1e1b8950724bc62e52a2a91e5ddc00020587e356bb87d4"} Jun 11 21:23:23.231050 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:23.230996 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-xd9h4" podStartSLOduration=1.070028529 podStartE2EDuration="2.230980672s" totalImagesPullingTime="1.160952143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:23.228736356 +0000 UTC m=+175.002676322" watchObservedRunningTime="2026-06-11 21:23:23.230980672 +0000 UTC m=+175.004920621" Jun 11 21:23:23.236356 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:23.236332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-f8d4h\" (UID: \"2a596ed4-5b47-4e8a-820d-d712ee82797f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" Jun 11 21:23:23.236500 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:23.236434 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8jrp2\" (UID: \"98aa7006-7fc7-4375-8d9f-51a8f9e0171a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" Jun 11 21:23:23.236500 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:23.236493 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:23:23.236602 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:23.236533 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 21:23:23.236602 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:23.236561 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls podName:2a596ed4-5b47-4e8a-820d-d712ee82797f nodeName:}" failed. No retries permitted until 2026-06-11 21:23:25.236544948 +0000 UTC m=+177.010484897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls") pod "cluster-samples-operator-9547488fd-f8d4h" (UID: "2a596ed4-5b47-4e8a-820d-d712ee82797f") : secret "samples-operator-tls" not found Jun 11 21:23:23.236602 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:23.236580 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert podName:98aa7006-7fc7-4375-8d9f-51a8f9e0171a nodeName:}" failed. No retries permitted until 2026-06-11 21:23:25.236571333 +0000 UTC m=+177.010511274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-8jrp2" (UID: "98aa7006-7fc7-4375-8d9f-51a8f9e0171a") : secret "networking-console-plugin-cert" not found Jun 11 21:23:23.337157 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:23.337083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:23.337157 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:23.337125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:23.337361 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:23.337210 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:23:23.337361 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:23.337278 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle podName:197e0956-cb50-413d-8ace-dac9967f2a80 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:25.337261287 +0000 UTC m=+177.111201242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle") pod "router-default-595dc98f7b-hphqq" (UID: "197e0956-cb50-413d-8ace-dac9967f2a80") : configmap references non-existent config key: service-ca.crt Jun 11 21:23:23.337361 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:23.337300 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs podName:197e0956-cb50-413d-8ace-dac9967f2a80 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:25.33729189 +0000 UTC m=+177.111231825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs") pod "router-default-595dc98f7b-hphqq" (UID: "197e0956-cb50-413d-8ace-dac9967f2a80") : secret "router-metrics-certs-default" not found Jun 11 21:23:24.220699 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:24.220657 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" event={"ID":"cbfce66f-8c70-4439-96bf-0fa73ae1a6af","Type":"ContainerStarted","Data":"5085d235f7ffa78e91269fba0afebf6d6d1047d977ad176c3f0424fe4371546f"} Jun 11 21:23:24.237122 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:24.237072 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" podStartSLOduration=1.468933619 podStartE2EDuration="3.237053385s" totalImagesPullingTime="1.768119766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:24.236827114 +0000 UTC m=+176.010767071" watchObservedRunningTime="2026-06-11 21:23:24.237053385 +0000 UTC m=+176.010993343" Jun 11 21:23:24.988185 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:24.988152 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qnszc"] Jun 11 21:23:24.991511 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:24.991489 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:24.993845 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:24.993826 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tnblg\"" Jun 11 21:23:24.994245 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:24.994229 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 21:23:24.994598 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:24.994577 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 21:23:25.003985 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.003964 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qnszc"] Jun 11 21:23:25.152472 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.152443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.152660 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.152495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5317c62d-38f6-46b0-b670-2c3dd8be6dff-data-volume\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.152660 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.152589 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7xm5\" (UniqueName: \"kubernetes.io/projected/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-api-access-w7xm5\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.152660 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.152624 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5317c62d-38f6-46b0-b670-2c3dd8be6dff-crio-socket\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.152798 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.152688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.224387 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.224354 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" event={"ID":"29bb2707-c217-4af7-bed1-b2a0800942ec","Type":"ContainerStarted","Data":"b1241ac14a6390585110cef27ce3ad5c8bfdc2455bd0cbaa34b57abc1470b921"} Jun 11 21:23:25.239311 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.239230 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" podStartSLOduration=1.520777044 podStartE2EDuration="4.239216414s" totalImagesPullingTime="2.71843937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:25.238178684 +0000 UTC m=+177.012118640" watchObservedRunningTime="2026-06-11 21:23:25.239216414 +0000 UTC m=+177.013156731" Jun 11 21:23:25.253854 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.253829 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5317c62d-38f6-46b0-b670-2c3dd8be6dff-data-volume\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.253973 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.253861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8jrp2\" (UID: \"98aa7006-7fc7-4375-8d9f-51a8f9e0171a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" Jun 11 21:23:25.253973 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.253916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7xm5\" (UniqueName: \"kubernetes.io/projected/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-api-access-w7xm5\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.253973 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.253940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5317c62d-38f6-46b0-b670-2c3dd8be6dff-crio-socket\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.254129 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.254061 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 21:23:25.254129 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.254094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.254225 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.254132 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert podName:98aa7006-7fc7-4375-8d9f-51a8f9e0171a nodeName:}" failed. No retries permitted until 2026-06-11 21:23:29.254115684 +0000 UTC m=+181.028055621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-8jrp2" (UID: "98aa7006-7fc7-4375-8d9f-51a8f9e0171a") : secret "networking-console-plugin-cert" not found Jun 11 21:23:25.254225 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.254176 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5317c62d-38f6-46b0-b670-2c3dd8be6dff-data-volume\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.254225 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.254030 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5317c62d-38f6-46b0-b670-2c3dd8be6dff-crio-socket\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.254225 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.254197 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:23:25.254225 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.254206 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.254490 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.254242 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-f8d4h\" (UID: \"2a596ed4-5b47-4e8a-820d-d712ee82797f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" Jun 11 21:23:25.254490 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.254248 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls podName:5317c62d-38f6-46b0-b670-2c3dd8be6dff nodeName:}" failed. No retries permitted until 2026-06-11 21:23:25.754237158 +0000 UTC m=+177.528177095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qnszc" (UID: "5317c62d-38f6-46b0-b670-2c3dd8be6dff") : secret "insights-runtime-extractor-tls" not found Jun 11 21:23:25.254490 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.254300 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:23:25.254490 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.254340 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm podName:5317c62d-38f6-46b0-b670-2c3dd8be6dff nodeName:}" failed. No retries permitted until 2026-06-11 21:23:25.754328102 +0000 UTC m=+177.528268050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qnszc" (UID: "5317c62d-38f6-46b0-b670-2c3dd8be6dff") : configmap "kube-rbac-proxy" not found Jun 11 21:23:25.254490 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.254360 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:23:25.254490 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.254396 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls podName:2a596ed4-5b47-4e8a-820d-d712ee82797f nodeName:}" failed. No retries permitted until 2026-06-11 21:23:29.254385352 +0000 UTC m=+181.028325287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls") pod "cluster-samples-operator-9547488fd-f8d4h" (UID: "2a596ed4-5b47-4e8a-820d-d712ee82797f") : secret "samples-operator-tls" not found Jun 11 21:23:25.261450 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.261430 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7xm5\" (UniqueName: \"kubernetes.io/projected/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-api-access-w7xm5\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.354777 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.354742 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:25.354925 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.354790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:25.354925 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.354895 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:23:25.355029 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.354960 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs podName:197e0956-cb50-413d-8ace-dac9967f2a80 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:29.354942827 +0000 UTC m=+181.128882774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs") pod "router-default-595dc98f7b-hphqq" (UID: "197e0956-cb50-413d-8ace-dac9967f2a80") : secret "router-metrics-certs-default" not found Jun 11 21:23:25.355137 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.355122 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle podName:197e0956-cb50-413d-8ace-dac9967f2a80 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:29.355108306 +0000 UTC m=+181.129048254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle") pod "router-default-595dc98f7b-hphqq" (UID: "197e0956-cb50-413d-8ace-dac9967f2a80") : configmap references non-existent config key: service-ca.crt Jun 11 21:23:25.757945 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.757914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.758114 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:25.757962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:25.758114 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.758055 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:23:25.758114 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.758071 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:23:25.758114 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.758102 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm podName:5317c62d-38f6-46b0-b670-2c3dd8be6dff nodeName:}" failed. No retries permitted until 2026-06-11 21:23:26.758090313 +0000 UTC m=+178.532030248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qnszc" (UID: "5317c62d-38f6-46b0-b670-2c3dd8be6dff") : configmap "kube-rbac-proxy" not found Jun 11 21:23:25.758288 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:25.758127 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls podName:5317c62d-38f6-46b0-b670-2c3dd8be6dff nodeName:}" failed. No retries permitted until 2026-06-11 21:23:26.758111949 +0000 UTC m=+178.532051883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qnszc" (UID: "5317c62d-38f6-46b0-b670-2c3dd8be6dff") : secret "insights-runtime-extractor-tls" not found Jun 11 21:23:26.764370 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:26.764332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:26.764833 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:26.764397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:26.764833 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:26.764516 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:23:26.764833 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:26.764566 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm podName:5317c62d-38f6-46b0-b670-2c3dd8be6dff nodeName:}" failed. No retries permitted until 2026-06-11 21:23:28.764553769 +0000 UTC m=+180.538493704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qnszc" (UID: "5317c62d-38f6-46b0-b670-2c3dd8be6dff") : configmap "kube-rbac-proxy" not found Jun 11 21:23:26.764833 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:26.764566 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:23:26.764833 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:26.764633 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls podName:5317c62d-38f6-46b0-b670-2c3dd8be6dff nodeName:}" failed. No retries permitted until 2026-06-11 21:23:28.764615 +0000 UTC m=+180.538554947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qnszc" (UID: "5317c62d-38f6-46b0-b670-2c3dd8be6dff") : secret "insights-runtime-extractor-tls" not found Jun 11 21:23:26.957834 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:26.957806 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xd2qc_95b638f6-e8d8-46fb-821b-dc717ecf393d/dns-node-resolver/0.log" Jun 11 21:23:27.957592 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:27.957569 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5478n_1c69230f-56d8-4a47-99de-65e6ca8ace50/node-ca/0.log" Jun 11 21:23:28.558379 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.558352 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5l5kw_3bcfddbf-7cfb-4f14-8fa4-89e702554ddb/serve-healthcheck-canary/0.log" Jun 11 21:23:28.718095 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.718065 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-fbn85"] Jun 11 21:23:28.721501 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.721481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-fbn85" Jun 11 21:23:28.723608 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.723589 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 21:23:28.723734 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.723716 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 21:23:28.723783 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.723741 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 21:23:28.724747 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.724731 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 21:23:28.724842 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.724733 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-n6k4n\"" Jun 11 21:23:28.729307 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.729289 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-fbn85"] Jun 11 21:23:28.781392 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.781367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:28.781491 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.781437 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:28.781532 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:28.781517 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:23:28.781577 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:28.781571 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls podName:5317c62d-38f6-46b0-b670-2c3dd8be6dff nodeName:}" failed. No retries permitted until 2026-06-11 21:23:32.781558371 +0000 UTC m=+184.555498305 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qnszc" (UID: "5317c62d-38f6-46b0-b670-2c3dd8be6dff") : secret "insights-runtime-extractor-tls" not found Jun 11 21:23:28.781616 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:28.781524 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:23:28.781659 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:28.781648 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm podName:5317c62d-38f6-46b0-b670-2c3dd8be6dff nodeName:}" failed. No retries permitted until 2026-06-11 21:23:32.781636068 +0000 UTC m=+184.555576007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qnszc" (UID: "5317c62d-38f6-46b0-b670-2c3dd8be6dff") : configmap "kube-rbac-proxy" not found Jun 11 21:23:28.882032 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.882011 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdvn4\" (UniqueName: \"kubernetes.io/projected/9bf53f5b-8c86-4066-91b8-624f45ef93ea-kube-api-access-fdvn4\") pod \"service-ca-7b994bc59-fbn85\" (UID: \"9bf53f5b-8c86-4066-91b8-624f45ef93ea\") " pod="openshift-service-ca/service-ca-7b994bc59-fbn85" Jun 11 21:23:28.882137 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.882044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9bf53f5b-8c86-4066-91b8-624f45ef93ea-signing-key\") pod \"service-ca-7b994bc59-fbn85\" (UID: \"9bf53f5b-8c86-4066-91b8-624f45ef93ea\") " pod="openshift-service-ca/service-ca-7b994bc59-fbn85" Jun 11 21:23:28.882137 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.882086 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9bf53f5b-8c86-4066-91b8-624f45ef93ea-signing-cabundle\") pod \"service-ca-7b994bc59-fbn85\" (UID: \"9bf53f5b-8c86-4066-91b8-624f45ef93ea\") " pod="openshift-service-ca/service-ca-7b994bc59-fbn85" Jun 11 21:23:28.982624 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.982588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdvn4\" (UniqueName: \"kubernetes.io/projected/9bf53f5b-8c86-4066-91b8-624f45ef93ea-kube-api-access-fdvn4\") pod \"service-ca-7b994bc59-fbn85\" (UID: \"9bf53f5b-8c86-4066-91b8-624f45ef93ea\") " pod="openshift-service-ca/service-ca-7b994bc59-fbn85" Jun 11 21:23:28.982956 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.982633 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9bf53f5b-8c86-4066-91b8-624f45ef93ea-signing-key\") pod \"service-ca-7b994bc59-fbn85\" (UID: \"9bf53f5b-8c86-4066-91b8-624f45ef93ea\") " pod="openshift-service-ca/service-ca-7b994bc59-fbn85" Jun 11 21:23:28.982956 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.982673 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9bf53f5b-8c86-4066-91b8-624f45ef93ea-signing-cabundle\") pod \"service-ca-7b994bc59-fbn85\" (UID: \"9bf53f5b-8c86-4066-91b8-624f45ef93ea\") " pod="openshift-service-ca/service-ca-7b994bc59-fbn85" Jun 11 21:23:28.983355 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.983337 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9bf53f5b-8c86-4066-91b8-624f45ef93ea-signing-cabundle\") pod \"service-ca-7b994bc59-fbn85\" (UID: \"9bf53f5b-8c86-4066-91b8-624f45ef93ea\") " pod="openshift-service-ca/service-ca-7b994bc59-fbn85" Jun 11 21:23:28.984947 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.984931 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9bf53f5b-8c86-4066-91b8-624f45ef93ea-signing-key\") pod \"service-ca-7b994bc59-fbn85\" (UID: \"9bf53f5b-8c86-4066-91b8-624f45ef93ea\") " pod="openshift-service-ca/service-ca-7b994bc59-fbn85" Jun 11 21:23:28.990757 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:28.990735 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdvn4\" (UniqueName: \"kubernetes.io/projected/9bf53f5b-8c86-4066-91b8-624f45ef93ea-kube-api-access-fdvn4\") pod \"service-ca-7b994bc59-fbn85\" (UID: \"9bf53f5b-8c86-4066-91b8-624f45ef93ea\") " pod="openshift-service-ca/service-ca-7b994bc59-fbn85" Jun 11 21:23:29.029116 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:29.029095 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-fbn85" Jun 11 21:23:29.146545 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:29.146481 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-fbn85"] Jun 11 21:23:29.149416 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:23:29.149375 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf53f5b_8c86_4066_91b8_624f45ef93ea.slice/crio-1cc11459ce694b89fd66b167cd1c0fe45dc4758d8c08b77e5ba44ca3c9178e1f WatchSource:0}: Error finding container 1cc11459ce694b89fd66b167cd1c0fe45dc4758d8c08b77e5ba44ca3c9178e1f: Status 404 returned error can't find the container with id 1cc11459ce694b89fd66b167cd1c0fe45dc4758d8c08b77e5ba44ca3c9178e1f Jun 11 21:23:29.236343 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:29.236317 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-fbn85" event={"ID":"9bf53f5b-8c86-4066-91b8-624f45ef93ea","Type":"ContainerStarted","Data":"1cc11459ce694b89fd66b167cd1c0fe45dc4758d8c08b77e5ba44ca3c9178e1f"} Jun 11 21:23:29.285597 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:29.285571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-f8d4h\" (UID: \"2a596ed4-5b47-4e8a-820d-d712ee82797f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" Jun 11 21:23:29.285688 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:29.285613 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8jrp2\" (UID: \"98aa7006-7fc7-4375-8d9f-51a8f9e0171a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" Jun 11 21:23:29.285728 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:29.285705 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:23:29.285761 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:29.285728 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 21:23:29.285797 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:29.285760 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls podName:2a596ed4-5b47-4e8a-820d-d712ee82797f nodeName:}" failed. No retries permitted until 2026-06-11 21:23:37.285745718 +0000 UTC m=+189.059685652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls") pod "cluster-samples-operator-9547488fd-f8d4h" (UID: "2a596ed4-5b47-4e8a-820d-d712ee82797f") : secret "samples-operator-tls" not found Jun 11 21:23:29.285797 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:29.285775 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert podName:98aa7006-7fc7-4375-8d9f-51a8f9e0171a nodeName:}" failed. No retries permitted until 2026-06-11 21:23:37.285768217 +0000 UTC m=+189.059708151 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-8jrp2" (UID: "98aa7006-7fc7-4375-8d9f-51a8f9e0171a") : secret "networking-console-plugin-cert" not found Jun 11 21:23:29.386394 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:29.386358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:29.386394 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:29.386415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:29.386586 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:29.386495 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:23:29.386586 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:29.386551 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs podName:197e0956-cb50-413d-8ace-dac9967f2a80 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:37.386535845 +0000 UTC m=+189.160475778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs") pod "router-default-595dc98f7b-hphqq" (UID: "197e0956-cb50-413d-8ace-dac9967f2a80") : secret "router-metrics-certs-default" not found Jun 11 21:23:29.386586 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:29.386576 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle podName:197e0956-cb50-413d-8ace-dac9967f2a80 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:37.386563708 +0000 UTC m=+189.160503642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle") pod "router-default-595dc98f7b-hphqq" (UID: "197e0956-cb50-413d-8ace-dac9967f2a80") : configmap references non-existent config key: service-ca.crt Jun 11 21:23:31.243465 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:31.243372 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-fbn85" event={"ID":"9bf53f5b-8c86-4066-91b8-624f45ef93ea","Type":"ContainerStarted","Data":"daccb0a12568dbb2918f3906b5338acf490359325a6b7a80cdc9007b65d3fe46"} Jun 11 21:23:31.262087 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:31.262048 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-fbn85" podStartSLOduration=1.496916084 podStartE2EDuration="3.262035268s" totalImagesPullingTime="1.765119184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:31.260946547 +0000 UTC m=+183.034886502" watchObservedRunningTime="2026-06-11 21:23:31.262035268 +0000 UTC m=+183.035975224" Jun 11 21:23:32.812615 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:32.812580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:32.813113 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:32.812654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:32.813113 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:32.812758 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:23:32.813113 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:32.812789 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:23:32.813113 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:32.812833 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls podName:5317c62d-38f6-46b0-b670-2c3dd8be6dff nodeName:}" failed. No retries permitted until 2026-06-11 21:23:40.812814072 +0000 UTC m=+192.586754017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qnszc" (UID: "5317c62d-38f6-46b0-b670-2c3dd8be6dff") : secret "insights-runtime-extractor-tls" not found Jun 11 21:23:32.813113 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:32.812851 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm podName:5317c62d-38f6-46b0-b670-2c3dd8be6dff nodeName:}" failed. No retries permitted until 2026-06-11 21:23:40.812842565 +0000 UTC m=+192.586782511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qnszc" (UID: "5317c62d-38f6-46b0-b670-2c3dd8be6dff") : configmap "kube-rbac-proxy" not found Jun 11 21:23:37.351752 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:37.351710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-f8d4h\" (UID: \"2a596ed4-5b47-4e8a-820d-d712ee82797f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" Jun 11 21:23:37.351752 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:37.351768 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8jrp2\" (UID: \"98aa7006-7fc7-4375-8d9f-51a8f9e0171a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" Jun 11 21:23:37.352184 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:37.351864 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 21:23:37.352184 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:37.351920 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert podName:98aa7006-7fc7-4375-8d9f-51a8f9e0171a nodeName:}" failed. No retries permitted until 2026-06-11 21:23:53.351903354 +0000 UTC m=+205.125843302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-8jrp2" (UID: "98aa7006-7fc7-4375-8d9f-51a8f9e0171a") : secret "networking-console-plugin-cert" not found Jun 11 21:23:37.354052 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:37.354029 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a596ed4-5b47-4e8a-820d-d712ee82797f-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-f8d4h\" (UID: \"2a596ed4-5b47-4e8a-820d-d712ee82797f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" Jun 11 21:23:37.368079 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:37.368059 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nxp7b\"" Jun 11 21:23:37.376044 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:37.376024 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" Jun 11 21:23:37.453109 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:37.453075 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:37.453232 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:37.453126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:37.453302 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:37.453290 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle podName:197e0956-cb50-413d-8ace-dac9967f2a80 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:53.453273713 +0000 UTC m=+205.227213647 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle") pod "router-default-595dc98f7b-hphqq" (UID: "197e0956-cb50-413d-8ace-dac9967f2a80") : configmap references non-existent config key: service-ca.crt Jun 11 21:23:37.455356 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:37.455335 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/197e0956-cb50-413d-8ace-dac9967f2a80-metrics-certs\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:37.493646 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:37.493613 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h"] Jun 11 21:23:38.263723 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:38.263688 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" event={"ID":"2a596ed4-5b47-4e8a-820d-d712ee82797f","Type":"ContainerStarted","Data":"e7ec419dafc25416f9fa5697730c98207254ff17ceacc5f6e6785ca5e223110b"} Jun 11 21:23:40.271154 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:40.271123 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" event={"ID":"2a596ed4-5b47-4e8a-820d-d712ee82797f","Type":"ContainerStarted","Data":"1ea0566aa1ff46d2cfd5325eea4f1101e6d4f3d5c2c5e8dfc4d618da1361fcfe"} Jun 11 21:23:40.271555 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:40.271170 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" event={"ID":"2a596ed4-5b47-4e8a-820d-d712ee82797f","Type":"ContainerStarted","Data":"8de463ba628afdea893dad1741638bc559b5998de8797aa87aefb928cdf4cf08"} Jun 11 21:23:40.287617 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:40.287564 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-f8d4h" podStartSLOduration=17.536919546 podStartE2EDuration="19.287544447s" totalImagesPullingTime="1.750624901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:40.285731934 +0000 UTC m=+192.059671908" watchObservedRunningTime="2026-06-11 21:23:40.287544447 +0000 UTC m=+192.061484405" Jun 11 21:23:40.879309 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:40.879276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:40.879508 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:40.879424 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:23:40.879508 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:40.879431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:40.879508 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:23:40.879488 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls podName:5317c62d-38f6-46b0-b670-2c3dd8be6dff nodeName:}" failed. No retries permitted until 2026-06-11 21:23:56.879474504 +0000 UTC m=+208.653414442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qnszc" (UID: "5317c62d-38f6-46b0-b670-2c3dd8be6dff") : secret "insights-runtime-extractor-tls" not found Jun 11 21:23:40.880037 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:40.880017 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5317c62d-38f6-46b0-b670-2c3dd8be6dff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:53.381720 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:53.381676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8jrp2\" (UID: \"98aa7006-7fc7-4375-8d9f-51a8f9e0171a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" Jun 11 21:23:53.383974 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:53.383945 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98aa7006-7fc7-4375-8d9f-51a8f9e0171a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8jrp2\" (UID: \"98aa7006-7fc7-4375-8d9f-51a8f9e0171a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" Jun 11 21:23:53.482200 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:53.482166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:53.482802 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:53.482783 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/197e0956-cb50-413d-8ace-dac9967f2a80-service-ca-bundle\") pod \"router-default-595dc98f7b-hphqq\" (UID: \"197e0956-cb50-413d-8ace-dac9967f2a80\") " pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:53.654095 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:53.654017 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rk8p6\"" Jun 11 21:23:53.658716 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:53.658696 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j4rsd\"" Jun 11 21:23:53.662413 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:53.662388 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" Jun 11 21:23:53.667624 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:53.667610 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:53.830287 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:53.830256 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-8jrp2"] Jun 11 21:23:53.833139 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:23:53.833113 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98aa7006_7fc7_4375_8d9f_51a8f9e0171a.slice/crio-e6c5700380398958928d7730f72c70c8a0944cedb2aa7a0dd8355dc5881ce31e WatchSource:0}: Error finding container e6c5700380398958928d7730f72c70c8a0944cedb2aa7a0dd8355dc5881ce31e: Status 404 returned error can't find the container with id e6c5700380398958928d7730f72c70c8a0944cedb2aa7a0dd8355dc5881ce31e Jun 11 21:23:53.851431 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:53.851395 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-595dc98f7b-hphqq"] Jun 11 21:23:53.853166 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:23:53.853143 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod197e0956_cb50_413d_8ace_dac9967f2a80.slice/crio-9328be04785b62758b4c76bb0a129fbe52a9101a5655497dc93e6d9e5161e07d WatchSource:0}: Error finding container 9328be04785b62758b4c76bb0a129fbe52a9101a5655497dc93e6d9e5161e07d: Status 404 returned error can't find the container with id 9328be04785b62758b4c76bb0a129fbe52a9101a5655497dc93e6d9e5161e07d Jun 11 21:23:54.313705 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:54.313619 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" event={"ID":"98aa7006-7fc7-4375-8d9f-51a8f9e0171a","Type":"ContainerStarted","Data":"e6c5700380398958928d7730f72c70c8a0944cedb2aa7a0dd8355dc5881ce31e"} Jun 11 21:23:54.314963 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:54.314937 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-595dc98f7b-hphqq" event={"ID":"197e0956-cb50-413d-8ace-dac9967f2a80","Type":"ContainerStarted","Data":"a171795b33a889e714afc0445040ca3d0248be9f989c5286646d1ea76058d33e"} Jun 11 21:23:54.315063 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:54.314981 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-595dc98f7b-hphqq" event={"ID":"197e0956-cb50-413d-8ace-dac9967f2a80","Type":"ContainerStarted","Data":"9328be04785b62758b4c76bb0a129fbe52a9101a5655497dc93e6d9e5161e07d"} Jun 11 21:23:54.668664 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:54.668625 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:54.671530 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:54.671504 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:54.688839 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:54.688792 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-595dc98f7b-hphqq" podStartSLOduration=33.688778511 podStartE2EDuration="33.688778511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:54.333010854 +0000 UTC m=+206.106950823" watchObservedRunningTime="2026-06-11 21:23:54.688778511 +0000 UTC m=+206.462718479" Jun 11 21:23:55.319302 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:55.319257 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" event={"ID":"98aa7006-7fc7-4375-8d9f-51a8f9e0171a","Type":"ContainerStarted","Data":"829b376170ed17e96feba16fc9fdb5ba1e0c7cd6dc9c3582f419ba481314f0c4"} Jun 11 21:23:55.319550 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:55.319529 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:55.320645 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:55.320628 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-595dc98f7b-hphqq" Jun 11 21:23:55.334604 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:55.334556 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-8jrp2" podStartSLOduration=33.0717112 podStartE2EDuration="34.334539355s" totalImagesPullingTime="1.262828155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:55.333690789 +0000 UTC m=+207.107630748" watchObservedRunningTime="2026-06-11 21:23:55.334539355 +0000 UTC m=+207.108479313" Jun 11 21:23:56.300629 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.300599 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zhfcj"] Jun 11 21:23:56.302694 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.302677 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zhfcj" Jun 11 21:23:56.304969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.304943 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 21:23:56.305082 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.304991 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pxn5q\"" Jun 11 21:23:56.314099 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.314075 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zhfcj"] Jun 11 21:23:56.406775 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.406739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/092b43c6-0f72-43f9-a7e3-372a64128f1f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-zhfcj\" (UID: \"092b43c6-0f72-43f9-a7e3-372a64128f1f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zhfcj" Jun 11 21:23:56.508018 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.507988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/092b43c6-0f72-43f9-a7e3-372a64128f1f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-zhfcj\" (UID: \"092b43c6-0f72-43f9-a7e3-372a64128f1f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zhfcj" Jun 11 21:23:56.510285 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.510256 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/092b43c6-0f72-43f9-a7e3-372a64128f1f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-zhfcj\" (UID: \"092b43c6-0f72-43f9-a7e3-372a64128f1f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zhfcj" Jun 11 21:23:56.611763 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.611668 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zhfcj" Jun 11 21:23:56.678483 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.678455 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69ff85444d-hcbjq"] Jun 11 21:23:56.680525 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.680506 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.682781 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.682762 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6bhfm\"" Jun 11 21:23:56.683749 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.683726 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 21:23:56.683867 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.683733 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 21:23:56.683867 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.683768 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 21:23:56.683970 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.683884 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 21:23:56.683970 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.683884 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 21:23:56.684073 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.683968 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 21:23:56.684073 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.684008 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 21:23:56.691816 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.691796 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69ff85444d-hcbjq"] Jun 11 21:23:56.752899 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.752869 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zhfcj"] Jun 11 21:23:56.755478 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:23:56.755450 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092b43c6_0f72_43f9_a7e3_372a64128f1f.slice/crio-93d3e4ef8989e39d1102baf28cbbcc73002b7479a06a8b5adc003f11338be81a WatchSource:0}: Error finding container 93d3e4ef8989e39d1102baf28cbbcc73002b7479a06a8b5adc003f11338be81a: Status 404 returned error can't find the container with id 93d3e4ef8989e39d1102baf28cbbcc73002b7479a06a8b5adc003f11338be81a Jun 11 21:23:56.810120 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.810098 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-config\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.810230 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.810126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-oauth-config\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.810230 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.810149 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whn7k\" (UniqueName: \"kubernetes.io/projected/40cc6b3a-53cc-45d4-894e-53eb723f0352-kube-api-access-whn7k\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.810230 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.810202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-service-ca\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.810347 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.810275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-oauth-serving-cert\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.810347 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.810292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-serving-cert\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.911566 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.911529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-config\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.911742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.911590 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-oauth-config\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.911742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.911612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whn7k\" (UniqueName: \"kubernetes.io/projected/40cc6b3a-53cc-45d4-894e-53eb723f0352-kube-api-access-whn7k\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.911742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.911640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-service-ca\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.911742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.911697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-oauth-serving-cert\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.911742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.911723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-serving-cert\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.911979 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.911784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:56.912314 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.912281 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-config\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.912462 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.912292 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-service-ca\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.912462 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.912436 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-oauth-serving-cert\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.914016 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.913990 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5317c62d-38f6-46b0-b670-2c3dd8be6dff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnszc\" (UID: \"5317c62d-38f6-46b0-b670-2c3dd8be6dff\") " pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:56.914102 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.914021 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-oauth-config\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.914228 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.914208 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-serving-cert\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.920117 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.920094 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whn7k\" (UniqueName: \"kubernetes.io/projected/40cc6b3a-53cc-45d4-894e-53eb723f0352-kube-api-access-whn7k\") pod \"console-69ff85444d-hcbjq\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:56.990222 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:56.990199 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:23:57.103049 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:57.103018 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tnblg\"" Jun 11 21:23:57.110601 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:57.110577 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69ff85444d-hcbjq"] Jun 11 21:23:57.112041 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:57.112024 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qnszc" Jun 11 21:23:57.114157 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:23:57.114134 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40cc6b3a_53cc_45d4_894e_53eb723f0352.slice/crio-65e995872265e274a9c4e2294d552dec3af793cc3b9c0c555f89ca65b195ba38 WatchSource:0}: Error finding container 65e995872265e274a9c4e2294d552dec3af793cc3b9c0c555f89ca65b195ba38: Status 404 returned error can't find the container with id 65e995872265e274a9c4e2294d552dec3af793cc3b9c0c555f89ca65b195ba38 Jun 11 21:23:57.231261 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:57.231229 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qnszc"] Jun 11 21:23:57.234039 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:23:57.234014 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5317c62d_38f6_46b0_b670_2c3dd8be6dff.slice/crio-bddc5aaee50ab9cd8f694ab611328348ef60800ef5d024b599caa138dc059f33 WatchSource:0}: Error finding container bddc5aaee50ab9cd8f694ab611328348ef60800ef5d024b599caa138dc059f33: Status 404 returned error can't find the container with id bddc5aaee50ab9cd8f694ab611328348ef60800ef5d024b599caa138dc059f33 Jun 11 21:23:57.328145 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:57.328107 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69ff85444d-hcbjq" event={"ID":"40cc6b3a-53cc-45d4-894e-53eb723f0352","Type":"ContainerStarted","Data":"65e995872265e274a9c4e2294d552dec3af793cc3b9c0c555f89ca65b195ba38"} Jun 11 21:23:57.329174 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:57.329150 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zhfcj" event={"ID":"092b43c6-0f72-43f9-a7e3-372a64128f1f","Type":"ContainerStarted","Data":"93d3e4ef8989e39d1102baf28cbbcc73002b7479a06a8b5adc003f11338be81a"} Jun 11 21:23:57.330117 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:57.330094 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qnszc" event={"ID":"5317c62d-38f6-46b0-b670-2c3dd8be6dff","Type":"ContainerStarted","Data":"bddc5aaee50ab9cd8f694ab611328348ef60800ef5d024b599caa138dc059f33"} Jun 11 21:23:58.335733 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.335687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zhfcj" event={"ID":"092b43c6-0f72-43f9-a7e3-372a64128f1f","Type":"ContainerStarted","Data":"2b01cc682fb002014563f6ac424affe4906cfab999c357f71ba76dbeefa039ff"} Jun 11 21:23:58.336182 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.336037 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zhfcj" Jun 11 21:23:58.342358 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.342332 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zhfcj" Jun 11 21:23:58.351201 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.351143 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zhfcj" podStartSLOduration=0.94876322 podStartE2EDuration="2.351120428s" totalImagesPullingTime="1.402357208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:58.349433442 +0000 UTC m=+210.123373400" watchObservedRunningTime="2026-06-11 21:23:58.351120428 +0000 UTC m=+210.125060368" Jun 11 21:23:58.469705 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.469623 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85df8c59bc-9nm6s"] Jun 11 21:23:58.471985 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.471961 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.478997 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.478972 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 21:23:58.483995 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.483935 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85df8c59bc-9nm6s"] Jun 11 21:23:58.628453 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.628118 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-trusted-ca-bundle\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.628453 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.628217 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-oauth-serving-cert\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.628453 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.628240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-config\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.628453 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.628279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-oauth-config\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.628453 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.628330 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-serving-cert\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.628453 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.628353 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-service-ca\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.628453 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.628383 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8rbn\" (UniqueName: \"kubernetes.io/projected/0791ce49-0899-451c-9b84-d6bb36c1edfb-kube-api-access-g8rbn\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.729344 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.728743 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-serving-cert\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.729344 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.728786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-service-ca\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.729344 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.728814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8rbn\" (UniqueName: \"kubernetes.io/projected/0791ce49-0899-451c-9b84-d6bb36c1edfb-kube-api-access-g8rbn\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.729344 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.728844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-trusted-ca-bundle\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.729344 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.728910 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-oauth-serving-cert\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.729344 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.728936 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-config\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.729344 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.728983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-oauth-config\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.730631 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.729890 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-oauth-serving-cert\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.730631 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.730093 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-trusted-ca-bundle\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.730631 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.730495 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-config\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.731194 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.731165 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-service-ca\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.732690 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.732647 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-serving-cert\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.732864 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.732847 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-oauth-config\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.737669 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.737637 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8rbn\" (UniqueName: \"kubernetes.io/projected/0791ce49-0899-451c-9b84-d6bb36c1edfb-kube-api-access-g8rbn\") pod \"console-85df8c59bc-9nm6s\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.783660 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.783546 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:23:58.940186 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:23:58.940150 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85df8c59bc-9nm6s"] Jun 11 21:24:00.196796 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:24:00.196760 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0791ce49_0899_451c_9b84_d6bb36c1edfb.slice/crio-4c89158ea63560193a192708d508e0ee7fccc215443a4cc239b1faf492c0defb WatchSource:0}: Error finding container 4c89158ea63560193a192708d508e0ee7fccc215443a4cc239b1faf492c0defb: Status 404 returned error can't find the container with id 4c89158ea63560193a192708d508e0ee7fccc215443a4cc239b1faf492c0defb Jun 11 21:24:00.343951 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:00.343903 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85df8c59bc-9nm6s" event={"ID":"0791ce49-0899-451c-9b84-d6bb36c1edfb","Type":"ContainerStarted","Data":"4c89158ea63560193a192708d508e0ee7fccc215443a4cc239b1faf492c0defb"} Jun 11 21:24:02.352096 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:02.352010 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69ff85444d-hcbjq" event={"ID":"40cc6b3a-53cc-45d4-894e-53eb723f0352","Type":"ContainerStarted","Data":"f1632c8fbe310c66244644e1c467b363ce7e80bb2ca9bc80a0886142a51f1e78"} Jun 11 21:24:02.353556 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:02.353535 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85df8c59bc-9nm6s" event={"ID":"0791ce49-0899-451c-9b84-d6bb36c1edfb","Type":"ContainerStarted","Data":"65627b4202530bb0835837da34b3da144a7dd31a47b3d1e2afd5496d1182daa2"} Jun 11 21:24:02.354951 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:02.354925 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qnszc" event={"ID":"5317c62d-38f6-46b0-b670-2c3dd8be6dff","Type":"ContainerStarted","Data":"3cb151b37e7a0cae9be9a489a68077b42d82d2f94124892c9e92dcc249bf6981"} Jun 11 21:24:02.369182 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:02.369136 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69ff85444d-hcbjq" podStartSLOduration=1.578177273 podStartE2EDuration="6.36912089s" totalImagesPullingTime="4.790943617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:02.367333169 +0000 UTC m=+214.141273138" watchObservedRunningTime="2026-06-11 21:24:02.36912089 +0000 UTC m=+214.143060845" Jun 11 21:24:02.382439 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:02.382380 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85df8c59bc-9nm6s" podStartSLOduration=2.6207672410000002 podStartE2EDuration="4.382367279s" totalImagesPullingTime="1.761600038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:02.381592614 +0000 UTC m=+214.155532570" watchObservedRunningTime="2026-06-11 21:24:02.382367279 +0000 UTC m=+214.156307234" Jun 11 21:24:03.361648 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:03.361612 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qnszc" event={"ID":"5317c62d-38f6-46b0-b670-2c3dd8be6dff","Type":"ContainerStarted","Data":"80f2671d266e37a2d06cff65010c84df4c805aa2bc146a296a5cce5da009cdfd"} Jun 11 21:24:04.367045 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:04.366955 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qnszc" event={"ID":"5317c62d-38f6-46b0-b670-2c3dd8be6dff","Type":"ContainerStarted","Data":"45c11a21c80b3002e9aadf5ba9147eb13b480cb6f86b84f5e1a54e9e902d7a45"} Jun 11 21:24:04.383755 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:04.383708 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qnszc" podStartSLOduration=33.637159901 podStartE2EDuration="40.383691664s" totalImagesPullingTime="6.746531763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:23:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:04.382678483 +0000 UTC m=+216.156618431" watchObservedRunningTime="2026-06-11 21:24:04.383691664 +0000 UTC m=+216.157631619" Jun 11 21:24:06.991062 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:06.991021 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:24:06.991468 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:06.991096 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:24:06.992372 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:06.992346 2581 patch_prober.go:28] interesting pod/console-69ff85444d-hcbjq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 11 21:24:06.992480 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:06.992395 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-69ff85444d-hcbjq" podUID="40cc6b3a-53cc-45d4-894e-53eb723f0352" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 11 21:24:08.783953 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:08.783912 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:24:08.784344 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:08.783989 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:24:08.785352 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:08.785327 2581 patch_prober.go:28] interesting pod/console-85df8c59bc-9nm6s container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 11 21:24:08.785469 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:08.785382 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85df8c59bc-9nm6s" podUID="0791ce49-0899-451c-9b84-d6bb36c1edfb" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 11 21:24:12.709011 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.708976 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck"] Jun 11 21:24:12.712748 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.712729 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" Jun 11 21:24:12.715106 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.715079 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 21:24:12.715471 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.715451 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 21:24:12.716138 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.716004 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 21:24:12.716138 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.716017 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 21:24:12.716138 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.716028 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8hlvx\"" Jun 11 21:24:12.716336 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.716253 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 21:24:12.723164 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.723143 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck"] Jun 11 21:24:12.729533 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.729511 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-c7f42"] Jun 11 21:24:12.732991 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.732974 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.736306 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.736281 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 21:24:12.736516 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.736500 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 21:24:12.736719 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.736702 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-j56lq\"" Jun 11 21:24:12.736905 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.736889 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 21:24:12.753582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.753555 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-c7f42"] Jun 11 21:24:12.756458 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.756435 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4th7l"] Jun 11 21:24:12.763348 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.763328 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.765663 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.765618 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 21:24:12.765874 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.765859 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 21:24:12.766154 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.766138 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xfs52\"" Jun 11 21:24:12.766229 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.766197 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 21:24:12.840814 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.840791 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-sys\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.840951 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.840821 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-textfile\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.840951 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.840840 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a4d587f-1f04-4ca5-b62d-3389bf663668-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-pk2ck\" (UID: \"2a4d587f-1f04-4ca5-b62d-3389bf663668\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" Jun 11 21:24:12.840951 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.840861 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.840951 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.840882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.841092 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.841001 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.841092 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.841034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.841092 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.841060 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25xgk\" (UniqueName: \"kubernetes.io/projected/2a4d587f-1f04-4ca5-b62d-3389bf663668-kube-api-access-25xgk\") pod \"openshift-state-metrics-6b8d965dd5-pk2ck\" (UID: \"2a4d587f-1f04-4ca5-b62d-3389bf663668\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" Jun 11 21:24:12.841194 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.841092 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-metrics-client-ca\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.841194 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.841127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.841194 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.841173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.841300 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.841198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65rjc\" (UniqueName: \"kubernetes.io/projected/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-kube-api-access-65rjc\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.841300 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.841224 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a4d587f-1f04-4ca5-b62d-3389bf663668-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-pk2ck\" (UID: \"2a4d587f-1f04-4ca5-b62d-3389bf663668\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" Jun 11 21:24:12.841300 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.841261 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlk9k\" (UniqueName: \"kubernetes.io/projected/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-kube-api-access-xlk9k\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.841300 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.841285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.841431 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.841319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-tls\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.841431 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.841354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a4d587f-1f04-4ca5-b62d-3389bf663668-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-pk2ck\" (UID: \"2a4d587f-1f04-4ca5-b62d-3389bf663668\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" Jun 11 21:24:12.841431 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.841378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-root\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.841524 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.841439 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-wtmp\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.942014 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.941976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65rjc\" (UniqueName: \"kubernetes.io/projected/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-kube-api-access-65rjc\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.942014 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a4d587f-1f04-4ca5-b62d-3389bf663668-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-pk2ck\" (UID: \"2a4d587f-1f04-4ca5-b62d-3389bf663668\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" Jun 11 21:24:12.942237 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlk9k\" (UniqueName: \"kubernetes.io/projected/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-kube-api-access-xlk9k\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.942237 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.942237 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-tls\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.942237 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942135 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a4d587f-1f04-4ca5-b62d-3389bf663668-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-pk2ck\" (UID: \"2a4d587f-1f04-4ca5-b62d-3389bf663668\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" Jun 11 21:24:12.942237 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942177 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-root\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.942237 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942226 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-wtmp\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.942611 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942282 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-root\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.942611 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942290 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-sys\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.942611 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-textfile\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.942611 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a4d587f-1f04-4ca5-b62d-3389bf663668-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-pk2ck\" (UID: \"2a4d587f-1f04-4ca5-b62d-3389bf663668\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" Jun 11 21:24:12.942611 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.942611 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.942611 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942506 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-wtmp\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.942611 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.942611 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.942611 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25xgk\" (UniqueName: \"kubernetes.io/projected/2a4d587f-1f04-4ca5-b62d-3389bf663668-kube-api-access-25xgk\") pod \"openshift-state-metrics-6b8d965dd5-pk2ck\" (UID: \"2a4d587f-1f04-4ca5-b62d-3389bf663668\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" Jun 11 21:24:12.943091 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-metrics-client-ca\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.943091 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.943091 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942754 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.943256 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.943091 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a4d587f-1f04-4ca5-b62d-3389bf663668-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-pk2ck\" (UID: \"2a4d587f-1f04-4ca5-b62d-3389bf663668\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" Jun 11 21:24:12.943256 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.943130 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-textfile\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.943256 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.942473 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-sys\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.943429 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.943297 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.943492 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.943445 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.943959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.943931 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-metrics-client-ca\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.944126 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.944102 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.944419 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.944382 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.945137 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.945112 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.945612 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.945592 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a4d587f-1f04-4ca5-b62d-3389bf663668-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-pk2ck\" (UID: \"2a4d587f-1f04-4ca5-b62d-3389bf663668\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" Jun 11 21:24:12.945851 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.945831 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.945968 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.945947 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-node-exporter-tls\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.946038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.946023 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a4d587f-1f04-4ca5-b62d-3389bf663668-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-pk2ck\" (UID: \"2a4d587f-1f04-4ca5-b62d-3389bf663668\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" Jun 11 21:24:12.946438 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.946397 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.949303 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.949278 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlk9k\" (UniqueName: \"kubernetes.io/projected/a8bb4f4b-ed55-45c3-b976-d9a19dec98ce-kube-api-access-xlk9k\") pod \"node-exporter-4th7l\" (UID: \"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce\") " pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:12.949908 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.949889 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65rjc\" (UniqueName: \"kubernetes.io/projected/f6386dd8-a909-4ecb-a26a-57b7e30d74f1-kube-api-access-65rjc\") pod \"kube-state-metrics-678bc549d7-c7f42\" (UID: \"f6386dd8-a909-4ecb-a26a-57b7e30d74f1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:12.950902 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:12.950883 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25xgk\" (UniqueName: \"kubernetes.io/projected/2a4d587f-1f04-4ca5-b62d-3389bf663668-kube-api-access-25xgk\") pod \"openshift-state-metrics-6b8d965dd5-pk2ck\" (UID: \"2a4d587f-1f04-4ca5-b62d-3389bf663668\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" Jun 11 21:24:13.026932 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:13.026828 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" Jun 11 21:24:13.057087 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:13.057057 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" Jun 11 21:24:13.072698 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:13.072674 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4th7l" Jun 11 21:24:13.084636 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:24:13.084607 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8bb4f4b_ed55_45c3_b976_d9a19dec98ce.slice/crio-6de67a9ad5b3c857bbd2f7f197a2d3b519d8b9f91b53045849e5b293e99afb83 WatchSource:0}: Error finding container 6de67a9ad5b3c857bbd2f7f197a2d3b519d8b9f91b53045849e5b293e99afb83: Status 404 returned error can't find the container with id 6de67a9ad5b3c857bbd2f7f197a2d3b519d8b9f91b53045849e5b293e99afb83 Jun 11 21:24:13.183045 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:13.183014 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck"] Jun 11 21:24:13.186113 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:24:13.186074 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a4d587f_1f04_4ca5_b62d_3389bf663668.slice/crio-a0ca53e4384e30db9d39d57d28ff58f77b57ce4df34ba8f9a03c8d0cd2dc6aa8 WatchSource:0}: Error finding container a0ca53e4384e30db9d39d57d28ff58f77b57ce4df34ba8f9a03c8d0cd2dc6aa8: Status 404 returned error can't find the container with id a0ca53e4384e30db9d39d57d28ff58f77b57ce4df34ba8f9a03c8d0cd2dc6aa8 Jun 11 21:24:13.205629 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:13.205573 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-c7f42"] Jun 11 21:24:13.219560 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:24:13.219519 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6386dd8_a909_4ecb_a26a_57b7e30d74f1.slice/crio-1bc97d8ed0ffeef9830fe7ddbd02acfb53257c81ee69685b83a55d14afdd5da0 WatchSource:0}: Error finding container 1bc97d8ed0ffeef9830fe7ddbd02acfb53257c81ee69685b83a55d14afdd5da0: Status 404 returned error can't find the container with id 1bc97d8ed0ffeef9830fe7ddbd02acfb53257c81ee69685b83a55d14afdd5da0 Jun 11 21:24:13.399468 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:13.399430 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4th7l" event={"ID":"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce","Type":"ContainerStarted","Data":"6de67a9ad5b3c857bbd2f7f197a2d3b519d8b9f91b53045849e5b293e99afb83"} Jun 11 21:24:13.400721 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:13.400695 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" event={"ID":"f6386dd8-a909-4ecb-a26a-57b7e30d74f1","Type":"ContainerStarted","Data":"1bc97d8ed0ffeef9830fe7ddbd02acfb53257c81ee69685b83a55d14afdd5da0"} Jun 11 21:24:13.402310 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:13.402290 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" event={"ID":"2a4d587f-1f04-4ca5-b62d-3389bf663668","Type":"ContainerStarted","Data":"e1d23ef8b295c4abc26249722088ed45063bba3b71f022a1cf2d634d5c34d212"} Jun 11 21:24:13.402387 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:13.402332 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" event={"ID":"2a4d587f-1f04-4ca5-b62d-3389bf663668","Type":"ContainerStarted","Data":"8f1b8c61bd579ae08ed63f474d262621a0d1b21fbb5741389fe6a958d01c2239"} Jun 11 21:24:13.402387 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:13.402351 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" event={"ID":"2a4d587f-1f04-4ca5-b62d-3389bf663668","Type":"ContainerStarted","Data":"a0ca53e4384e30db9d39d57d28ff58f77b57ce4df34ba8f9a03c8d0cd2dc6aa8"} Jun 11 21:24:14.408141 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:14.408108 2581 generic.go:356] "Generic (PLEG): container finished" podID="a8bb4f4b-ed55-45c3-b976-d9a19dec98ce" containerID="42454fdd0928fa4bc1ffe66e4a3b594b9d5b3d7006167f3bb6bd40ef868fb26d" exitCode=0 Jun 11 21:24:14.408569 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:14.408160 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4th7l" event={"ID":"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce","Type":"ContainerDied","Data":"42454fdd0928fa4bc1ffe66e4a3b594b9d5b3d7006167f3bb6bd40ef868fb26d"} Jun 11 21:24:15.414095 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.414060 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4th7l" event={"ID":"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce","Type":"ContainerStarted","Data":"b038a5b056fca7649262eb820f88efaf8e76166a44b03cae0a974769d4e80ce5"} Jun 11 21:24:15.414523 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.414123 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4th7l" event={"ID":"a8bb4f4b-ed55-45c3-b976-d9a19dec98ce","Type":"ContainerStarted","Data":"9724ce94b455ec654072ba097af31cba7328fc0f98a1cb66bb5550e148e36f9a"} Jun 11 21:24:15.416165 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.416139 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" event={"ID":"f6386dd8-a909-4ecb-a26a-57b7e30d74f1","Type":"ContainerStarted","Data":"bb0962012ca073f74cdc303cfc7a15cb67da71ac350c0f4c3ae2f3c6441191b2"} Jun 11 21:24:15.416310 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.416190 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" event={"ID":"f6386dd8-a909-4ecb-a26a-57b7e30d74f1","Type":"ContainerStarted","Data":"e34b41dd0c47a0f862f5483d2f709a1a469f485aaecef8e5badf6376a548ead5"} Jun 11 21:24:15.416310 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.416221 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" event={"ID":"f6386dd8-a909-4ecb-a26a-57b7e30d74f1","Type":"ContainerStarted","Data":"d92c848bcc87b5ac969e7199694ef7dd6346a015801d75374a6bf81b92e60c40"} Jun 11 21:24:15.422532 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.422506 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" event={"ID":"2a4d587f-1f04-4ca5-b62d-3389bf663668","Type":"ContainerStarted","Data":"4f51494a022a019bd01636323ef6b9b202760e91c1bb77faabdfeb6936c66581"} Jun 11 21:24:15.436721 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.436682 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4th7l" podStartSLOduration=2.5404296669999997 podStartE2EDuration="3.436669447s" totalImagesPullingTime="822.699347ms" totalInitContainerRuntime="73.540433ms" isStatefulPod=true podCreationTimestamp="2026-06-11 21:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:15.435264791 +0000 UTC m=+227.209204747" watchObservedRunningTime="2026-06-11 21:24:15.436669447 +0000 UTC m=+227.210609403" Jun 11 21:24:15.452336 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.452292 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-c7f42" podStartSLOduration=1.866466921 podStartE2EDuration="3.452277743s" totalImagesPullingTime="1.585810822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:15.450632557 +0000 UTC m=+227.224572514" watchObservedRunningTime="2026-06-11 21:24:15.452277743 +0000 UTC m=+227.226217689" Jun 11 21:24:15.466512 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.466469 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pk2ck" podStartSLOduration=1.9726444939999999 podStartE2EDuration="3.466456099s" totalImagesPullingTime="1.493811605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:15.465053481 +0000 UTC m=+227.238993448" watchObservedRunningTime="2026-06-11 21:24:15.466456099 +0000 UTC m=+227.240396059" Jun 11 21:24:15.807079 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.806990 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5498774f75-4qhxz"] Jun 11 21:24:15.810908 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.810885 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:15.816129 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.815927 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 21:24:15.816129 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.815949 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 21:24:15.816129 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.815962 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 21:24:15.816129 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.816002 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 21:24:15.816485 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.816465 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 21:24:15.816548 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.816469 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-69lhk\"" Jun 11 21:24:15.819290 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.819274 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9r6c5rb84va0d\"" Jun 11 21:24:15.840377 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.840344 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5498774f75-4qhxz"] Jun 11 21:24:15.970730 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.970696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-tls\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:15.970730 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.970733 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-metrics-client-ca\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:15.970922 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.970753 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-grpc-tls\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:15.970922 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.970872 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:15.970922 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.970894 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg5cv\" (UniqueName: \"kubernetes.io/projected/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-kube-api-access-zg5cv\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:15.970922 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.970912 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:15.971079 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.970929 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:15.971079 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:15.970954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.071953 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.071867 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.071953 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.071946 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-tls\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.072149 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.071966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-metrics-client-ca\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.072149 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.071984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-grpc-tls\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.072149 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.072060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.072149 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.072077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg5cv\" (UniqueName: \"kubernetes.io/projected/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-kube-api-access-zg5cv\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.072149 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.072098 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.072149 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.072125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.072899 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.072868 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-metrics-client-ca\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.074662 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.074632 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.074773 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.074675 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.075206 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.075181 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.075313 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.075212 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-tls\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.075313 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.075273 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.075433 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.075343 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-secret-grpc-tls\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.079921 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.079900 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg5cv\" (UniqueName: \"kubernetes.io/projected/6f6c8464-9329-4d8e-95f9-c53b24b2d9ae-kube-api-access-zg5cv\") pod \"thanos-querier-5498774f75-4qhxz\" (UID: \"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae\") " pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.121010 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.120985 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:16.253076 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.253052 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5498774f75-4qhxz"] Jun 11 21:24:16.255875 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:24:16.255852 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6c8464_9329_4d8e_95f9_c53b24b2d9ae.slice/crio-aa4212870453da96302ce0ab528fcd07495c6689ad0bbee8c87bc46da2ced799 WatchSource:0}: Error finding container aa4212870453da96302ce0ab528fcd07495c6689ad0bbee8c87bc46da2ced799: Status 404 returned error can't find the container with id aa4212870453da96302ce0ab528fcd07495c6689ad0bbee8c87bc46da2ced799 Jun 11 21:24:16.427817 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.427782 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" event={"ID":"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae","Type":"ContainerStarted","Data":"aa4212870453da96302ce0ab528fcd07495c6689ad0bbee8c87bc46da2ced799"} Jun 11 21:24:16.991449 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.991396 2581 patch_prober.go:28] interesting pod/console-69ff85444d-hcbjq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 11 21:24:16.991643 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:16.991479 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-69ff85444d-hcbjq" podUID="40cc6b3a-53cc-45d4-894e-53eb723f0352" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 11 21:24:17.507855 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.507819 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-tk28d"] Jun 11 21:24:17.511131 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.511110 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-tk28d" Jun 11 21:24:17.513681 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.513496 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 21:24:17.513681 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.513547 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69ff85444d-hcbjq"] Jun 11 21:24:17.513681 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.513499 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cmfpk\"" Jun 11 21:24:17.520221 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.520199 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-tk28d"] Jun 11 21:24:17.541432 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.541393 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-ff9854f4d-2scl5"] Jun 11 21:24:17.544801 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.544779 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.554244 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.554224 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ff9854f4d-2scl5"] Jun 11 21:24:17.687420 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.687374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-service-ca\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.687558 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.687444 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-console-config\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.687558 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.687474 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59b29085-145d-48c6-8e30-25d72df3ebf6-console-oauth-config\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.687558 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.687503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlp74\" (UniqueName: \"kubernetes.io/projected/59b29085-145d-48c6-8e30-25d72df3ebf6-kube-api-access-nlp74\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.687668 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.687601 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-trusted-ca-bundle\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.687668 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.687648 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-oauth-serving-cert\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.687740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.687724 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59b29085-145d-48c6-8e30-25d72df3ebf6-console-serving-cert\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.687852 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.687834 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzrr9\" (UniqueName: \"kubernetes.io/projected/e87dfe88-0c22-4d15-98fe-2c767529645b-kube-api-access-bzrr9\") pod \"monitoring-plugin-589576dfc7-tk28d\" (UID: \"e87dfe88-0c22-4d15-98fe-2c767529645b\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-tk28d" Jun 11 21:24:17.687885 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.687875 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e87dfe88-0c22-4d15-98fe-2c767529645b-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-tk28d\" (UID: \"e87dfe88-0c22-4d15-98fe-2c767529645b\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-tk28d" Jun 11 21:24:17.788793 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.788710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzrr9\" (UniqueName: \"kubernetes.io/projected/e87dfe88-0c22-4d15-98fe-2c767529645b-kube-api-access-bzrr9\") pod \"monitoring-plugin-589576dfc7-tk28d\" (UID: \"e87dfe88-0c22-4d15-98fe-2c767529645b\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-tk28d" Jun 11 21:24:17.788793 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.788755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e87dfe88-0c22-4d15-98fe-2c767529645b-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-tk28d\" (UID: \"e87dfe88-0c22-4d15-98fe-2c767529645b\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-tk28d" Jun 11 21:24:17.789010 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.788814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-service-ca\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.789010 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.788850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-console-config\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.789010 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.788873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59b29085-145d-48c6-8e30-25d72df3ebf6-console-oauth-config\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.789010 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.788892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlp74\" (UniqueName: \"kubernetes.io/projected/59b29085-145d-48c6-8e30-25d72df3ebf6-kube-api-access-nlp74\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.789010 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.788928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-trusted-ca-bundle\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.789010 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.788961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-oauth-serving-cert\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.789286 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.789018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59b29085-145d-48c6-8e30-25d72df3ebf6-console-serving-cert\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.789689 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.789663 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-console-config\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.789947 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.789926 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-service-ca\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.790537 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.790486 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-oauth-serving-cert\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.790637 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.790542 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-trusted-ca-bundle\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.791851 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.791825 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59b29085-145d-48c6-8e30-25d72df3ebf6-console-serving-cert\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.791951 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.791876 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e87dfe88-0c22-4d15-98fe-2c767529645b-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-tk28d\" (UID: \"e87dfe88-0c22-4d15-98fe-2c767529645b\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-tk28d" Jun 11 21:24:17.791951 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.791899 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59b29085-145d-48c6-8e30-25d72df3ebf6-console-oauth-config\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.798605 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.798587 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzrr9\" (UniqueName: \"kubernetes.io/projected/e87dfe88-0c22-4d15-98fe-2c767529645b-kube-api-access-bzrr9\") pod \"monitoring-plugin-589576dfc7-tk28d\" (UID: \"e87dfe88-0c22-4d15-98fe-2c767529645b\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-tk28d" Jun 11 21:24:17.798952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.798931 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlp74\" (UniqueName: \"kubernetes.io/projected/59b29085-145d-48c6-8e30-25d72df3ebf6-kube-api-access-nlp74\") pod \"console-ff9854f4d-2scl5\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:17.825478 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.825448 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-tk28d" Jun 11 21:24:17.855023 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:17.854998 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:18.349154 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:18.349123 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ff9854f4d-2scl5"] Jun 11 21:24:18.352710 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:24:18.352685 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b29085_145d_48c6_8e30_25d72df3ebf6.slice/crio-27fbab5b9a10f1f293ab44e92f8d3250c28a9b74ab8da270bb231ef27c4b2e6b WatchSource:0}: Error finding container 27fbab5b9a10f1f293ab44e92f8d3250c28a9b74ab8da270bb231ef27c4b2e6b: Status 404 returned error can't find the container with id 27fbab5b9a10f1f293ab44e92f8d3250c28a9b74ab8da270bb231ef27c4b2e6b Jun 11 21:24:18.369077 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:18.368877 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-tk28d"] Jun 11 21:24:18.373024 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:24:18.372997 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode87dfe88_0c22_4d15_98fe_2c767529645b.slice/crio-ecd2c062d0b0f551766ac58be088c6d1a9e0430a063bd06b57a55c8ea1f1ddf7 WatchSource:0}: Error finding container ecd2c062d0b0f551766ac58be088c6d1a9e0430a063bd06b57a55c8ea1f1ddf7: Status 404 returned error can't find the container with id ecd2c062d0b0f551766ac58be088c6d1a9e0430a063bd06b57a55c8ea1f1ddf7 Jun 11 21:24:18.439028 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:18.438996 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" event={"ID":"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae","Type":"ContainerStarted","Data":"697201152b6a4bff2e7aa007bcf3d5b0e20bb5407bda74fefd0c6f4f7cf57255"} Jun 11 21:24:18.439130 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:18.439084 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" event={"ID":"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae","Type":"ContainerStarted","Data":"f42236aa09e0bd0d9b89b5aaa120987aa731bbd4b0983b325f674503b36331d0"} Jun 11 21:24:18.440586 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:18.440561 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff9854f4d-2scl5" event={"ID":"59b29085-145d-48c6-8e30-25d72df3ebf6","Type":"ContainerStarted","Data":"24fd332a11e1fd7b5a66cb076792474057012a82f09a056b127845614d324420"} Jun 11 21:24:18.440676 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:18.440609 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff9854f4d-2scl5" event={"ID":"59b29085-145d-48c6-8e30-25d72df3ebf6","Type":"ContainerStarted","Data":"27fbab5b9a10f1f293ab44e92f8d3250c28a9b74ab8da270bb231ef27c4b2e6b"} Jun 11 21:24:18.441881 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:18.441858 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-tk28d" event={"ID":"e87dfe88-0c22-4d15-98fe-2c767529645b","Type":"ContainerStarted","Data":"ecd2c062d0b0f551766ac58be088c6d1a9e0430a063bd06b57a55c8ea1f1ddf7"} Jun 11 21:24:18.457508 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:18.457459 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-ff9854f4d-2scl5" podStartSLOduration=1.4574404570000001 podStartE2EDuration="1.457440457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:24:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:18.456239372 +0000 UTC m=+230.230179327" watchObservedRunningTime="2026-06-11 21:24:18.457440457 +0000 UTC m=+230.231380414" Jun 11 21:24:18.784905 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:18.784873 2581 patch_prober.go:28] interesting pod/console-85df8c59bc-9nm6s container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 11 21:24:18.785268 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:18.784928 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85df8c59bc-9nm6s" podUID="0791ce49-0899-451c-9b84-d6bb36c1edfb" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 11 21:24:19.448701 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:19.448662 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" event={"ID":"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae","Type":"ContainerStarted","Data":"7c61356ee47a05670f0e4b384c5f664f385573160d7202da1f1478fc220faf57"} Jun 11 21:24:20.453984 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:20.453942 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-tk28d" event={"ID":"e87dfe88-0c22-4d15-98fe-2c767529645b","Type":"ContainerStarted","Data":"681d01bdb334706f9bbb66bc885708328cff866f709a034636dbec67d6060260"} Jun 11 21:24:20.454447 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:20.454039 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-tk28d" Jun 11 21:24:20.457335 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:20.457308 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" event={"ID":"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae","Type":"ContainerStarted","Data":"c40b6bc85bf1a2deb6596d19e9cfcd9fc73b39e075ddef3db0de254c78ca922e"} Jun 11 21:24:20.457471 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:20.457369 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" event={"ID":"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae","Type":"ContainerStarted","Data":"984e97ede593e84281c44baeba216ff3c02cf5ba7536d2a3c67bd10f11b5e04c"} Jun 11 21:24:20.457471 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:20.457418 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" event={"ID":"6f6c8464-9329-4d8e-95f9-c53b24b2d9ae","Type":"ContainerStarted","Data":"e40e5a28e1c8900074669dbb2b4a1bd458b7e7ab121525020a124f175a834506"} Jun 11 21:24:20.457546 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:20.457531 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:20.459627 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:20.459609 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-tk28d" Jun 11 21:24:20.469020 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:20.468982 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-tk28d" podStartSLOduration=1.991981733 podStartE2EDuration="3.46896835s" totalImagesPullingTime="1.476986617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:20.467107472 +0000 UTC m=+232.241047428" watchObservedRunningTime="2026-06-11 21:24:20.46896835 +0000 UTC m=+232.242908305" Jun 11 21:24:20.499267 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:20.499208 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" podStartSLOduration=2.570537764 podStartE2EDuration="5.49918372s" totalImagesPullingTime="2.928645956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:24:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:20.498526649 +0000 UTC m=+232.272466630" watchObservedRunningTime="2026-06-11 21:24:20.49918372 +0000 UTC m=+232.273123669" Jun 11 21:24:26.467334 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:26.467304 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5498774f75-4qhxz" Jun 11 21:24:27.855354 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:27.855314 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:27.855879 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:27.855381 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:24:27.856666 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:27.856645 2581 patch_prober.go:28] interesting pod/console-ff9854f4d-2scl5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 11 21:24:27.856743 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:27.856687 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-ff9854f4d-2scl5" podUID="59b29085-145d-48c6-8e30-25d72df3ebf6" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 11 21:24:28.784189 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:28.784157 2581 patch_prober.go:28] interesting pod/console-85df8c59bc-9nm6s container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 11 21:24:28.784339 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:28.784204 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85df8c59bc-9nm6s" podUID="0791ce49-0899-451c-9b84-d6bb36c1edfb" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 11 21:24:29.492441 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:29.492387 2581 generic.go:356] "Generic (PLEG): container finished" podID="cbfce66f-8c70-4439-96bf-0fa73ae1a6af" containerID="5085d235f7ffa78e91269fba0afebf6d6d1047d977ad176c3f0424fe4371546f" exitCode=0 Jun 11 21:24:29.492812 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:29.492462 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" event={"ID":"cbfce66f-8c70-4439-96bf-0fa73ae1a6af","Type":"ContainerDied","Data":"5085d235f7ffa78e91269fba0afebf6d6d1047d977ad176c3f0424fe4371546f"} Jun 11 21:24:29.492857 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:29.492811 2581 scope.go:117] "RemoveContainer" containerID="5085d235f7ffa78e91269fba0afebf6d6d1047d977ad176c3f0424fe4371546f" Jun 11 21:24:30.497558 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:30.497524 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-zl8nl" event={"ID":"cbfce66f-8c70-4439-96bf-0fa73ae1a6af","Type":"ContainerStarted","Data":"be4e3c28a7059266552e6749871ac0c4db99f8f93bcc03c9b45cfa8388478dc0"} Jun 11 21:24:33.770630 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:33.770601 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-c7f42_f6386dd8-a909-4ecb-a26a-57b7e30d74f1/kube-state-metrics/0.log" Jun 11 21:24:33.969230 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:33.969204 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-c7f42_f6386dd8-a909-4ecb-a26a-57b7e30d74f1/kube-rbac-proxy-main/0.log" Jun 11 21:24:34.169647 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:34.169619 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-c7f42_f6386dd8-a909-4ecb-a26a-57b7e30d74f1/kube-rbac-proxy-self/0.log" Jun 11 21:24:34.570565 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:34.570491 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-tk28d_e87dfe88-0c22-4d15-98fe-2c767529645b/monitoring-plugin/0.log" Jun 11 21:24:34.770191 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:34.770169 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4th7l_a8bb4f4b-ed55-45c3-b976-d9a19dec98ce/init-textfile/0.log" Jun 11 21:24:34.971066 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:34.971042 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4th7l_a8bb4f4b-ed55-45c3-b976-d9a19dec98ce/node-exporter/0.log" Jun 11 21:24:35.170485 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:35.170463 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4th7l_a8bb4f4b-ed55-45c3-b976-d9a19dec98ce/kube-rbac-proxy/0.log" Jun 11 21:24:35.518446 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:35.518390 2581 generic.go:356] "Generic (PLEG): container finished" podID="29bb2707-c217-4af7-bed1-b2a0800942ec" containerID="b1241ac14a6390585110cef27ce3ad5c8bfdc2455bd0cbaa34b57abc1470b921" exitCode=0 Jun 11 21:24:35.518609 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:35.518463 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" event={"ID":"29bb2707-c217-4af7-bed1-b2a0800942ec","Type":"ContainerDied","Data":"b1241ac14a6390585110cef27ce3ad5c8bfdc2455bd0cbaa34b57abc1470b921"} Jun 11 21:24:35.518791 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:35.518777 2581 scope.go:117] "RemoveContainer" containerID="b1241ac14a6390585110cef27ce3ad5c8bfdc2455bd0cbaa34b57abc1470b921" Jun 11 21:24:36.524517 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:36.524474 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nhxxh" event={"ID":"29bb2707-c217-4af7-bed1-b2a0800942ec","Type":"ContainerStarted","Data":"e5fb2a30fa783e2b313293438098dce23a881791741ac2a5ea16d77cd3869b93"} Jun 11 21:24:36.569472 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:36.569451 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pk2ck_2a4d587f-1f04-4ca5-b62d-3389bf663668/kube-rbac-proxy-main/0.log" Jun 11 21:24:36.770015 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:36.769983 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pk2ck_2a4d587f-1f04-4ca5-b62d-3389bf663668/kube-rbac-proxy-self/0.log" Jun 11 21:24:36.969732 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:36.969709 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pk2ck_2a4d587f-1f04-4ca5-b62d-3389bf663668/openshift-state-metrics/0.log" Jun 11 21:24:37.856181 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:37.856148 2581 patch_prober.go:28] interesting pod/console-ff9854f4d-2scl5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 11 21:24:37.856596 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:37.856200 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-ff9854f4d-2scl5" podUID="59b29085-145d-48c6-8e30-25d72df3ebf6" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 11 21:24:38.784228 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:38.784194 2581 patch_prober.go:28] interesting pod/console-85df8c59bc-9nm6s container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 11 21:24:38.784372 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:38.784248 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85df8c59bc-9nm6s" podUID="0791ce49-0899-451c-9b84-d6bb36c1edfb" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 11 21:24:38.969448 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:38.969419 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-zhfcj_092b43c6-0f72-43f9-a7e3-372a64128f1f/prometheus-operator-admission-webhook/0.log" Jun 11 21:24:39.169795 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:39.169769 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5498774f75-4qhxz_6f6c8464-9329-4d8e-95f9-c53b24b2d9ae/thanos-query/0.log" Jun 11 21:24:39.370941 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:39.370914 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5498774f75-4qhxz_6f6c8464-9329-4d8e-95f9-c53b24b2d9ae/kube-rbac-proxy-web/0.log" Jun 11 21:24:39.569388 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:39.569299 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5498774f75-4qhxz_6f6c8464-9329-4d8e-95f9-c53b24b2d9ae/kube-rbac-proxy/0.log" Jun 11 21:24:39.770011 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:39.769984 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5498774f75-4qhxz_6f6c8464-9329-4d8e-95f9-c53b24b2d9ae/prom-label-proxy/0.log" Jun 11 21:24:39.969351 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:39.969328 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5498774f75-4qhxz_6f6c8464-9329-4d8e-95f9-c53b24b2d9ae/kube-rbac-proxy-rules/0.log" Jun 11 21:24:40.170088 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:40.170062 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5498774f75-4qhxz_6f6c8464-9329-4d8e-95f9-c53b24b2d9ae/kube-rbac-proxy-metrics/0.log" Jun 11 21:24:40.370824 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:40.370754 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-8jrp2_98aa7006-7fc7-4375-8d9f-51a8f9e0171a/networking-console-plugin/0.log" Jun 11 21:24:40.486950 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:40.486923 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:24:40.489469 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:40.489453 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e097be0-6ad1-4fea-9652-09fe7e0b89e1-metrics-certs\") pod \"network-metrics-daemon-k5xgg\" (UID: \"0e097be0-6ad1-4fea-9652-09fe7e0b89e1\") " pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:24:40.704696 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:40.704669 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l7p7b\"" Jun 11 21:24:40.712517 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:40.712494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5xgg" Jun 11 21:24:40.832640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:40.832601 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k5xgg"] Jun 11 21:24:40.834709 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:24:40.834685 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e097be0_6ad1_4fea_9652_09fe7e0b89e1.slice/crio-8697be534c4e4b949ca9c8089e62cf615b73b5236c84d8f1ece40e5e9b917996 WatchSource:0}: Error finding container 8697be534c4e4b949ca9c8089e62cf615b73b5236c84d8f1ece40e5e9b917996: Status 404 returned error can't find the container with id 8697be534c4e4b949ca9c8089e62cf615b73b5236c84d8f1ece40e5e9b917996 Jun 11 21:24:40.970027 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:40.969966 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69ff85444d-hcbjq_40cc6b3a-53cc-45d4-894e-53eb723f0352/console/0.log" Jun 11 21:24:41.170222 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:41.170201 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85df8c59bc-9nm6s_0791ce49-0899-451c-9b84-d6bb36c1edfb/console/0.log" Jun 11 21:24:41.370251 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:41.370182 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-ff9854f4d-2scl5_59b29085-145d-48c6-8e30-25d72df3ebf6/console/0.log" Jun 11 21:24:41.543666 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:41.543632 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k5xgg" event={"ID":"0e097be0-6ad1-4fea-9652-09fe7e0b89e1","Type":"ContainerStarted","Data":"8697be534c4e4b949ca9c8089e62cf615b73b5236c84d8f1ece40e5e9b917996"} Jun 11 21:24:42.543301 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:42.543262 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-69ff85444d-hcbjq" podUID="40cc6b3a-53cc-45d4-894e-53eb723f0352" containerName="console" containerID="cri-o://f1632c8fbe310c66244644e1c467b363ce7e80bb2ca9bc80a0886142a51f1e78" gracePeriod=15 Jun 11 21:24:42.549884 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:42.549857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k5xgg" event={"ID":"0e097be0-6ad1-4fea-9652-09fe7e0b89e1","Type":"ContainerStarted","Data":"3452691902f3549bab1fd9d53904e4b60871f7e4b84a001fd304259d8bb11c53"} Jun 11 21:24:42.550011 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:42.549909 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k5xgg" event={"ID":"0e097be0-6ad1-4fea-9652-09fe7e0b89e1","Type":"ContainerStarted","Data":"8b96c3230b5d6d79fec86baefc1123ebed721795ac700c3205d5ce30aff4d200"} Jun 11 21:24:42.565372 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:42.565330 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k5xgg" podStartSLOduration=253.774468797 podStartE2EDuration="4m14.565313749s" totalImagesPullingTime="790.844952ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:42.564058185 +0000 UTC m=+254.337998143" watchObservedRunningTime="2026-06-11 21:24:42.565313749 +0000 UTC m=+254.339253704" Jun 11 21:24:43.169507 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:43.169482 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xd2qc_95b638f6-e8d8-46fb-821b-dc717ecf393d/dns-node-resolver/0.log" Jun 11 21:24:44.170028 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:44.170003 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5478n_1c69230f-56d8-4a47-99de-65e6ca8ace50/node-ca/0.log" Jun 11 21:24:44.570232 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:44.570150 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-595dc98f7b-hphqq_197e0956-cb50-413d-8ace-dac9967f2a80/router/0.log" Jun 11 21:24:44.769366 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:44.769326 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5l5kw_3bcfddbf-7cfb-4f14-8fa4-89e702554ddb/serve-healthcheck-canary/0.log" Jun 11 21:24:47.855569 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:47.855540 2581 patch_prober.go:28] interesting pod/console-ff9854f4d-2scl5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 11 21:24:47.856051 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:47.855587 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-ff9854f4d-2scl5" podUID="59b29085-145d-48c6-8e30-25d72df3ebf6" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 11 21:24:48.784696 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:48.784656 2581 patch_prober.go:28] interesting pod/console-85df8c59bc-9nm6s container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 11 21:24:48.784902 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:48.784722 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85df8c59bc-9nm6s" podUID="0791ce49-0899-451c-9b84-d6bb36c1edfb" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 11 21:24:57.614230 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:57.614207 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69ff85444d-hcbjq_40cc6b3a-53cc-45d4-894e-53eb723f0352/console/0.log" Jun 11 21:24:57.614524 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:57.614241 2581 generic.go:356] "Generic (PLEG): container finished" podID="40cc6b3a-53cc-45d4-894e-53eb723f0352" containerID="f1632c8fbe310c66244644e1c467b363ce7e80bb2ca9bc80a0886142a51f1e78" exitCode=137 Jun 11 21:24:57.614524 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:57.614304 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69ff85444d-hcbjq" event={"ID":"40cc6b3a-53cc-45d4-894e-53eb723f0352","Type":"ContainerDied","Data":"f1632c8fbe310c66244644e1c467b363ce7e80bb2ca9bc80a0886142a51f1e78"} Jun 11 21:24:57.855597 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:57.855513 2581 patch_prober.go:28] interesting pod/console-ff9854f4d-2scl5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 11 21:24:57.855597 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:57.855560 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-ff9854f4d-2scl5" podUID="59b29085-145d-48c6-8e30-25d72df3ebf6" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 11 21:24:58.178538 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.178516 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69ff85444d-hcbjq_40cc6b3a-53cc-45d4-894e-53eb723f0352/console/0.log" Jun 11 21:24:58.179743 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.179728 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:24:58.353449 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.353397 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whn7k\" (UniqueName: \"kubernetes.io/projected/40cc6b3a-53cc-45d4-894e-53eb723f0352-kube-api-access-whn7k\") pod \"40cc6b3a-53cc-45d4-894e-53eb723f0352\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " Jun 11 21:24:58.353611 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.353468 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-config\") pod \"40cc6b3a-53cc-45d4-894e-53eb723f0352\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " Jun 11 21:24:58.353611 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.353520 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-oauth-config\") pod \"40cc6b3a-53cc-45d4-894e-53eb723f0352\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " Jun 11 21:24:58.353611 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.353566 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-oauth-serving-cert\") pod \"40cc6b3a-53cc-45d4-894e-53eb723f0352\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " Jun 11 21:24:58.353785 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.353618 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-serving-cert\") pod \"40cc6b3a-53cc-45d4-894e-53eb723f0352\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " Jun 11 21:24:58.353785 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.353661 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-service-ca\") pod \"40cc6b3a-53cc-45d4-894e-53eb723f0352\" (UID: \"40cc6b3a-53cc-45d4-894e-53eb723f0352\") " Jun 11 21:24:58.353935 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.353910 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-config" (OuterVolumeSpecName: "console-config") pod "40cc6b3a-53cc-45d4-894e-53eb723f0352" (UID: "40cc6b3a-53cc-45d4-894e-53eb723f0352"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:24:58.354047 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.354016 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "40cc6b3a-53cc-45d4-894e-53eb723f0352" (UID: "40cc6b3a-53cc-45d4-894e-53eb723f0352"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:24:58.354096 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.354081 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-service-ca" (OuterVolumeSpecName: "service-ca") pod "40cc6b3a-53cc-45d4-894e-53eb723f0352" (UID: "40cc6b3a-53cc-45d4-894e-53eb723f0352"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:24:58.355813 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.355786 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "40cc6b3a-53cc-45d4-894e-53eb723f0352" (UID: "40cc6b3a-53cc-45d4-894e-53eb723f0352"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:24:58.356079 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.356056 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40cc6b3a-53cc-45d4-894e-53eb723f0352-kube-api-access-whn7k" (OuterVolumeSpecName: "kube-api-access-whn7k") pod "40cc6b3a-53cc-45d4-894e-53eb723f0352" (UID: "40cc6b3a-53cc-45d4-894e-53eb723f0352"). InnerVolumeSpecName "kube-api-access-whn7k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:24:58.356079 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.356066 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "40cc6b3a-53cc-45d4-894e-53eb723f0352" (UID: "40cc6b3a-53cc-45d4-894e-53eb723f0352"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:24:58.454576 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.454548 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-serving-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:24:58.454576 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.454572 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-service-ca\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:24:58.454576 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.454582 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whn7k\" (UniqueName: \"kubernetes.io/projected/40cc6b3a-53cc-45d4-894e-53eb723f0352-kube-api-access-whn7k\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:24:58.454780 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.454590 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-config\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:24:58.454780 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.454599 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40cc6b3a-53cc-45d4-894e-53eb723f0352-console-oauth-config\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:24:58.454780 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.454608 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40cc6b3a-53cc-45d4-894e-53eb723f0352-oauth-serving-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:24:58.620081 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.620001 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69ff85444d-hcbjq_40cc6b3a-53cc-45d4-894e-53eb723f0352/console/0.log" Jun 11 21:24:58.620489 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.620088 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69ff85444d-hcbjq" Jun 11 21:24:58.620489 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.620100 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69ff85444d-hcbjq" event={"ID":"40cc6b3a-53cc-45d4-894e-53eb723f0352","Type":"ContainerDied","Data":"65e995872265e274a9c4e2294d552dec3af793cc3b9c0c555f89ca65b195ba38"} Jun 11 21:24:58.620489 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.620146 2581 scope.go:117] "RemoveContainer" containerID="f1632c8fbe310c66244644e1c467b363ce7e80bb2ca9bc80a0886142a51f1e78" Jun 11 21:24:58.640415 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.640373 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69ff85444d-hcbjq"] Jun 11 21:24:58.644317 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.644291 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69ff85444d-hcbjq"] Jun 11 21:24:58.706277 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.706247 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40cc6b3a-53cc-45d4-894e-53eb723f0352" path="/var/lib/kubelet/pods/40cc6b3a-53cc-45d4-894e-53eb723f0352/volumes" Jun 11 21:24:58.784624 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.784590 2581 patch_prober.go:28] interesting pod/console-85df8c59bc-9nm6s container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 11 21:24:58.784792 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:24:58.784635 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85df8c59bc-9nm6s" podUID="0791ce49-0899-451c-9b84-d6bb36c1edfb" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 11 21:25:07.855573 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:07.855531 2581 patch_prober.go:28] interesting pod/console-ff9854f4d-2scl5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 11 21:25:07.855959 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:07.855602 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-ff9854f4d-2scl5" podUID="59b29085-145d-48c6-8e30-25d72df3ebf6" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 11 21:25:08.784121 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:08.784081 2581 patch_prober.go:28] interesting pod/console-85df8c59bc-9nm6s container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 11 21:25:08.784305 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:08.784133 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85df8c59bc-9nm6s" podUID="0791ce49-0899-451c-9b84-d6bb36c1edfb" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 11 21:25:10.174760 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:25:10.174709 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8vn6m" podUID="cddedd15-ffbc-40cc-9327-b496b9474e62" Jun 11 21:25:10.672826 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:10.672794 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vn6m" Jun 11 21:25:13.985127 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:13.985076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:25:13.987364 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:13.987344 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cddedd15-ffbc-40cc-9327-b496b9474e62-metrics-tls\") pod \"dns-default-8vn6m\" (UID: \"cddedd15-ffbc-40cc-9327-b496b9474e62\") " pod="openshift-dns/dns-default-8vn6m" Jun 11 21:25:14.275893 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:14.275806 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x2227\"" Jun 11 21:25:14.284660 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:14.284628 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vn6m" Jun 11 21:25:14.414597 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:14.414563 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8vn6m"] Jun 11 21:25:14.417417 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:25:14.417373 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcddedd15_ffbc_40cc_9327_b496b9474e62.slice/crio-ccd1093b063cea42b5f42aa1eae1bea76c2f7233af664e42cf0edd33fef386f2 WatchSource:0}: Error finding container ccd1093b063cea42b5f42aa1eae1bea76c2f7233af664e42cf0edd33fef386f2: Status 404 returned error can't find the container with id ccd1093b063cea42b5f42aa1eae1bea76c2f7233af664e42cf0edd33fef386f2 Jun 11 21:25:14.693380 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:14.693343 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vn6m" event={"ID":"cddedd15-ffbc-40cc-9327-b496b9474e62","Type":"ContainerStarted","Data":"ccd1093b063cea42b5f42aa1eae1bea76c2f7233af664e42cf0edd33fef386f2"} Jun 11 21:25:16.706083 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:16.706051 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8vn6m" Jun 11 21:25:16.706465 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:16.706103 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vn6m" event={"ID":"cddedd15-ffbc-40cc-9327-b496b9474e62","Type":"ContainerStarted","Data":"5f240b7c893e43026231aa9e92fe85ca22fa733fd5a31e9dc2ae3774c791e3dc"} Jun 11 21:25:16.706465 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:16.706131 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vn6m" event={"ID":"cddedd15-ffbc-40cc-9327-b496b9474e62","Type":"ContainerStarted","Data":"6f326eecbc04a555762bbd6ace03f96bd27ce635e19db76a6a0b3230906fedda"} Jun 11 21:25:17.859947 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:17.859921 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:25:17.863792 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:17.863775 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:25:17.887509 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:17.887466 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8vn6m" podStartSLOduration=252.221045141 podStartE2EDuration="4m13.887451408s" totalImagesPullingTime="1.666406267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:25:16.71785386 +0000 UTC m=+288.491793841" watchObservedRunningTime="2026-06-11 21:25:17.887451408 +0000 UTC m=+289.661391363" Jun 11 21:25:17.998919 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:17.998888 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85df8c59bc-9nm6s"] Jun 11 21:25:26.708645 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:26.708617 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8vn6m" Jun 11 21:25:28.661859 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:28.661825 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:25:28.662276 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:28.661985 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:25:28.665753 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:28.665735 2581 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 21:25:40.478789 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.478759 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-856765d7b-lktwq"] Jun 11 21:25:40.481007 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.479097 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40cc6b3a-53cc-45d4-894e-53eb723f0352" containerName="console" Jun 11 21:25:40.481007 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.479108 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="40cc6b3a-53cc-45d4-894e-53eb723f0352" containerName="console" Jun 11 21:25:40.481007 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.479230 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="40cc6b3a-53cc-45d4-894e-53eb723f0352" containerName="console" Jun 11 21:25:40.482006 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.481989 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.502637 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.502614 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-856765d7b-lktwq"] Jun 11 21:25:40.612300 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.612265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-console-config\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.612300 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.612315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-trusted-ca-bundle\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.612551 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.612344 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-oauth-serving-cert\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.612551 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.612424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vd2g\" (UniqueName: \"kubernetes.io/projected/07cd3632-2741-42c0-9391-103078608836-kube-api-access-6vd2g\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.612551 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.612447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-service-ca\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.612551 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.612485 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07cd3632-2741-42c0-9391-103078608836-console-oauth-config\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.612551 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.612518 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07cd3632-2741-42c0-9391-103078608836-console-serving-cert\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.713785 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.713751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07cd3632-2741-42c0-9391-103078608836-console-oauth-config\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.713957 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.713796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07cd3632-2741-42c0-9391-103078608836-console-serving-cert\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.713957 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.713833 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-console-config\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.713957 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.713869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-trusted-ca-bundle\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.714115 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.714009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-oauth-serving-cert\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.714115 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.714063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vd2g\" (UniqueName: \"kubernetes.io/projected/07cd3632-2741-42c0-9391-103078608836-kube-api-access-6vd2g\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.714115 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.714092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-service-ca\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.714740 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.714717 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-console-config\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.714850 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.714745 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-oauth-serving-cert\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.714931 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.714911 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-service-ca\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.714990 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.714964 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-trusted-ca-bundle\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.716456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.716437 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07cd3632-2741-42c0-9391-103078608836-console-serving-cert\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.716524 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.716474 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07cd3632-2741-42c0-9391-103078608836-console-oauth-config\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.722353 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.722335 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vd2g\" (UniqueName: \"kubernetes.io/projected/07cd3632-2741-42c0-9391-103078608836-kube-api-access-6vd2g\") pod \"console-856765d7b-lktwq\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.791056 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.790967 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:40.923160 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:40.923110 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-856765d7b-lktwq"] Jun 11 21:25:40.925983 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:25:40.925954 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07cd3632_2741_42c0_9391_103078608836.slice/crio-d5e9c741588555640e048bd4e824876fce976992eba856b2958594da626e8bd7 WatchSource:0}: Error finding container d5e9c741588555640e048bd4e824876fce976992eba856b2958594da626e8bd7: Status 404 returned error can't find the container with id d5e9c741588555640e048bd4e824876fce976992eba856b2958594da626e8bd7 Jun 11 21:25:41.807342 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:41.807305 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-856765d7b-lktwq" event={"ID":"07cd3632-2741-42c0-9391-103078608836","Type":"ContainerStarted","Data":"697aad858b60ef0c58953db26047f24c3cce29eb62bce67cedc7934702587767"} Jun 11 21:25:41.807732 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:41.807352 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-856765d7b-lktwq" event={"ID":"07cd3632-2741-42c0-9391-103078608836","Type":"ContainerStarted","Data":"d5e9c741588555640e048bd4e824876fce976992eba856b2958594da626e8bd7"} Jun 11 21:25:41.824558 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:41.824508 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-856765d7b-lktwq" podStartSLOduration=1.824493194 podStartE2EDuration="1.824493194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:25:41.822576883 +0000 UTC m=+313.596516839" watchObservedRunningTime="2026-06-11 21:25:41.824493194 +0000 UTC m=+313.598433212" Jun 11 21:25:43.018829 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.018788 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85df8c59bc-9nm6s" podUID="0791ce49-0899-451c-9b84-d6bb36c1edfb" containerName="console" containerID="cri-o://65627b4202530bb0835837da34b3da144a7dd31a47b3d1e2afd5496d1182daa2" gracePeriod=15 Jun 11 21:25:43.274380 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.274317 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:25:43.438423 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.438365 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-serving-cert\") pod \"0791ce49-0899-451c-9b84-d6bb36c1edfb\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " Jun 11 21:25:43.438423 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.438425 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-service-ca\") pod \"0791ce49-0899-451c-9b84-d6bb36c1edfb\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " Jun 11 21:25:43.438672 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.438473 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8rbn\" (UniqueName: \"kubernetes.io/projected/0791ce49-0899-451c-9b84-d6bb36c1edfb-kube-api-access-g8rbn\") pod \"0791ce49-0899-451c-9b84-d6bb36c1edfb\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " Jun 11 21:25:43.438672 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.438516 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-config\") pod \"0791ce49-0899-451c-9b84-d6bb36c1edfb\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " Jun 11 21:25:43.438672 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.438536 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-trusted-ca-bundle\") pod \"0791ce49-0899-451c-9b84-d6bb36c1edfb\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " Jun 11 21:25:43.438672 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.438566 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-oauth-config\") pod \"0791ce49-0899-451c-9b84-d6bb36c1edfb\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " Jun 11 21:25:43.438672 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.438600 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-oauth-serving-cert\") pod \"0791ce49-0899-451c-9b84-d6bb36c1edfb\" (UID: \"0791ce49-0899-451c-9b84-d6bb36c1edfb\") " Jun 11 21:25:43.438962 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.438929 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-config" (OuterVolumeSpecName: "console-config") pod "0791ce49-0899-451c-9b84-d6bb36c1edfb" (UID: "0791ce49-0899-451c-9b84-d6bb36c1edfb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:25:43.439093 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.438930 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0791ce49-0899-451c-9b84-d6bb36c1edfb" (UID: "0791ce49-0899-451c-9b84-d6bb36c1edfb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:25:43.439093 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.439047 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-service-ca" (OuterVolumeSpecName: "service-ca") pod "0791ce49-0899-451c-9b84-d6bb36c1edfb" (UID: "0791ce49-0899-451c-9b84-d6bb36c1edfb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:25:43.439211 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.439157 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0791ce49-0899-451c-9b84-d6bb36c1edfb" (UID: "0791ce49-0899-451c-9b84-d6bb36c1edfb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:25:43.440699 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.440670 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0791ce49-0899-451c-9b84-d6bb36c1edfb" (UID: "0791ce49-0899-451c-9b84-d6bb36c1edfb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:43.440784 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.440706 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0791ce49-0899-451c-9b84-d6bb36c1edfb" (UID: "0791ce49-0899-451c-9b84-d6bb36c1edfb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:43.440784 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.440741 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0791ce49-0899-451c-9b84-d6bb36c1edfb-kube-api-access-g8rbn" (OuterVolumeSpecName: "kube-api-access-g8rbn") pod "0791ce49-0899-451c-9b84-d6bb36c1edfb" (UID: "0791ce49-0899-451c-9b84-d6bb36c1edfb"). InnerVolumeSpecName "kube-api-access-g8rbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:25:43.539961 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.539875 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-config\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:25:43.539961 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.539904 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-trusted-ca-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:25:43.539961 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.539914 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-oauth-config\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:25:43.539961 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.539923 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-oauth-serving-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:25:43.539961 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.539933 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0791ce49-0899-451c-9b84-d6bb36c1edfb-console-serving-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:25:43.539961 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.539941 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0791ce49-0899-451c-9b84-d6bb36c1edfb-service-ca\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:25:43.539961 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.539948 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8rbn\" (UniqueName: \"kubernetes.io/projected/0791ce49-0899-451c-9b84-d6bb36c1edfb-kube-api-access-g8rbn\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:25:43.815632 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.815545 2581 generic.go:356] "Generic (PLEG): container finished" podID="0791ce49-0899-451c-9b84-d6bb36c1edfb" containerID="65627b4202530bb0835837da34b3da144a7dd31a47b3d1e2afd5496d1182daa2" exitCode=0 Jun 11 21:25:43.815632 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.815593 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85df8c59bc-9nm6s" Jun 11 21:25:43.815632 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.815618 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85df8c59bc-9nm6s" event={"ID":"0791ce49-0899-451c-9b84-d6bb36c1edfb","Type":"ContainerDied","Data":"65627b4202530bb0835837da34b3da144a7dd31a47b3d1e2afd5496d1182daa2"} Jun 11 21:25:43.815871 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.815657 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85df8c59bc-9nm6s" event={"ID":"0791ce49-0899-451c-9b84-d6bb36c1edfb","Type":"ContainerDied","Data":"4c89158ea63560193a192708d508e0ee7fccc215443a4cc239b1faf492c0defb"} Jun 11 21:25:43.815871 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.815678 2581 scope.go:117] "RemoveContainer" containerID="65627b4202530bb0835837da34b3da144a7dd31a47b3d1e2afd5496d1182daa2" Jun 11 21:25:43.824519 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.824461 2581 scope.go:117] "RemoveContainer" containerID="65627b4202530bb0835837da34b3da144a7dd31a47b3d1e2afd5496d1182daa2" Jun 11 21:25:43.824720 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:25:43.824701 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65627b4202530bb0835837da34b3da144a7dd31a47b3d1e2afd5496d1182daa2\": container with ID starting with 65627b4202530bb0835837da34b3da144a7dd31a47b3d1e2afd5496d1182daa2 not found: ID does not exist" containerID="65627b4202530bb0835837da34b3da144a7dd31a47b3d1e2afd5496d1182daa2" Jun 11 21:25:43.824775 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.824729 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65627b4202530bb0835837da34b3da144a7dd31a47b3d1e2afd5496d1182daa2"} err="failed to get container status \"65627b4202530bb0835837da34b3da144a7dd31a47b3d1e2afd5496d1182daa2\": rpc error: code = NotFound desc = could not find container \"65627b4202530bb0835837da34b3da144a7dd31a47b3d1e2afd5496d1182daa2\": container with ID starting with 65627b4202530bb0835837da34b3da144a7dd31a47b3d1e2afd5496d1182daa2 not found: ID does not exist" Jun 11 21:25:43.836884 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.836862 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85df8c59bc-9nm6s"] Jun 11 21:25:43.840204 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:43.840182 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85df8c59bc-9nm6s"] Jun 11 21:25:44.706767 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:44.706732 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0791ce49-0899-451c-9b84-d6bb36c1edfb" path="/var/lib/kubelet/pods/0791ce49-0899-451c-9b84-d6bb36c1edfb/volumes" Jun 11 21:25:50.791248 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:50.791195 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:50.791675 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:50.791296 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:50.796034 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:50.796014 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:50.845809 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:50.845783 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:25:50.890861 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:25:50.890832 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ff9854f4d-2scl5"] Jun 11 21:26:15.919048 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:15.918960 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-ff9854f4d-2scl5" podUID="59b29085-145d-48c6-8e30-25d72df3ebf6" containerName="console" containerID="cri-o://24fd332a11e1fd7b5a66cb076792474057012a82f09a056b127845614d324420" gracePeriod=15 Jun 11 21:26:16.158595 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.158573 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:26:16.190513 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.190452 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-service-ca\") pod \"59b29085-145d-48c6-8e30-25d72df3ebf6\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " Jun 11 21:26:16.190513 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.190488 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlp74\" (UniqueName: \"kubernetes.io/projected/59b29085-145d-48c6-8e30-25d72df3ebf6-kube-api-access-nlp74\") pod \"59b29085-145d-48c6-8e30-25d72df3ebf6\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " Jun 11 21:26:16.190715 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.190517 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59b29085-145d-48c6-8e30-25d72df3ebf6-console-serving-cert\") pod \"59b29085-145d-48c6-8e30-25d72df3ebf6\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " Jun 11 21:26:16.190715 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.190565 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-console-config\") pod \"59b29085-145d-48c6-8e30-25d72df3ebf6\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " Jun 11 21:26:16.190715 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.190605 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59b29085-145d-48c6-8e30-25d72df3ebf6-console-oauth-config\") pod \"59b29085-145d-48c6-8e30-25d72df3ebf6\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " Jun 11 21:26:16.190874 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.190746 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-trusted-ca-bundle\") pod \"59b29085-145d-48c6-8e30-25d72df3ebf6\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " Jun 11 21:26:16.190874 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.190809 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-oauth-serving-cert\") pod \"59b29085-145d-48c6-8e30-25d72df3ebf6\" (UID: \"59b29085-145d-48c6-8e30-25d72df3ebf6\") " Jun 11 21:26:16.190990 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.190870 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-service-ca" (OuterVolumeSpecName: "service-ca") pod "59b29085-145d-48c6-8e30-25d72df3ebf6" (UID: "59b29085-145d-48c6-8e30-25d72df3ebf6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:26:16.191044 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.190994 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-console-config" (OuterVolumeSpecName: "console-config") pod "59b29085-145d-48c6-8e30-25d72df3ebf6" (UID: "59b29085-145d-48c6-8e30-25d72df3ebf6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:26:16.191123 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.191105 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-console-config\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:26:16.191184 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.191128 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-service-ca\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:26:16.191264 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.191241 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "59b29085-145d-48c6-8e30-25d72df3ebf6" (UID: "59b29085-145d-48c6-8e30-25d72df3ebf6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:26:16.191326 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.191265 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "59b29085-145d-48c6-8e30-25d72df3ebf6" (UID: "59b29085-145d-48c6-8e30-25d72df3ebf6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:26:16.192741 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.192719 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b29085-145d-48c6-8e30-25d72df3ebf6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "59b29085-145d-48c6-8e30-25d72df3ebf6" (UID: "59b29085-145d-48c6-8e30-25d72df3ebf6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:26:16.192833 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.192775 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b29085-145d-48c6-8e30-25d72df3ebf6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "59b29085-145d-48c6-8e30-25d72df3ebf6" (UID: "59b29085-145d-48c6-8e30-25d72df3ebf6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:26:16.192916 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.192902 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59b29085-145d-48c6-8e30-25d72df3ebf6-kube-api-access-nlp74" (OuterVolumeSpecName: "kube-api-access-nlp74") pod "59b29085-145d-48c6-8e30-25d72df3ebf6" (UID: "59b29085-145d-48c6-8e30-25d72df3ebf6"). InnerVolumeSpecName "kube-api-access-nlp74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:26:16.292070 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.292038 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59b29085-145d-48c6-8e30-25d72df3ebf6-console-oauth-config\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:26:16.292070 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.292063 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-trusted-ca-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:26:16.292070 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.292072 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59b29085-145d-48c6-8e30-25d72df3ebf6-oauth-serving-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:26:16.292276 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.292081 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlp74\" (UniqueName: \"kubernetes.io/projected/59b29085-145d-48c6-8e30-25d72df3ebf6-kube-api-access-nlp74\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:26:16.292276 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.292090 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59b29085-145d-48c6-8e30-25d72df3ebf6-console-serving-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:26:16.946715 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.946681 2581 generic.go:356] "Generic (PLEG): container finished" podID="59b29085-145d-48c6-8e30-25d72df3ebf6" containerID="24fd332a11e1fd7b5a66cb076792474057012a82f09a056b127845614d324420" exitCode=0 Jun 11 21:26:16.947148 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.946724 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff9854f4d-2scl5" Jun 11 21:26:16.947148 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.946745 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff9854f4d-2scl5" event={"ID":"59b29085-145d-48c6-8e30-25d72df3ebf6","Type":"ContainerDied","Data":"24fd332a11e1fd7b5a66cb076792474057012a82f09a056b127845614d324420"} Jun 11 21:26:16.947148 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.946796 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff9854f4d-2scl5" event={"ID":"59b29085-145d-48c6-8e30-25d72df3ebf6","Type":"ContainerDied","Data":"27fbab5b9a10f1f293ab44e92f8d3250c28a9b74ab8da270bb231ef27c4b2e6b"} Jun 11 21:26:16.947148 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.946817 2581 scope.go:117] "RemoveContainer" containerID="24fd332a11e1fd7b5a66cb076792474057012a82f09a056b127845614d324420" Jun 11 21:26:16.954995 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.954979 2581 scope.go:117] "RemoveContainer" containerID="24fd332a11e1fd7b5a66cb076792474057012a82f09a056b127845614d324420" Jun 11 21:26:16.955250 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:26:16.955232 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24fd332a11e1fd7b5a66cb076792474057012a82f09a056b127845614d324420\": container with ID starting with 24fd332a11e1fd7b5a66cb076792474057012a82f09a056b127845614d324420 not found: ID does not exist" containerID="24fd332a11e1fd7b5a66cb076792474057012a82f09a056b127845614d324420" Jun 11 21:26:16.955300 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.955258 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24fd332a11e1fd7b5a66cb076792474057012a82f09a056b127845614d324420"} err="failed to get container status \"24fd332a11e1fd7b5a66cb076792474057012a82f09a056b127845614d324420\": rpc error: code = NotFound desc = could not find container \"24fd332a11e1fd7b5a66cb076792474057012a82f09a056b127845614d324420\": container with ID starting with 24fd332a11e1fd7b5a66cb076792474057012a82f09a056b127845614d324420 not found: ID does not exist" Jun 11 21:26:16.962938 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.962912 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ff9854f4d-2scl5"] Jun 11 21:26:16.967519 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:16.967465 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-ff9854f4d-2scl5"] Jun 11 21:26:18.706319 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:26:18.706287 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59b29085-145d-48c6-8e30-25d72df3ebf6" path="/var/lib/kubelet/pods/59b29085-145d-48c6-8e30-25d72df3ebf6/volumes" Jun 11 21:27:02.276484 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.276449 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-848788995f-5ggb9"] Jun 11 21:27:02.276952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.276746 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b29085-145d-48c6-8e30-25d72df3ebf6" containerName="console" Jun 11 21:27:02.276952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.276757 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b29085-145d-48c6-8e30-25d72df3ebf6" containerName="console" Jun 11 21:27:02.276952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.276774 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0791ce49-0899-451c-9b84-d6bb36c1edfb" containerName="console" Jun 11 21:27:02.276952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.276779 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0791ce49-0899-451c-9b84-d6bb36c1edfb" containerName="console" Jun 11 21:27:02.276952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.276837 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0791ce49-0899-451c-9b84-d6bb36c1edfb" containerName="console" Jun 11 21:27:02.276952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.276845 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="59b29085-145d-48c6-8e30-25d72df3ebf6" containerName="console" Jun 11 21:27:02.279669 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.279654 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.292661 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.292633 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-848788995f-5ggb9"] Jun 11 21:27:02.471642 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.471604 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-oauth-serving-cert\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.471642 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.471646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-serving-cert\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.471862 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.471676 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x6fv\" (UniqueName: \"kubernetes.io/projected/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-kube-api-access-4x6fv\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.471862 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.471806 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-service-ca\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.471862 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.471853 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-oauth-config\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.472011 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.471871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-config\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.472011 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.471932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-trusted-ca-bundle\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.573424 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.573315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-service-ca\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.573424 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.573377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-oauth-config\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.573424 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.573415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-config\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.573678 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.573444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-trusted-ca-bundle\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.573678 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.573491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-oauth-serving-cert\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.573678 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.573516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-serving-cert\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.573678 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.573545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x6fv\" (UniqueName: \"kubernetes.io/projected/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-kube-api-access-4x6fv\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.574136 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.574102 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-service-ca\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.574254 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.574143 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-config\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.574254 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.574240 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-oauth-serving-cert\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.574421 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.574383 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-trusted-ca-bundle\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.576000 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.575970 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-oauth-config\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.576102 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.576057 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-serving-cert\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.588941 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.588922 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x6fv\" (UniqueName: \"kubernetes.io/projected/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-kube-api-access-4x6fv\") pod \"console-848788995f-5ggb9\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.593843 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.593806 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:02.720286 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:02.720262 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-848788995f-5ggb9"] Jun 11 21:27:02.722509 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:27:02.722478 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba9e325_bda6_4ec4_9534_fc5c3b94abad.slice/crio-c4d3256e3b9f57cd967183bb22d377d38a569ec3917db5a72e20eb2d36005468 WatchSource:0}: Error finding container c4d3256e3b9f57cd967183bb22d377d38a569ec3917db5a72e20eb2d36005468: Status 404 returned error can't find the container with id c4d3256e3b9f57cd967183bb22d377d38a569ec3917db5a72e20eb2d36005468 Jun 11 21:27:03.127878 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:03.127842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848788995f-5ggb9" event={"ID":"3ba9e325-bda6-4ec4-9534-fc5c3b94abad","Type":"ContainerStarted","Data":"ab73ad4ab6e0db0771261369d92144afc45ce0ad04630d629bbd10cd0e284da7"} Jun 11 21:27:03.127878 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:03.127887 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848788995f-5ggb9" event={"ID":"3ba9e325-bda6-4ec4-9534-fc5c3b94abad","Type":"ContainerStarted","Data":"c4d3256e3b9f57cd967183bb22d377d38a569ec3917db5a72e20eb2d36005468"} Jun 11 21:27:03.145825 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:03.145777 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-848788995f-5ggb9" podStartSLOduration=1.145762291 podStartE2EDuration="1.145762291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:27:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:27:03.1436597 +0000 UTC m=+394.917599696" watchObservedRunningTime="2026-06-11 21:27:03.145762291 +0000 UTC m=+394.919702247" Jun 11 21:27:12.593960 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:12.593927 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:12.594477 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:12.593995 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:12.598343 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:12.598322 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:13.168793 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:13.168767 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:27:13.211085 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:13.211052 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-856765d7b-lktwq"] Jun 11 21:27:22.352717 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.352685 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc"] Jun 11 21:27:22.356143 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.356125 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" Jun 11 21:27:22.358464 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.358443 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rw9rw\"" Jun 11 21:27:22.358582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.358474 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:27:22.359382 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.359366 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:27:22.365110 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.365083 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc"] Jun 11 21:27:22.442497 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.442470 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc\" (UID: \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" Jun 11 21:27:22.442626 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.442514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjzvj\" (UniqueName: \"kubernetes.io/projected/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-kube-api-access-jjzvj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc\" (UID: \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" Jun 11 21:27:22.442626 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.442590 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc\" (UID: \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" Jun 11 21:27:22.543463 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.543431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc\" (UID: \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" Jun 11 21:27:22.543621 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.543500 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjzvj\" (UniqueName: \"kubernetes.io/projected/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-kube-api-access-jjzvj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc\" (UID: \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" Jun 11 21:27:22.543621 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.543564 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc\" (UID: \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" Jun 11 21:27:22.543788 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.543769 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc\" (UID: \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" Jun 11 21:27:22.543883 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.543865 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc\" (UID: \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" Jun 11 21:27:22.552128 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.552104 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjzvj\" (UniqueName: \"kubernetes.io/projected/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-kube-api-access-jjzvj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc\" (UID: \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" Jun 11 21:27:22.666023 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.666000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" Jun 11 21:27:22.790863 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.790840 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc"] Jun 11 21:27:22.792994 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:27:22.792970 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eab1b0a_3932_4d31_bd0a_481ecb36bd78.slice/crio-23d292edc58eb9c08fcd5c5cd95d30f5c25b5d1c5ec9ef3cb7e90e631d233924 WatchSource:0}: Error finding container 23d292edc58eb9c08fcd5c5cd95d30f5c25b5d1c5ec9ef3cb7e90e631d233924: Status 404 returned error can't find the container with id 23d292edc58eb9c08fcd5c5cd95d30f5c25b5d1c5ec9ef3cb7e90e631d233924 Jun 11 21:27:22.795074 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:22.795059 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:27:23.207744 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:23.207711 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" event={"ID":"1eab1b0a-3932-4d31-bd0a-481ecb36bd78","Type":"ContainerStarted","Data":"23d292edc58eb9c08fcd5c5cd95d30f5c25b5d1c5ec9ef3cb7e90e631d233924"} Jun 11 21:27:29.236165 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:29.236133 2581 generic.go:356] "Generic (PLEG): container finished" podID="1eab1b0a-3932-4d31-bd0a-481ecb36bd78" containerID="b20df21bdbebd1d6ddd9778db3fe721a7f39d5fb97610f124c32924b3c4cd5a3" exitCode=0 Jun 11 21:27:29.236563 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:29.236216 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" event={"ID":"1eab1b0a-3932-4d31-bd0a-481ecb36bd78","Type":"ContainerDied","Data":"b20df21bdbebd1d6ddd9778db3fe721a7f39d5fb97610f124c32924b3c4cd5a3"} Jun 11 21:27:32.251385 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:32.251351 2581 generic.go:356] "Generic (PLEG): container finished" podID="1eab1b0a-3932-4d31-bd0a-481ecb36bd78" containerID="255666277f2f0bbd934a3e737092cdf9d0819d2272d955bcaec5d96766449bd9" exitCode=0 Jun 11 21:27:32.251823 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:32.251441 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" event={"ID":"1eab1b0a-3932-4d31-bd0a-481ecb36bd78","Type":"ContainerDied","Data":"255666277f2f0bbd934a3e737092cdf9d0819d2272d955bcaec5d96766449bd9"} Jun 11 21:27:38.231664 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.231589 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-856765d7b-lktwq" podUID="07cd3632-2741-42c0-9391-103078608836" containerName="console" containerID="cri-o://697aad858b60ef0c58953db26047f24c3cce29eb62bce67cedc7934702587767" gracePeriod=15 Jun 11 21:27:38.279249 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.279220 2581 generic.go:356] "Generic (PLEG): container finished" podID="1eab1b0a-3932-4d31-bd0a-481ecb36bd78" containerID="ffd8d4904f5826c57ec17797521ac7fe8b367ec820f26ac38a099c6ab08affa0" exitCode=0 Jun 11 21:27:38.279368 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.279302 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" event={"ID":"1eab1b0a-3932-4d31-bd0a-481ecb36bd78","Type":"ContainerDied","Data":"ffd8d4904f5826c57ec17797521ac7fe8b367ec820f26ac38a099c6ab08affa0"} Jun 11 21:27:38.466625 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.466604 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:27:38.587245 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.587170 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vd2g\" (UniqueName: \"kubernetes.io/projected/07cd3632-2741-42c0-9391-103078608836-kube-api-access-6vd2g\") pod \"07cd3632-2741-42c0-9391-103078608836\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " Jun 11 21:27:38.587245 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.587200 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07cd3632-2741-42c0-9391-103078608836-console-oauth-config\") pod \"07cd3632-2741-42c0-9391-103078608836\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " Jun 11 21:27:38.587245 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.587241 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-trusted-ca-bundle\") pod \"07cd3632-2741-42c0-9391-103078608836\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " Jun 11 21:27:38.587516 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.587283 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-console-config\") pod \"07cd3632-2741-42c0-9391-103078608836\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " Jun 11 21:27:38.587516 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.587317 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-service-ca\") pod \"07cd3632-2741-42c0-9391-103078608836\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " Jun 11 21:27:38.587516 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.587352 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-oauth-serving-cert\") pod \"07cd3632-2741-42c0-9391-103078608836\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " Jun 11 21:27:38.587516 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.587438 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07cd3632-2741-42c0-9391-103078608836-console-serving-cert\") pod \"07cd3632-2741-42c0-9391-103078608836\" (UID: \"07cd3632-2741-42c0-9391-103078608836\") " Jun 11 21:27:38.587862 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.587829 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "07cd3632-2741-42c0-9391-103078608836" (UID: "07cd3632-2741-42c0-9391-103078608836"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:27:38.587991 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.587864 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-service-ca" (OuterVolumeSpecName: "service-ca") pod "07cd3632-2741-42c0-9391-103078608836" (UID: "07cd3632-2741-42c0-9391-103078608836"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:27:38.587991 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.587859 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "07cd3632-2741-42c0-9391-103078608836" (UID: "07cd3632-2741-42c0-9391-103078608836"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:27:38.588072 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.587997 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-console-config" (OuterVolumeSpecName: "console-config") pod "07cd3632-2741-42c0-9391-103078608836" (UID: "07cd3632-2741-42c0-9391-103078608836"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:27:38.589359 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.589333 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07cd3632-2741-42c0-9391-103078608836-kube-api-access-6vd2g" (OuterVolumeSpecName: "kube-api-access-6vd2g") pod "07cd3632-2741-42c0-9391-103078608836" (UID: "07cd3632-2741-42c0-9391-103078608836"). InnerVolumeSpecName "kube-api-access-6vd2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:27:38.589474 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.589359 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07cd3632-2741-42c0-9391-103078608836-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "07cd3632-2741-42c0-9391-103078608836" (UID: "07cd3632-2741-42c0-9391-103078608836"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:27:38.589474 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.589440 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07cd3632-2741-42c0-9391-103078608836-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "07cd3632-2741-42c0-9391-103078608836" (UID: "07cd3632-2741-42c0-9391-103078608836"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:27:38.688316 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.688291 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07cd3632-2741-42c0-9391-103078608836-console-serving-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:27:38.688316 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.688313 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vd2g\" (UniqueName: \"kubernetes.io/projected/07cd3632-2741-42c0-9391-103078608836-kube-api-access-6vd2g\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:27:38.688446 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.688323 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07cd3632-2741-42c0-9391-103078608836-console-oauth-config\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:27:38.688446 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.688332 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-trusted-ca-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:27:38.688446 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.688340 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-console-config\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:27:38.688446 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.688348 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-service-ca\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:27:38.688446 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:38.688356 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07cd3632-2741-42c0-9391-103078608836-oauth-serving-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:27:39.284464 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.284372 2581 generic.go:356] "Generic (PLEG): container finished" podID="07cd3632-2741-42c0-9391-103078608836" containerID="697aad858b60ef0c58953db26047f24c3cce29eb62bce67cedc7934702587767" exitCode=0 Jun 11 21:27:39.284464 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.284432 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-856765d7b-lktwq" Jun 11 21:27:39.284877 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.284458 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-856765d7b-lktwq" event={"ID":"07cd3632-2741-42c0-9391-103078608836","Type":"ContainerDied","Data":"697aad858b60ef0c58953db26047f24c3cce29eb62bce67cedc7934702587767"} Jun 11 21:27:39.284877 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.284509 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-856765d7b-lktwq" event={"ID":"07cd3632-2741-42c0-9391-103078608836","Type":"ContainerDied","Data":"d5e9c741588555640e048bd4e824876fce976992eba856b2958594da626e8bd7"} Jun 11 21:27:39.284877 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.284528 2581 scope.go:117] "RemoveContainer" containerID="697aad858b60ef0c58953db26047f24c3cce29eb62bce67cedc7934702587767" Jun 11 21:27:39.293092 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.293068 2581 scope.go:117] "RemoveContainer" containerID="697aad858b60ef0c58953db26047f24c3cce29eb62bce67cedc7934702587767" Jun 11 21:27:39.293358 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:27:39.293339 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"697aad858b60ef0c58953db26047f24c3cce29eb62bce67cedc7934702587767\": container with ID starting with 697aad858b60ef0c58953db26047f24c3cce29eb62bce67cedc7934702587767 not found: ID does not exist" containerID="697aad858b60ef0c58953db26047f24c3cce29eb62bce67cedc7934702587767" Jun 11 21:27:39.293435 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.293364 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"697aad858b60ef0c58953db26047f24c3cce29eb62bce67cedc7934702587767"} err="failed to get container status \"697aad858b60ef0c58953db26047f24c3cce29eb62bce67cedc7934702587767\": rpc error: code = NotFound desc = could not find container \"697aad858b60ef0c58953db26047f24c3cce29eb62bce67cedc7934702587767\": container with ID starting with 697aad858b60ef0c58953db26047f24c3cce29eb62bce67cedc7934702587767 not found: ID does not exist" Jun 11 21:27:39.302073 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.302049 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-856765d7b-lktwq"] Jun 11 21:27:39.305604 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.305580 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-856765d7b-lktwq"] Jun 11 21:27:39.407344 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.407323 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" Jun 11 21:27:39.495691 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.495627 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjzvj\" (UniqueName: \"kubernetes.io/projected/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-kube-api-access-jjzvj\") pod \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\" (UID: \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\") " Jun 11 21:27:39.495799 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.495687 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-bundle\") pod \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\" (UID: \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\") " Jun 11 21:27:39.495799 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.495713 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-util\") pod \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\" (UID: \"1eab1b0a-3932-4d31-bd0a-481ecb36bd78\") " Jun 11 21:27:39.496307 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.496285 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-bundle" (OuterVolumeSpecName: "bundle") pod "1eab1b0a-3932-4d31-bd0a-481ecb36bd78" (UID: "1eab1b0a-3932-4d31-bd0a-481ecb36bd78"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:27:39.497737 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.497715 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-kube-api-access-jjzvj" (OuterVolumeSpecName: "kube-api-access-jjzvj") pod "1eab1b0a-3932-4d31-bd0a-481ecb36bd78" (UID: "1eab1b0a-3932-4d31-bd0a-481ecb36bd78"). InnerVolumeSpecName "kube-api-access-jjzvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:27:39.499843 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.499824 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-util" (OuterVolumeSpecName: "util") pod "1eab1b0a-3932-4d31-bd0a-481ecb36bd78" (UID: "1eab1b0a-3932-4d31-bd0a-481ecb36bd78"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:27:39.596811 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.596751 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjzvj\" (UniqueName: \"kubernetes.io/projected/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-kube-api-access-jjzvj\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:27:39.596811 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.596774 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:27:39.596811 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:39.596784 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eab1b0a-3932-4d31-bd0a-481ecb36bd78-util\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:27:40.290644 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:40.290608 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" Jun 11 21:27:40.290644 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:40.290626 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6s8nc" event={"ID":"1eab1b0a-3932-4d31-bd0a-481ecb36bd78","Type":"ContainerDied","Data":"23d292edc58eb9c08fcd5c5cd95d30f5c25b5d1c5ec9ef3cb7e90e631d233924"} Jun 11 21:27:40.291100 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:40.290707 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23d292edc58eb9c08fcd5c5cd95d30f5c25b5d1c5ec9ef3cb7e90e631d233924" Jun 11 21:27:40.706945 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:40.706912 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07cd3632-2741-42c0-9391-103078608836" path="/var/lib/kubelet/pods/07cd3632-2741-42c0-9391-103078608836/volumes" Jun 11 21:27:45.887601 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.887566 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vlzk6"] Jun 11 21:27:45.888025 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.887866 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eab1b0a-3932-4d31-bd0a-481ecb36bd78" containerName="pull" Jun 11 21:27:45.888025 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.887877 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eab1b0a-3932-4d31-bd0a-481ecb36bd78" containerName="pull" Jun 11 21:27:45.888025 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.887885 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07cd3632-2741-42c0-9391-103078608836" containerName="console" Jun 11 21:27:45.888025 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.887891 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="07cd3632-2741-42c0-9391-103078608836" containerName="console" Jun 11 21:27:45.888025 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.887896 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eab1b0a-3932-4d31-bd0a-481ecb36bd78" containerName="util" Jun 11 21:27:45.888025 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.887902 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eab1b0a-3932-4d31-bd0a-481ecb36bd78" containerName="util" Jun 11 21:27:45.888025 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.887918 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eab1b0a-3932-4d31-bd0a-481ecb36bd78" containerName="extract" Jun 11 21:27:45.888025 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.887923 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eab1b0a-3932-4d31-bd0a-481ecb36bd78" containerName="extract" Jun 11 21:27:45.888354 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.888090 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eab1b0a-3932-4d31-bd0a-481ecb36bd78" containerName="extract" Jun 11 21:27:45.888354 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.888104 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="07cd3632-2741-42c0-9391-103078608836" containerName="console" Jun 11 21:27:45.896410 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.896387 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vlzk6" Jun 11 21:27:45.898878 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.898856 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:27:45.898999 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.898938 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rxs4c\"" Jun 11 21:27:45.899041 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.899001 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 21:27:45.902709 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:45.902689 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vlzk6"] Jun 11 21:27:46.046676 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:46.046643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8d967f2-2095-4f12-8386-eb09037a6dd2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vlzk6\" (UID: \"c8d967f2-2095-4f12-8386-eb09037a6dd2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vlzk6" Jun 11 21:27:46.046871 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:46.046772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpjb9\" (UniqueName: \"kubernetes.io/projected/c8d967f2-2095-4f12-8386-eb09037a6dd2-kube-api-access-kpjb9\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vlzk6\" (UID: \"c8d967f2-2095-4f12-8386-eb09037a6dd2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vlzk6" Jun 11 21:27:46.147147 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:46.147075 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpjb9\" (UniqueName: \"kubernetes.io/projected/c8d967f2-2095-4f12-8386-eb09037a6dd2-kube-api-access-kpjb9\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vlzk6\" (UID: \"c8d967f2-2095-4f12-8386-eb09037a6dd2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vlzk6" Jun 11 21:27:46.147147 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:46.147112 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8d967f2-2095-4f12-8386-eb09037a6dd2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vlzk6\" (UID: \"c8d967f2-2095-4f12-8386-eb09037a6dd2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vlzk6" Jun 11 21:27:46.147473 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:46.147457 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8d967f2-2095-4f12-8386-eb09037a6dd2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vlzk6\" (UID: \"c8d967f2-2095-4f12-8386-eb09037a6dd2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vlzk6" Jun 11 21:27:46.155069 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:46.155045 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpjb9\" (UniqueName: \"kubernetes.io/projected/c8d967f2-2095-4f12-8386-eb09037a6dd2-kube-api-access-kpjb9\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vlzk6\" (UID: \"c8d967f2-2095-4f12-8386-eb09037a6dd2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vlzk6" Jun 11 21:27:46.206953 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:46.206930 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vlzk6" Jun 11 21:27:46.341263 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:46.341231 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vlzk6"] Jun 11 21:27:46.345622 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:27:46.345593 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d967f2_2095_4f12_8386_eb09037a6dd2.slice/crio-b94c62a89b55b9bc1ce8af138b15ab7ebf0a66b9780a7cbf63d69ead2ebc13c1 WatchSource:0}: Error finding container b94c62a89b55b9bc1ce8af138b15ab7ebf0a66b9780a7cbf63d69ead2ebc13c1: Status 404 returned error can't find the container with id b94c62a89b55b9bc1ce8af138b15ab7ebf0a66b9780a7cbf63d69ead2ebc13c1 Jun 11 21:27:47.321157 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:47.321126 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vlzk6" event={"ID":"c8d967f2-2095-4f12-8386-eb09037a6dd2","Type":"ContainerStarted","Data":"b94c62a89b55b9bc1ce8af138b15ab7ebf0a66b9780a7cbf63d69ead2ebc13c1"} Jun 11 21:27:55.358194 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:55.358153 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vlzk6" event={"ID":"c8d967f2-2095-4f12-8386-eb09037a6dd2","Type":"ContainerStarted","Data":"e0a74bc410da3eaec0d03257b455a136a0238524ce065eb28dffda2fe9a9f153"} Jun 11 21:27:55.406073 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:55.406022 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vlzk6" podStartSLOduration=2.081170496 podStartE2EDuration="10.40600598s" totalImagesPullingTime="8.324835484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:27:55.404418466 +0000 UTC m=+447.178358416" watchObservedRunningTime="2026-06-11 21:27:55.40600598 +0000 UTC m=+447.179945964" Jun 11 21:27:57.357241 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:57.357207 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-85zzk"] Jun 11 21:27:57.360778 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:57.360757 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-85zzk" Jun 11 21:27:57.363094 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:57.363067 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mw462\"" Jun 11 21:27:57.363094 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:57.363088 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 21:27:57.364027 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:57.364008 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 21:27:57.377699 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:57.377680 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-85zzk"] Jun 11 21:27:57.434665 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:57.434628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnc6w\" (UniqueName: \"kubernetes.io/projected/d68e47c5-90cf-4523-a487-bea50ec65f81-kube-api-access-wnc6w\") pod \"cert-manager-webhook-7dc76cbb94-85zzk\" (UID: \"d68e47c5-90cf-4523-a487-bea50ec65f81\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-85zzk" Jun 11 21:27:57.434806 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:57.434684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d68e47c5-90cf-4523-a487-bea50ec65f81-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-85zzk\" (UID: \"d68e47c5-90cf-4523-a487-bea50ec65f81\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-85zzk" Jun 11 21:27:57.535988 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:57.535953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnc6w\" (UniqueName: \"kubernetes.io/projected/d68e47c5-90cf-4523-a487-bea50ec65f81-kube-api-access-wnc6w\") pod \"cert-manager-webhook-7dc76cbb94-85zzk\" (UID: \"d68e47c5-90cf-4523-a487-bea50ec65f81\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-85zzk" Jun 11 21:27:57.536163 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:57.536003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d68e47c5-90cf-4523-a487-bea50ec65f81-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-85zzk\" (UID: \"d68e47c5-90cf-4523-a487-bea50ec65f81\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-85zzk" Jun 11 21:27:57.543946 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:57.543923 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d68e47c5-90cf-4523-a487-bea50ec65f81-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-85zzk\" (UID: \"d68e47c5-90cf-4523-a487-bea50ec65f81\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-85zzk" Jun 11 21:27:57.544161 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:57.544141 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnc6w\" (UniqueName: \"kubernetes.io/projected/d68e47c5-90cf-4523-a487-bea50ec65f81-kube-api-access-wnc6w\") pod \"cert-manager-webhook-7dc76cbb94-85zzk\" (UID: \"d68e47c5-90cf-4523-a487-bea50ec65f81\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-85zzk" Jun 11 21:27:57.679253 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:57.679201 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-85zzk" Jun 11 21:27:57.810663 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:57.810622 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-85zzk"] Jun 11 21:27:57.813951 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:27:57.813921 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd68e47c5_90cf_4523_a487_bea50ec65f81.slice/crio-10328c9f88399ec2a054efdb0df89492241b70eb66cb5d20fac0149ed268fbc9 WatchSource:0}: Error finding container 10328c9f88399ec2a054efdb0df89492241b70eb66cb5d20fac0149ed268fbc9: Status 404 returned error can't find the container with id 10328c9f88399ec2a054efdb0df89492241b70eb66cb5d20fac0149ed268fbc9 Jun 11 21:27:58.373441 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:27:58.373390 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-85zzk" event={"ID":"d68e47c5-90cf-4523-a487-bea50ec65f81","Type":"ContainerStarted","Data":"10328c9f88399ec2a054efdb0df89492241b70eb66cb5d20fac0149ed268fbc9"} Jun 11 21:28:01.388958 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:01.388917 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-85zzk" event={"ID":"d68e47c5-90cf-4523-a487-bea50ec65f81","Type":"ContainerStarted","Data":"0bf753f7911f058ee0a72443c1234773c11485f4d84dc148c91094977c6ddd14"} Jun 11 21:28:01.389327 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:01.389084 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-85zzk" Jun 11 21:28:01.405822 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:01.405778 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-85zzk" podStartSLOduration=1.380541843 podStartE2EDuration="4.40576557s" totalImagesPullingTime="3.025223727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:28:01.40505219 +0000 UTC m=+453.178992146" watchObservedRunningTime="2026-06-11 21:28:01.40576557 +0000 UTC m=+453.179705525" Jun 11 21:28:02.805885 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.805853 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj"] Jun 11 21:28:02.814936 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.814904 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" Jun 11 21:28:02.816340 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.816304 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj"] Jun 11 21:28:02.817194 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.817170 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:28:02.817315 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.817199 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rw9rw\"" Jun 11 21:28:02.818060 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.818040 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:28:02.879787 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.879752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daef3eff-95b0-434a-bf94-f94496896a20-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj\" (UID: \"daef3eff-95b0-434a-bf94-f94496896a20\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" Jun 11 21:28:02.879946 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.879813 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daef3eff-95b0-434a-bf94-f94496896a20-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj\" (UID: \"daef3eff-95b0-434a-bf94-f94496896a20\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" Jun 11 21:28:02.879946 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.879853 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6xkf\" (UniqueName: \"kubernetes.io/projected/daef3eff-95b0-434a-bf94-f94496896a20-kube-api-access-s6xkf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj\" (UID: \"daef3eff-95b0-434a-bf94-f94496896a20\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" Jun 11 21:28:02.980292 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.980255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daef3eff-95b0-434a-bf94-f94496896a20-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj\" (UID: \"daef3eff-95b0-434a-bf94-f94496896a20\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" Jun 11 21:28:02.980467 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.980320 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daef3eff-95b0-434a-bf94-f94496896a20-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj\" (UID: \"daef3eff-95b0-434a-bf94-f94496896a20\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" Jun 11 21:28:02.980467 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.980360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6xkf\" (UniqueName: \"kubernetes.io/projected/daef3eff-95b0-434a-bf94-f94496896a20-kube-api-access-s6xkf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj\" (UID: \"daef3eff-95b0-434a-bf94-f94496896a20\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" Jun 11 21:28:02.980672 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.980655 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daef3eff-95b0-434a-bf94-f94496896a20-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj\" (UID: \"daef3eff-95b0-434a-bf94-f94496896a20\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" Jun 11 21:28:02.980729 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.980677 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daef3eff-95b0-434a-bf94-f94496896a20-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj\" (UID: \"daef3eff-95b0-434a-bf94-f94496896a20\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" Jun 11 21:28:02.988040 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:02.988023 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6xkf\" (UniqueName: \"kubernetes.io/projected/daef3eff-95b0-434a-bf94-f94496896a20-kube-api-access-s6xkf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj\" (UID: \"daef3eff-95b0-434a-bf94-f94496896a20\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" Jun 11 21:28:03.125159 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:03.125130 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" Jun 11 21:28:03.254249 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:03.254223 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj"] Jun 11 21:28:03.256499 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:28:03.256461 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaef3eff_95b0_434a_bf94_f94496896a20.slice/crio-78c1e554d4f18ee8c553c5c38c1ed73cc4ef116e877f0bd31d34a83f72cbaa98 WatchSource:0}: Error finding container 78c1e554d4f18ee8c553c5c38c1ed73cc4ef116e877f0bd31d34a83f72cbaa98: Status 404 returned error can't find the container with id 78c1e554d4f18ee8c553c5c38c1ed73cc4ef116e877f0bd31d34a83f72cbaa98 Jun 11 21:28:03.399934 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:03.399841 2581 generic.go:356] "Generic (PLEG): container finished" podID="daef3eff-95b0-434a-bf94-f94496896a20" containerID="5fef0db141e6ac5b4bba65425238004c8d4d9961b3cdfbe232153321e1a58e1c" exitCode=0 Jun 11 21:28:03.399934 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:03.399900 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" event={"ID":"daef3eff-95b0-434a-bf94-f94496896a20","Type":"ContainerDied","Data":"5fef0db141e6ac5b4bba65425238004c8d4d9961b3cdfbe232153321e1a58e1c"} Jun 11 21:28:03.399934 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:03.399935 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" event={"ID":"daef3eff-95b0-434a-bf94-f94496896a20","Type":"ContainerStarted","Data":"78c1e554d4f18ee8c553c5c38c1ed73cc4ef116e877f0bd31d34a83f72cbaa98"} Jun 11 21:28:07.396387 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:07.396353 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-85zzk" Jun 11 21:28:10.166388 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:10.166348 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-lmqcn"] Jun 11 21:28:10.176508 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:10.176480 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-lmqcn" Jun 11 21:28:10.177694 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:10.177669 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-lmqcn"] Jun 11 21:28:10.178937 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:10.178908 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kmjjg\"" Jun 11 21:28:10.242939 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:10.242908 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v6cf\" (UniqueName: \"kubernetes.io/projected/8f1a8966-5393-4658-9c0b-78f2f0262896-kube-api-access-7v6cf\") pod \"cert-manager-59c77684cc-lmqcn\" (UID: \"8f1a8966-5393-4658-9c0b-78f2f0262896\") " pod="cert-manager/cert-manager-59c77684cc-lmqcn" Jun 11 21:28:10.243091 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:10.242999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f1a8966-5393-4658-9c0b-78f2f0262896-bound-sa-token\") pod \"cert-manager-59c77684cc-lmqcn\" (UID: \"8f1a8966-5393-4658-9c0b-78f2f0262896\") " pod="cert-manager/cert-manager-59c77684cc-lmqcn" Jun 11 21:28:10.343794 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:10.343764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f1a8966-5393-4658-9c0b-78f2f0262896-bound-sa-token\") pod \"cert-manager-59c77684cc-lmqcn\" (UID: \"8f1a8966-5393-4658-9c0b-78f2f0262896\") " pod="cert-manager/cert-manager-59c77684cc-lmqcn" Jun 11 21:28:10.343948 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:10.343860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v6cf\" (UniqueName: \"kubernetes.io/projected/8f1a8966-5393-4658-9c0b-78f2f0262896-kube-api-access-7v6cf\") pod \"cert-manager-59c77684cc-lmqcn\" (UID: \"8f1a8966-5393-4658-9c0b-78f2f0262896\") " pod="cert-manager/cert-manager-59c77684cc-lmqcn" Jun 11 21:28:10.352135 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:10.352107 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v6cf\" (UniqueName: \"kubernetes.io/projected/8f1a8966-5393-4658-9c0b-78f2f0262896-kube-api-access-7v6cf\") pod \"cert-manager-59c77684cc-lmqcn\" (UID: \"8f1a8966-5393-4658-9c0b-78f2f0262896\") " pod="cert-manager/cert-manager-59c77684cc-lmqcn" Jun 11 21:28:10.352495 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:10.352474 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f1a8966-5393-4658-9c0b-78f2f0262896-bound-sa-token\") pod \"cert-manager-59c77684cc-lmqcn\" (UID: \"8f1a8966-5393-4658-9c0b-78f2f0262896\") " pod="cert-manager/cert-manager-59c77684cc-lmqcn" Jun 11 21:28:10.486166 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:10.486094 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-lmqcn" Jun 11 21:28:10.627497 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:10.627468 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-lmqcn"] Jun 11 21:28:10.629611 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:28:10.629587 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f1a8966_5393_4658_9c0b_78f2f0262896.slice/crio-7b28e6f8e834df892a731b6f41660aa5723d1030c102a2957123a908770bcb1f WatchSource:0}: Error finding container 7b28e6f8e834df892a731b6f41660aa5723d1030c102a2957123a908770bcb1f: Status 404 returned error can't find the container with id 7b28e6f8e834df892a731b6f41660aa5723d1030c102a2957123a908770bcb1f Jun 11 21:28:11.435255 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:11.435216 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-lmqcn" event={"ID":"8f1a8966-5393-4658-9c0b-78f2f0262896","Type":"ContainerStarted","Data":"4d10562a26656cebd1cae83c55ac5c879017c36fdf4c01ac0426d0b97df10b7b"} Jun 11 21:28:11.435255 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:11.435264 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-lmqcn" event={"ID":"8f1a8966-5393-4658-9c0b-78f2f0262896","Type":"ContainerStarted","Data":"7b28e6f8e834df892a731b6f41660aa5723d1030c102a2957123a908770bcb1f"} Jun 11 21:28:11.452009 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:11.451962 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-lmqcn" podStartSLOduration=1.451947069 podStartE2EDuration="1.451947069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:28:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:28:11.450397435 +0000 UTC m=+463.224337421" watchObservedRunningTime="2026-06-11 21:28:11.451947069 +0000 UTC m=+463.225887025" Jun 11 21:28:29.515814 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:29.515776 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" event={"ID":"daef3eff-95b0-434a-bf94-f94496896a20","Type":"ContainerStarted","Data":"6b80f6ba8ed88b2febea4fbef10b835b4fcef438c3c0d6d7e0fd9ba970cb91cd"} Jun 11 21:28:30.522112 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:30.522079 2581 generic.go:356] "Generic (PLEG): container finished" podID="daef3eff-95b0-434a-bf94-f94496896a20" containerID="6b80f6ba8ed88b2febea4fbef10b835b4fcef438c3c0d6d7e0fd9ba970cb91cd" exitCode=0 Jun 11 21:28:30.522521 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:30.522166 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" event={"ID":"daef3eff-95b0-434a-bf94-f94496896a20","Type":"ContainerDied","Data":"6b80f6ba8ed88b2febea4fbef10b835b4fcef438c3c0d6d7e0fd9ba970cb91cd"} Jun 11 21:28:31.529031 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:31.528994 2581 generic.go:356] "Generic (PLEG): container finished" podID="daef3eff-95b0-434a-bf94-f94496896a20" containerID="938cfd8554dbfdec50953ba3d92e987c0f77f38039e91785b16308ae6f9bb805" exitCode=0 Jun 11 21:28:31.529435 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:31.529075 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" event={"ID":"daef3eff-95b0-434a-bf94-f94496896a20","Type":"ContainerDied","Data":"938cfd8554dbfdec50953ba3d92e987c0f77f38039e91785b16308ae6f9bb805"} Jun 11 21:28:32.658391 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:32.658365 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" Jun 11 21:28:32.728453 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:32.728427 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6xkf\" (UniqueName: \"kubernetes.io/projected/daef3eff-95b0-434a-bf94-f94496896a20-kube-api-access-s6xkf\") pod \"daef3eff-95b0-434a-bf94-f94496896a20\" (UID: \"daef3eff-95b0-434a-bf94-f94496896a20\") " Jun 11 21:28:32.728609 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:32.728472 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daef3eff-95b0-434a-bf94-f94496896a20-bundle\") pod \"daef3eff-95b0-434a-bf94-f94496896a20\" (UID: \"daef3eff-95b0-434a-bf94-f94496896a20\") " Jun 11 21:28:32.728609 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:32.728547 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daef3eff-95b0-434a-bf94-f94496896a20-util\") pod \"daef3eff-95b0-434a-bf94-f94496896a20\" (UID: \"daef3eff-95b0-434a-bf94-f94496896a20\") " Jun 11 21:28:32.728895 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:32.728872 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daef3eff-95b0-434a-bf94-f94496896a20-bundle" (OuterVolumeSpecName: "bundle") pod "daef3eff-95b0-434a-bf94-f94496896a20" (UID: "daef3eff-95b0-434a-bf94-f94496896a20"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:28:32.730421 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:32.730379 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daef3eff-95b0-434a-bf94-f94496896a20-kube-api-access-s6xkf" (OuterVolumeSpecName: "kube-api-access-s6xkf") pod "daef3eff-95b0-434a-bf94-f94496896a20" (UID: "daef3eff-95b0-434a-bf94-f94496896a20"). InnerVolumeSpecName "kube-api-access-s6xkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:28:32.732958 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:32.732934 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daef3eff-95b0-434a-bf94-f94496896a20-util" (OuterVolumeSpecName: "util") pod "daef3eff-95b0-434a-bf94-f94496896a20" (UID: "daef3eff-95b0-434a-bf94-f94496896a20"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:28:32.829466 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:32.829368 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daef3eff-95b0-434a-bf94-f94496896a20-util\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:28:32.829466 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:32.829425 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6xkf\" (UniqueName: \"kubernetes.io/projected/daef3eff-95b0-434a-bf94-f94496896a20-kube-api-access-s6xkf\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:28:32.829466 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:32.829436 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daef3eff-95b0-434a-bf94-f94496896a20-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:28:33.539097 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:33.539068 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" Jun 11 21:28:33.539097 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:33.539088 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqn2lj" event={"ID":"daef3eff-95b0-434a-bf94-f94496896a20","Type":"ContainerDied","Data":"78c1e554d4f18ee8c553c5c38c1ed73cc4ef116e877f0bd31d34a83f72cbaa98"} Jun 11 21:28:33.539295 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:33.539131 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78c1e554d4f18ee8c553c5c38c1ed73cc4ef116e877f0bd31d34a83f72cbaa98" Jun 11 21:28:46.296345 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.296312 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l"] Jun 11 21:28:46.296748 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.296658 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daef3eff-95b0-434a-bf94-f94496896a20" containerName="pull" Jun 11 21:28:46.296748 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.296670 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="daef3eff-95b0-434a-bf94-f94496896a20" containerName="pull" Jun 11 21:28:46.296748 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.296684 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daef3eff-95b0-434a-bf94-f94496896a20" containerName="util" Jun 11 21:28:46.296748 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.296689 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="daef3eff-95b0-434a-bf94-f94496896a20" containerName="util" Jun 11 21:28:46.296748 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.296706 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daef3eff-95b0-434a-bf94-f94496896a20" containerName="extract" Jun 11 21:28:46.296748 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.296712 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="daef3eff-95b0-434a-bf94-f94496896a20" containerName="extract" Jun 11 21:28:46.296938 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.296776 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="daef3eff-95b0-434a-bf94-f94496896a20" containerName="extract" Jun 11 21:28:46.299985 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.299969 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" Jun 11 21:28:46.302190 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.302159 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:28:46.302353 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.302335 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:28:46.303038 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.303024 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rw9rw\"" Jun 11 21:28:46.307074 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.306955 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l"] Jun 11 21:28:46.440816 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.440778 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgttx\" (UniqueName: \"kubernetes.io/projected/3d6019e3-9b87-4504-961e-12165a2e761d-kube-api-access-rgttx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l\" (UID: \"3d6019e3-9b87-4504-961e-12165a2e761d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" Jun 11 21:28:46.440971 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.440822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d6019e3-9b87-4504-961e-12165a2e761d-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l\" (UID: \"3d6019e3-9b87-4504-961e-12165a2e761d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" Jun 11 21:28:46.440971 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.440843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d6019e3-9b87-4504-961e-12165a2e761d-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l\" (UID: \"3d6019e3-9b87-4504-961e-12165a2e761d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" Jun 11 21:28:46.541825 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.541778 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgttx\" (UniqueName: \"kubernetes.io/projected/3d6019e3-9b87-4504-961e-12165a2e761d-kube-api-access-rgttx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l\" (UID: \"3d6019e3-9b87-4504-961e-12165a2e761d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" Jun 11 21:28:46.541825 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.541835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d6019e3-9b87-4504-961e-12165a2e761d-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l\" (UID: \"3d6019e3-9b87-4504-961e-12165a2e761d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" Jun 11 21:28:46.542031 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.541855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d6019e3-9b87-4504-961e-12165a2e761d-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l\" (UID: \"3d6019e3-9b87-4504-961e-12165a2e761d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" Jun 11 21:28:46.542227 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.542206 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d6019e3-9b87-4504-961e-12165a2e761d-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l\" (UID: \"3d6019e3-9b87-4504-961e-12165a2e761d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" Jun 11 21:28:46.542264 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.542232 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d6019e3-9b87-4504-961e-12165a2e761d-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l\" (UID: \"3d6019e3-9b87-4504-961e-12165a2e761d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" Jun 11 21:28:46.549599 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.549546 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgttx\" (UniqueName: \"kubernetes.io/projected/3d6019e3-9b87-4504-961e-12165a2e761d-kube-api-access-rgttx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l\" (UID: \"3d6019e3-9b87-4504-961e-12165a2e761d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" Jun 11 21:28:46.609343 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.609314 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" Jun 11 21:28:46.737640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:46.737618 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l"] Jun 11 21:28:46.740082 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:28:46.740056 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6019e3_9b87_4504_961e_12165a2e761d.slice/crio-27cfcaadb9716b40d211851a2494d20dae115a0e96737d582e7e949c0157aa84 WatchSource:0}: Error finding container 27cfcaadb9716b40d211851a2494d20dae115a0e96737d582e7e949c0157aa84: Status 404 returned error can't find the container with id 27cfcaadb9716b40d211851a2494d20dae115a0e96737d582e7e949c0157aa84 Jun 11 21:28:47.602266 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:47.602225 2581 generic.go:356] "Generic (PLEG): container finished" podID="3d6019e3-9b87-4504-961e-12165a2e761d" containerID="61797a89c22165440e7105ec7aa8e0e548c3017c1f476a20b905bdbdccfa433c" exitCode=0 Jun 11 21:28:47.602600 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:47.602307 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" event={"ID":"3d6019e3-9b87-4504-961e-12165a2e761d","Type":"ContainerDied","Data":"61797a89c22165440e7105ec7aa8e0e548c3017c1f476a20b905bdbdccfa433c"} Jun 11 21:28:47.602600 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:47.602354 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" event={"ID":"3d6019e3-9b87-4504-961e-12165a2e761d","Type":"ContainerStarted","Data":"27cfcaadb9716b40d211851a2494d20dae115a0e96737d582e7e949c0157aa84"} Jun 11 21:28:48.608158 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:48.608077 2581 generic.go:356] "Generic (PLEG): container finished" podID="3d6019e3-9b87-4504-961e-12165a2e761d" containerID="5e8e32e4a02b028ca1149f19b196427b2eeb7f624d2a8b6113a2ad43380d2e7c" exitCode=0 Jun 11 21:28:48.608614 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:48.608160 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" event={"ID":"3d6019e3-9b87-4504-961e-12165a2e761d","Type":"ContainerDied","Data":"5e8e32e4a02b028ca1149f19b196427b2eeb7f624d2a8b6113a2ad43380d2e7c"} Jun 11 21:28:49.614447 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:49.614389 2581 generic.go:356] "Generic (PLEG): container finished" podID="3d6019e3-9b87-4504-961e-12165a2e761d" containerID="dde09d274b7b0ca5818066829d9c2dfd24768bf20e9579f7015cb65b99963e63" exitCode=0 Jun 11 21:28:49.614841 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:49.614445 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" event={"ID":"3d6019e3-9b87-4504-961e-12165a2e761d","Type":"ContainerDied","Data":"dde09d274b7b0ca5818066829d9c2dfd24768bf20e9579f7015cb65b99963e63"} Jun 11 21:28:50.636927 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.636900 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl"] Jun 11 21:28:50.644223 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.644198 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:50.647453 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.647391 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 21:28:50.647453 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.647446 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 21:28:50.647638 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.647468 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 21:28:50.647638 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.647492 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gtz27\"" Jun 11 21:28:50.647638 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.647532 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:28:50.647638 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.647591 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 21:28:50.653958 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.653930 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl"] Jun 11 21:28:50.763037 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.763012 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" Jun 11 21:28:50.780768 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.780743 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/707dc652-4859-4945-942e-42ddecadc248-cert\") pod \"lws-controller-manager-56b9fd76f8-lghkl\" (UID: \"707dc652-4859-4945-942e-42ddecadc248\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:50.780866 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.780808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/707dc652-4859-4945-942e-42ddecadc248-metrics-cert\") pod \"lws-controller-manager-56b9fd76f8-lghkl\" (UID: \"707dc652-4859-4945-942e-42ddecadc248\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:50.780866 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.780832 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2cpz\" (UniqueName: \"kubernetes.io/projected/707dc652-4859-4945-942e-42ddecadc248-kube-api-access-t2cpz\") pod \"lws-controller-manager-56b9fd76f8-lghkl\" (UID: \"707dc652-4859-4945-942e-42ddecadc248\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:50.780866 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.780857 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/707dc652-4859-4945-942e-42ddecadc248-manager-config\") pod \"lws-controller-manager-56b9fd76f8-lghkl\" (UID: \"707dc652-4859-4945-942e-42ddecadc248\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:50.881597 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.881571 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d6019e3-9b87-4504-961e-12165a2e761d-bundle\") pod \"3d6019e3-9b87-4504-961e-12165a2e761d\" (UID: \"3d6019e3-9b87-4504-961e-12165a2e761d\") " Jun 11 21:28:50.881724 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.881622 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d6019e3-9b87-4504-961e-12165a2e761d-util\") pod \"3d6019e3-9b87-4504-961e-12165a2e761d\" (UID: \"3d6019e3-9b87-4504-961e-12165a2e761d\") " Jun 11 21:28:50.881724 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.881662 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgttx\" (UniqueName: \"kubernetes.io/projected/3d6019e3-9b87-4504-961e-12165a2e761d-kube-api-access-rgttx\") pod \"3d6019e3-9b87-4504-961e-12165a2e761d\" (UID: \"3d6019e3-9b87-4504-961e-12165a2e761d\") " Jun 11 21:28:50.881798 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.881758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/707dc652-4859-4945-942e-42ddecadc248-cert\") pod \"lws-controller-manager-56b9fd76f8-lghkl\" (UID: \"707dc652-4859-4945-942e-42ddecadc248\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:50.881839 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.881821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/707dc652-4859-4945-942e-42ddecadc248-metrics-cert\") pod \"lws-controller-manager-56b9fd76f8-lghkl\" (UID: \"707dc652-4859-4945-942e-42ddecadc248\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:50.881876 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.881854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2cpz\" (UniqueName: \"kubernetes.io/projected/707dc652-4859-4945-942e-42ddecadc248-kube-api-access-t2cpz\") pod \"lws-controller-manager-56b9fd76f8-lghkl\" (UID: \"707dc652-4859-4945-942e-42ddecadc248\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:50.881925 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.881892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/707dc652-4859-4945-942e-42ddecadc248-manager-config\") pod \"lws-controller-manager-56b9fd76f8-lghkl\" (UID: \"707dc652-4859-4945-942e-42ddecadc248\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:50.882682 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.882653 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d6019e3-9b87-4504-961e-12165a2e761d-bundle" (OuterVolumeSpecName: "bundle") pod "3d6019e3-9b87-4504-961e-12165a2e761d" (UID: "3d6019e3-9b87-4504-961e-12165a2e761d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:28:50.882682 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.882668 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/707dc652-4859-4945-942e-42ddecadc248-manager-config\") pod \"lws-controller-manager-56b9fd76f8-lghkl\" (UID: \"707dc652-4859-4945-942e-42ddecadc248\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:50.884051 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.884028 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d6019e3-9b87-4504-961e-12165a2e761d-kube-api-access-rgttx" (OuterVolumeSpecName: "kube-api-access-rgttx") pod "3d6019e3-9b87-4504-961e-12165a2e761d" (UID: "3d6019e3-9b87-4504-961e-12165a2e761d"). InnerVolumeSpecName "kube-api-access-rgttx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:28:50.884387 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.884368 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/707dc652-4859-4945-942e-42ddecadc248-cert\") pod \"lws-controller-manager-56b9fd76f8-lghkl\" (UID: \"707dc652-4859-4945-942e-42ddecadc248\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:50.884474 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.884418 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/707dc652-4859-4945-942e-42ddecadc248-metrics-cert\") pod \"lws-controller-manager-56b9fd76f8-lghkl\" (UID: \"707dc652-4859-4945-942e-42ddecadc248\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:50.887539 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.887514 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d6019e3-9b87-4504-961e-12165a2e761d-util" (OuterVolumeSpecName: "util") pod "3d6019e3-9b87-4504-961e-12165a2e761d" (UID: "3d6019e3-9b87-4504-961e-12165a2e761d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:28:50.898560 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.898542 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2cpz\" (UniqueName: \"kubernetes.io/projected/707dc652-4859-4945-942e-42ddecadc248-kube-api-access-t2cpz\") pod \"lws-controller-manager-56b9fd76f8-lghkl\" (UID: \"707dc652-4859-4945-942e-42ddecadc248\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:50.956654 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.956619 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:50.983297 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.983267 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d6019e3-9b87-4504-961e-12165a2e761d-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:28:50.983297 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.983295 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d6019e3-9b87-4504-961e-12165a2e761d-util\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:28:50.983542 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:50.983311 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgttx\" (UniqueName: \"kubernetes.io/projected/3d6019e3-9b87-4504-961e-12165a2e761d-kube-api-access-rgttx\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:28:51.107092 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:51.107068 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl"] Jun 11 21:28:51.109157 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:28:51.109131 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707dc652_4859_4945_942e_42ddecadc248.slice/crio-84aa866f7c7742cc868835a4d23a2bc92b5d23a173b316d60a459c5aef2225e5 WatchSource:0}: Error finding container 84aa866f7c7742cc868835a4d23a2bc92b5d23a173b316d60a459c5aef2225e5: Status 404 returned error can't find the container with id 84aa866f7c7742cc868835a4d23a2bc92b5d23a173b316d60a459c5aef2225e5 Jun 11 21:28:51.624818 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:51.624787 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" event={"ID":"707dc652-4859-4945-942e-42ddecadc248","Type":"ContainerStarted","Data":"84aa866f7c7742cc868835a4d23a2bc92b5d23a173b316d60a459c5aef2225e5"} Jun 11 21:28:51.626488 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:51.626465 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" event={"ID":"3d6019e3-9b87-4504-961e-12165a2e761d","Type":"ContainerDied","Data":"27cfcaadb9716b40d211851a2494d20dae115a0e96737d582e7e949c0157aa84"} Jun 11 21:28:51.626591 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:51.626501 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27cfcaadb9716b40d211851a2494d20dae115a0e96737d582e7e949c0157aa84" Jun 11 21:28:51.626591 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:51.626508 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdh8h6l" Jun 11 21:28:53.638851 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:53.638817 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" event={"ID":"707dc652-4859-4945-942e-42ddecadc248","Type":"ContainerStarted","Data":"460eb248ec60df0e35bb9ee3e6c0cda7c29b453e6b1cc7644bef1bcf2bfc6aea"} Jun 11 21:28:53.639295 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:53.638927 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:28:53.655035 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:28:53.654994 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" podStartSLOduration=1.502113097 podStartE2EDuration="3.65498068s" totalImagesPullingTime="2.152867583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:28:53.654283241 +0000 UTC m=+505.428223222" watchObservedRunningTime="2026-06-11 21:28:53.65498068 +0000 UTC m=+505.428920636" Jun 11 21:29:03.472914 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.472872 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj"] Jun 11 21:29:03.473379 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.473231 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d6019e3-9b87-4504-961e-12165a2e761d" containerName="extract" Jun 11 21:29:03.473379 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.473244 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6019e3-9b87-4504-961e-12165a2e761d" containerName="extract" Jun 11 21:29:03.473379 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.473258 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d6019e3-9b87-4504-961e-12165a2e761d" containerName="pull" Jun 11 21:29:03.473379 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.473263 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6019e3-9b87-4504-961e-12165a2e761d" containerName="pull" Jun 11 21:29:03.473379 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.473284 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d6019e3-9b87-4504-961e-12165a2e761d" containerName="util" Jun 11 21:29:03.473379 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.473290 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6019e3-9b87-4504-961e-12165a2e761d" containerName="util" Jun 11 21:29:03.473593 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.473396 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d6019e3-9b87-4504-961e-12165a2e761d" containerName="extract" Jun 11 21:29:03.479944 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.479925 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.482457 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.482426 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 21:29:03.482563 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.482512 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 21:29:03.482767 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.482747 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 21:29:03.482886 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.482778 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 21:29:03.482886 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.482754 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qrt99\"" Jun 11 21:29:03.491072 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.491051 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj"] Jun 11 21:29:03.491543 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.491526 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-tmp\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.491599 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.491550 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz8m2\" (UniqueName: \"kubernetes.io/projected/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-kube-api-access-zz8m2\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.491637 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.491606 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-webhook-cert\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.491637 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.491633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.491701 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.491664 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-manifests\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.592877 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.592841 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-webhook-cert\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.593068 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.592891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.593068 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.592929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-manifests\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.593068 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.592970 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-tmp\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.593068 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.592992 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz8m2\" (UniqueName: \"kubernetes.io/projected/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-kube-api-access-zz8m2\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.593424 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.593369 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-manifests\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.595278 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.595255 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-tmp\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.595378 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.595335 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.595459 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.595447 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-webhook-cert\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.603446 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.603423 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz8m2\" (UniqueName: \"kubernetes.io/projected/6fa9368c-aacd-4ccd-b7f5-c156d3a53239-kube-api-access-zz8m2\") pod \"opendatahub-operator-controller-manager-75f49467f8-jg7lj\" (UID: \"6fa9368c-aacd-4ccd-b7f5-c156d3a53239\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.792330 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.792253 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:03.929060 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:03.929037 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj"] Jun 11 21:29:03.931387 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:29:03.931355 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa9368c_aacd_4ccd_b7f5_c156d3a53239.slice/crio-c8699f9dea49da0f36e0addfa019212dc40afa62c96368ddc6533adcd078e832 WatchSource:0}: Error finding container c8699f9dea49da0f36e0addfa019212dc40afa62c96368ddc6533adcd078e832: Status 404 returned error can't find the container with id c8699f9dea49da0f36e0addfa019212dc40afa62c96368ddc6533adcd078e832 Jun 11 21:29:04.647503 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:04.647468 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lghkl" Jun 11 21:29:04.696345 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:04.696304 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" event={"ID":"6fa9368c-aacd-4ccd-b7f5-c156d3a53239","Type":"ContainerStarted","Data":"c8699f9dea49da0f36e0addfa019212dc40afa62c96368ddc6533adcd078e832"} Jun 11 21:29:07.714391 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:07.714353 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" event={"ID":"6fa9368c-aacd-4ccd-b7f5-c156d3a53239","Type":"ContainerStarted","Data":"e57d4c5b48551c28eae6fee3899d34401693312e2d7373600c144e0e8bb0f2de"} Jun 11 21:29:08.720293 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:08.720259 2581 generic.go:356] "Generic (PLEG): container finished" podID="6fa9368c-aacd-4ccd-b7f5-c156d3a53239" containerID="e57d4c5b48551c28eae6fee3899d34401693312e2d7373600c144e0e8bb0f2de" exitCode=0 Jun 11 21:29:08.720695 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:08.720308 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" event={"ID":"6fa9368c-aacd-4ccd-b7f5-c156d3a53239","Type":"ContainerDied","Data":"e57d4c5b48551c28eae6fee3899d34401693312e2d7373600c144e0e8bb0f2de"} Jun 11 21:29:09.726483 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:09.726445 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" event={"ID":"6fa9368c-aacd-4ccd-b7f5-c156d3a53239","Type":"ContainerStarted","Data":"1d86836211190837ae5d2fd7ad833421803d13cc3a75fdd8ecf3c4681373a5a4"} Jun 11 21:29:09.726878 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:09.726505 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:09.749125 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:09.749075 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" podStartSLOduration=2.473656008 podStartE2EDuration="6.749061783s" totalImagesPullingTime="3.337049231s" totalInitContainerRuntime="938.356544ms" isStatefulPod=false podCreationTimestamp="2026-06-11 21:29:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:29:09.74789136 +0000 UTC m=+521.521831316" watchObservedRunningTime="2026-06-11 21:29:09.749061783 +0000 UTC m=+521.523001738" Jun 11 21:29:20.733466 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:20.733436 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-jg7lj" Jun 11 21:29:25.637911 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.637874 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6"] Jun 11 21:29:25.646481 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.646451 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" Jun 11 21:29:25.648489 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.648464 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6"] Jun 11 21:29:25.648863 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.648836 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:29:25.648960 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.648894 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rw9rw\"" Jun 11 21:29:25.649798 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.649775 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:29:25.786480 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.786450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjglq\" (UniqueName: \"kubernetes.io/projected/f2c349da-395c-4c81-bd96-4457e8a896a3-kube-api-access-kjglq\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6\" (UID: \"f2c349da-395c-4c81-bd96-4457e8a896a3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" Jun 11 21:29:25.786480 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.786493 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2c349da-395c-4c81-bd96-4457e8a896a3-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6\" (UID: \"f2c349da-395c-4c81-bd96-4457e8a896a3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" Jun 11 21:29:25.786714 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.786561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2c349da-395c-4c81-bd96-4457e8a896a3-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6\" (UID: \"f2c349da-395c-4c81-bd96-4457e8a896a3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" Jun 11 21:29:25.887688 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.887657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2c349da-395c-4c81-bd96-4457e8a896a3-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6\" (UID: \"f2c349da-395c-4c81-bd96-4457e8a896a3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" Jun 11 21:29:25.887849 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.887745 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjglq\" (UniqueName: \"kubernetes.io/projected/f2c349da-395c-4c81-bd96-4457e8a896a3-kube-api-access-kjglq\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6\" (UID: \"f2c349da-395c-4c81-bd96-4457e8a896a3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" Jun 11 21:29:25.887849 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.887781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2c349da-395c-4c81-bd96-4457e8a896a3-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6\" (UID: \"f2c349da-395c-4c81-bd96-4457e8a896a3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" Jun 11 21:29:25.888129 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.888084 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2c349da-395c-4c81-bd96-4457e8a896a3-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6\" (UID: \"f2c349da-395c-4c81-bd96-4457e8a896a3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" Jun 11 21:29:25.888129 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.888093 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2c349da-395c-4c81-bd96-4457e8a896a3-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6\" (UID: \"f2c349da-395c-4c81-bd96-4457e8a896a3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" Jun 11 21:29:25.894837 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.894808 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjglq\" (UniqueName: \"kubernetes.io/projected/f2c349da-395c-4c81-bd96-4457e8a896a3-kube-api-access-kjglq\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6\" (UID: \"f2c349da-395c-4c81-bd96-4457e8a896a3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" Jun 11 21:29:25.957773 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:25.957742 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" Jun 11 21:29:26.086985 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:26.086965 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6"] Jun 11 21:29:26.088833 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:29:26.088807 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c349da_395c_4c81_bd96_4457e8a896a3.slice/crio-c6ccae6730cd0b9e0780ca19095659ef1e2a9a0ea11e62dde2a9cfb9b99cfbf9 WatchSource:0}: Error finding container c6ccae6730cd0b9e0780ca19095659ef1e2a9a0ea11e62dde2a9cfb9b99cfbf9: Status 404 returned error can't find the container with id c6ccae6730cd0b9e0780ca19095659ef1e2a9a0ea11e62dde2a9cfb9b99cfbf9 Jun 11 21:29:26.813292 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:26.813260 2581 generic.go:356] "Generic (PLEG): container finished" podID="f2c349da-395c-4c81-bd96-4457e8a896a3" containerID="c567d0cb358d4b0ea91c2a0fdf7918f32cdec64e9a787c53362ee12b50148766" exitCode=0 Jun 11 21:29:26.813671 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:26.813298 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" event={"ID":"f2c349da-395c-4c81-bd96-4457e8a896a3","Type":"ContainerDied","Data":"c567d0cb358d4b0ea91c2a0fdf7918f32cdec64e9a787c53362ee12b50148766"} Jun 11 21:29:26.813671 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:26.813332 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" event={"ID":"f2c349da-395c-4c81-bd96-4457e8a896a3","Type":"ContainerStarted","Data":"c6ccae6730cd0b9e0780ca19095659ef1e2a9a0ea11e62dde2a9cfb9b99cfbf9"} Jun 11 21:29:27.820674 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:27.820589 2581 generic.go:356] "Generic (PLEG): container finished" podID="f2c349da-395c-4c81-bd96-4457e8a896a3" containerID="c647fc1696170f802ed533f93f765e10ad7d31f92d78dd179f2dc7da647b80c5" exitCode=0 Jun 11 21:29:27.820674 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:27.820632 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" event={"ID":"f2c349da-395c-4c81-bd96-4457e8a896a3","Type":"ContainerDied","Data":"c647fc1696170f802ed533f93f765e10ad7d31f92d78dd179f2dc7da647b80c5"} Jun 11 21:29:28.826504 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:28.826466 2581 generic.go:356] "Generic (PLEG): container finished" podID="f2c349da-395c-4c81-bd96-4457e8a896a3" containerID="4473251485b30107cee84d299eec5b85954c0bf9c84936aa0f607cee0d24d676" exitCode=0 Jun 11 21:29:28.826880 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:28.826528 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" event={"ID":"f2c349da-395c-4c81-bd96-4457e8a896a3","Type":"ContainerDied","Data":"4473251485b30107cee84d299eec5b85954c0bf9c84936aa0f607cee0d24d676"} Jun 11 21:29:29.973367 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:29.973336 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" Jun 11 21:29:30.124961 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:30.124928 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2c349da-395c-4c81-bd96-4457e8a896a3-util\") pod \"f2c349da-395c-4c81-bd96-4457e8a896a3\" (UID: \"f2c349da-395c-4c81-bd96-4457e8a896a3\") " Jun 11 21:29:30.125138 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:30.125039 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2c349da-395c-4c81-bd96-4457e8a896a3-bundle\") pod \"f2c349da-395c-4c81-bd96-4457e8a896a3\" (UID: \"f2c349da-395c-4c81-bd96-4457e8a896a3\") " Jun 11 21:29:30.125138 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:30.125130 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjglq\" (UniqueName: \"kubernetes.io/projected/f2c349da-395c-4c81-bd96-4457e8a896a3-kube-api-access-kjglq\") pod \"f2c349da-395c-4c81-bd96-4457e8a896a3\" (UID: \"f2c349da-395c-4c81-bd96-4457e8a896a3\") " Jun 11 21:29:30.126210 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:30.126176 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c349da-395c-4c81-bd96-4457e8a896a3-bundle" (OuterVolumeSpecName: "bundle") pod "f2c349da-395c-4c81-bd96-4457e8a896a3" (UID: "f2c349da-395c-4c81-bd96-4457e8a896a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:29:30.127380 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:30.127345 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c349da-395c-4c81-bd96-4457e8a896a3-kube-api-access-kjglq" (OuterVolumeSpecName: "kube-api-access-kjglq") pod "f2c349da-395c-4c81-bd96-4457e8a896a3" (UID: "f2c349da-395c-4c81-bd96-4457e8a896a3"). InnerVolumeSpecName "kube-api-access-kjglq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:29:30.130597 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:30.130571 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c349da-395c-4c81-bd96-4457e8a896a3-util" (OuterVolumeSpecName: "util") pod "f2c349da-395c-4c81-bd96-4457e8a896a3" (UID: "f2c349da-395c-4c81-bd96-4457e8a896a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:29:30.226747 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:30.226700 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2c349da-395c-4c81-bd96-4457e8a896a3-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:29:30.226747 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:30.226742 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjglq\" (UniqueName: \"kubernetes.io/projected/f2c349da-395c-4c81-bd96-4457e8a896a3-kube-api-access-kjglq\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:29:30.226747 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:30.226752 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2c349da-395c-4c81-bd96-4457e8a896a3-util\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:29:30.836900 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:30.836874 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" Jun 11 21:29:30.836900 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:30.836889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xq5j6" event={"ID":"f2c349da-395c-4c81-bd96-4457e8a896a3","Type":"ContainerDied","Data":"c6ccae6730cd0b9e0780ca19095659ef1e2a9a0ea11e62dde2a9cfb9b99cfbf9"} Jun 11 21:29:30.837081 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:30.836927 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6ccae6730cd0b9e0780ca19095659ef1e2a9a0ea11e62dde2a9cfb9b99cfbf9" Jun 11 21:29:36.269557 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.269523 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8"] Jun 11 21:29:36.270101 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.270031 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c349da-395c-4c81-bd96-4457e8a896a3" containerName="util" Jun 11 21:29:36.270101 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.270052 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c349da-395c-4c81-bd96-4457e8a896a3" containerName="util" Jun 11 21:29:36.270101 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.270065 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c349da-395c-4c81-bd96-4457e8a896a3" containerName="pull" Jun 11 21:29:36.270101 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.270074 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c349da-395c-4c81-bd96-4457e8a896a3" containerName="pull" Jun 11 21:29:36.270101 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.270094 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c349da-395c-4c81-bd96-4457e8a896a3" containerName="extract" Jun 11 21:29:36.270101 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.270102 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c349da-395c-4c81-bd96-4457e8a896a3" containerName="extract" Jun 11 21:29:36.270425 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.270207 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2c349da-395c-4c81-bd96-4457e8a896a3" containerName="extract" Jun 11 21:29:36.283259 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.283237 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" Jun 11 21:29:36.283914 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.283890 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8"] Jun 11 21:29:36.285962 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.285940 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rw9rw\"" Jun 11 21:29:36.286174 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.286155 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:29:36.286828 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.286809 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:29:36.375490 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.375452 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdgc9\" (UniqueName: \"kubernetes.io/projected/0b176b63-be3b-4035-9a3b-bba803b720a1-kube-api-access-jdgc9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8\" (UID: \"0b176b63-be3b-4035-9a3b-bba803b720a1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" Jun 11 21:29:36.375725 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.375700 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b176b63-be3b-4035-9a3b-bba803b720a1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8\" (UID: \"0b176b63-be3b-4035-9a3b-bba803b720a1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" Jun 11 21:29:36.375821 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.375739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b176b63-be3b-4035-9a3b-bba803b720a1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8\" (UID: \"0b176b63-be3b-4035-9a3b-bba803b720a1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" Jun 11 21:29:36.477216 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.477186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdgc9\" (UniqueName: \"kubernetes.io/projected/0b176b63-be3b-4035-9a3b-bba803b720a1-kube-api-access-jdgc9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8\" (UID: \"0b176b63-be3b-4035-9a3b-bba803b720a1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" Jun 11 21:29:36.477393 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.477270 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b176b63-be3b-4035-9a3b-bba803b720a1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8\" (UID: \"0b176b63-be3b-4035-9a3b-bba803b720a1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" Jun 11 21:29:36.477393 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.477289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b176b63-be3b-4035-9a3b-bba803b720a1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8\" (UID: \"0b176b63-be3b-4035-9a3b-bba803b720a1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" Jun 11 21:29:36.477662 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.477644 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b176b63-be3b-4035-9a3b-bba803b720a1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8\" (UID: \"0b176b63-be3b-4035-9a3b-bba803b720a1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" Jun 11 21:29:36.477733 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.477681 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b176b63-be3b-4035-9a3b-bba803b720a1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8\" (UID: \"0b176b63-be3b-4035-9a3b-bba803b720a1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" Jun 11 21:29:36.507783 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.507760 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdgc9\" (UniqueName: \"kubernetes.io/projected/0b176b63-be3b-4035-9a3b-bba803b720a1-kube-api-access-jdgc9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8\" (UID: \"0b176b63-be3b-4035-9a3b-bba803b720a1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" Jun 11 21:29:36.596361 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.596301 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" Jun 11 21:29:36.757553 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.757527 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8"] Jun 11 21:29:36.759492 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:29:36.759462 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b176b63_be3b_4035_9a3b_bba803b720a1.slice/crio-b3ab7dc939e52ec3cc8990a960d3c3cacf1c0f9aaf07cecab669da645b2bfc45 WatchSource:0}: Error finding container b3ab7dc939e52ec3cc8990a960d3c3cacf1c0f9aaf07cecab669da645b2bfc45: Status 404 returned error can't find the container with id b3ab7dc939e52ec3cc8990a960d3c3cacf1c0f9aaf07cecab669da645b2bfc45 Jun 11 21:29:36.868376 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:36.868305 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" event={"ID":"0b176b63-be3b-4035-9a3b-bba803b720a1","Type":"ContainerStarted","Data":"b3ab7dc939e52ec3cc8990a960d3c3cacf1c0f9aaf07cecab669da645b2bfc45"} Jun 11 21:29:37.874313 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:37.874278 2581 generic.go:356] "Generic (PLEG): container finished" podID="0b176b63-be3b-4035-9a3b-bba803b720a1" containerID="7a1d8904754c365774f46b9d95377026ad2fe2c53c213612f46d72b8f45271b7" exitCode=0 Jun 11 21:29:37.874696 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:37.874362 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" event={"ID":"0b176b63-be3b-4035-9a3b-bba803b720a1","Type":"ContainerDied","Data":"7a1d8904754c365774f46b9d95377026ad2fe2c53c213612f46d72b8f45271b7"} Jun 11 21:29:38.698183 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:38.698151 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5bc579744d-7pd22"] Jun 11 21:29:38.701430 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:38.701393 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5bc579744d-7pd22" Jun 11 21:29:38.706373 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:38.706352 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 21:29:38.706516 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:38.706481 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4wxgn\"" Jun 11 21:29:38.712047 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:38.712026 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5bc579744d-7pd22"] Jun 11 21:29:38.797837 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:38.797806 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgtqj\" (UniqueName: \"kubernetes.io/projected/dd016104-07f0-4664-856c-84725af31488-kube-api-access-xgtqj\") pod \"dashboard-redirect-5bc579744d-7pd22\" (UID: \"dd016104-07f0-4664-856c-84725af31488\") " pod="opendatahub/dashboard-redirect-5bc579744d-7pd22" Jun 11 21:29:38.797989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:38.797854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/dd016104-07f0-4664-856c-84725af31488-redirect-config\") pod \"dashboard-redirect-5bc579744d-7pd22\" (UID: \"dd016104-07f0-4664-856c-84725af31488\") " pod="opendatahub/dashboard-redirect-5bc579744d-7pd22" Jun 11 21:29:38.899105 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:38.899080 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/dd016104-07f0-4664-856c-84725af31488-redirect-config\") pod \"dashboard-redirect-5bc579744d-7pd22\" (UID: \"dd016104-07f0-4664-856c-84725af31488\") " pod="opendatahub/dashboard-redirect-5bc579744d-7pd22" Jun 11 21:29:38.899387 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:38.899154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgtqj\" (UniqueName: \"kubernetes.io/projected/dd016104-07f0-4664-856c-84725af31488-kube-api-access-xgtqj\") pod \"dashboard-redirect-5bc579744d-7pd22\" (UID: \"dd016104-07f0-4664-856c-84725af31488\") " pod="opendatahub/dashboard-redirect-5bc579744d-7pd22" Jun 11 21:29:38.899973 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:38.899948 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/dd016104-07f0-4664-856c-84725af31488-redirect-config\") pod \"dashboard-redirect-5bc579744d-7pd22\" (UID: \"dd016104-07f0-4664-856c-84725af31488\") " pod="opendatahub/dashboard-redirect-5bc579744d-7pd22" Jun 11 21:29:38.907283 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:38.907260 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgtqj\" (UniqueName: \"kubernetes.io/projected/dd016104-07f0-4664-856c-84725af31488-kube-api-access-xgtqj\") pod \"dashboard-redirect-5bc579744d-7pd22\" (UID: \"dd016104-07f0-4664-856c-84725af31488\") " pod="opendatahub/dashboard-redirect-5bc579744d-7pd22" Jun 11 21:29:39.014878 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:39.014846 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5bc579744d-7pd22" Jun 11 21:29:39.161235 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:39.161211 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5bc579744d-7pd22"] Jun 11 21:29:39.163152 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:29:39.163118 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd016104_07f0_4664_856c_84725af31488.slice/crio-bb645b8f8bfd514fcd0ff753dec18dfda6f4dea4b0e75debdb2faedbf0ec2788 WatchSource:0}: Error finding container bb645b8f8bfd514fcd0ff753dec18dfda6f4dea4b0e75debdb2faedbf0ec2788: Status 404 returned error can't find the container with id bb645b8f8bfd514fcd0ff753dec18dfda6f4dea4b0e75debdb2faedbf0ec2788 Jun 11 21:29:39.885187 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:39.885150 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5bc579744d-7pd22" event={"ID":"dd016104-07f0-4664-856c-84725af31488","Type":"ContainerStarted","Data":"bb645b8f8bfd514fcd0ff753dec18dfda6f4dea4b0e75debdb2faedbf0ec2788"} Jun 11 21:29:39.887159 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:39.887125 2581 generic.go:356] "Generic (PLEG): container finished" podID="0b176b63-be3b-4035-9a3b-bba803b720a1" containerID="925d3337c79269d8034fa9d9c27261ece2a76fa0fc5fa462c2849e07bbb4edfa" exitCode=0 Jun 11 21:29:39.887317 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:39.887209 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" event={"ID":"0b176b63-be3b-4035-9a3b-bba803b720a1","Type":"ContainerDied","Data":"925d3337c79269d8034fa9d9c27261ece2a76fa0fc5fa462c2849e07bbb4edfa"} Jun 11 21:29:40.896121 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:40.896090 2581 generic.go:356] "Generic (PLEG): container finished" podID="0b176b63-be3b-4035-9a3b-bba803b720a1" containerID="ed64a3c1e082eceefb63ce2796989fbe00b84c12fd74e3e35c3198c706eb0c22" exitCode=0 Jun 11 21:29:40.896532 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:40.896172 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" event={"ID":"0b176b63-be3b-4035-9a3b-bba803b720a1","Type":"ContainerDied","Data":"ed64a3c1e082eceefb63ce2796989fbe00b84c12fd74e3e35c3198c706eb0c22"} Jun 11 21:29:41.902078 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:41.902045 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5bc579744d-7pd22" event={"ID":"dd016104-07f0-4664-856c-84725af31488","Type":"ContainerStarted","Data":"9cf5d348f20d8b842178f5f35112c74e0647d3a311dd52120b20f02e3e105e9d"} Jun 11 21:29:41.922218 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:41.922171 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5bc579744d-7pd22" podStartSLOduration=2.098170057 podStartE2EDuration="3.922155211s" totalImagesPullingTime="1.823985154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:29:41.920797693 +0000 UTC m=+553.694737649" watchObservedRunningTime="2026-06-11 21:29:41.922155211 +0000 UTC m=+553.696095167" Jun 11 21:29:42.034062 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:42.034039 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" Jun 11 21:29:42.130420 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:42.130376 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdgc9\" (UniqueName: \"kubernetes.io/projected/0b176b63-be3b-4035-9a3b-bba803b720a1-kube-api-access-jdgc9\") pod \"0b176b63-be3b-4035-9a3b-bba803b720a1\" (UID: \"0b176b63-be3b-4035-9a3b-bba803b720a1\") " Jun 11 21:29:42.130593 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:42.130463 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b176b63-be3b-4035-9a3b-bba803b720a1-util\") pod \"0b176b63-be3b-4035-9a3b-bba803b720a1\" (UID: \"0b176b63-be3b-4035-9a3b-bba803b720a1\") " Jun 11 21:29:42.130593 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:42.130518 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b176b63-be3b-4035-9a3b-bba803b720a1-bundle\") pod \"0b176b63-be3b-4035-9a3b-bba803b720a1\" (UID: \"0b176b63-be3b-4035-9a3b-bba803b720a1\") " Jun 11 21:29:42.131310 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:42.131288 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b176b63-be3b-4035-9a3b-bba803b720a1-bundle" (OuterVolumeSpecName: "bundle") pod "0b176b63-be3b-4035-9a3b-bba803b720a1" (UID: "0b176b63-be3b-4035-9a3b-bba803b720a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:29:42.132590 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:42.132570 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b176b63-be3b-4035-9a3b-bba803b720a1-kube-api-access-jdgc9" (OuterVolumeSpecName: "kube-api-access-jdgc9") pod "0b176b63-be3b-4035-9a3b-bba803b720a1" (UID: "0b176b63-be3b-4035-9a3b-bba803b720a1"). InnerVolumeSpecName "kube-api-access-jdgc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:29:42.139054 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:42.139032 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b176b63-be3b-4035-9a3b-bba803b720a1-util" (OuterVolumeSpecName: "util") pod "0b176b63-be3b-4035-9a3b-bba803b720a1" (UID: "0b176b63-be3b-4035-9a3b-bba803b720a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:29:42.231529 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:42.231480 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdgc9\" (UniqueName: \"kubernetes.io/projected/0b176b63-be3b-4035-9a3b-bba803b720a1-kube-api-access-jdgc9\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:29:42.231529 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:42.231500 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b176b63-be3b-4035-9a3b-bba803b720a1-util\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:29:42.231529 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:42.231509 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b176b63-be3b-4035-9a3b-bba803b720a1-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:29:42.908535 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:42.908493 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" Jun 11 21:29:42.908535 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:42.908521 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az2sl8" event={"ID":"0b176b63-be3b-4035-9a3b-bba803b720a1","Type":"ContainerDied","Data":"b3ab7dc939e52ec3cc8990a960d3c3cacf1c0f9aaf07cecab669da645b2bfc45"} Jun 11 21:29:42.908956 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:42.908596 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3ab7dc939e52ec3cc8990a960d3c3cacf1c0f9aaf07cecab669da645b2bfc45" Jun 11 21:29:52.102269 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.102231 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf"] Jun 11 21:29:52.102761 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.102574 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b176b63-be3b-4035-9a3b-bba803b720a1" containerName="pull" Jun 11 21:29:52.102761 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.102586 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b176b63-be3b-4035-9a3b-bba803b720a1" containerName="pull" Jun 11 21:29:52.102761 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.102594 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b176b63-be3b-4035-9a3b-bba803b720a1" containerName="extract" Jun 11 21:29:52.102761 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.102600 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b176b63-be3b-4035-9a3b-bba803b720a1" containerName="extract" Jun 11 21:29:52.102761 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.102612 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b176b63-be3b-4035-9a3b-bba803b720a1" containerName="util" Jun 11 21:29:52.102761 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.102618 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b176b63-be3b-4035-9a3b-bba803b720a1" containerName="util" Jun 11 21:29:52.102761 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.102686 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b176b63-be3b-4035-9a3b-bba803b720a1" containerName="extract" Jun 11 21:29:52.106808 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.106784 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.109015 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.108994 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 21:29:52.109109 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.109088 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hgjht\"" Jun 11 21:29:52.116305 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.116284 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf"] Jun 11 21:29:52.213536 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.213505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.213700 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.213542 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.213700 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.213564 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrzqj\" (UniqueName: \"kubernetes.io/projected/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-kube-api-access-vrzqj\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.213700 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.213582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.213700 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.213639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.213700 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.213678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.213934 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.213739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.213934 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.213785 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.213934 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.213827 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.314532 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.314494 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.314532 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.314534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.314762 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.314560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.314762 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.314593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.314762 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.314625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.314762 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.314657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrzqj\" (UniqueName: \"kubernetes.io/projected/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-kube-api-access-vrzqj\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.314762 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.314683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.314762 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.314714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.315037 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.314781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.315037 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.314991 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.315166 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.315139 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.315316 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.315264 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.315316 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.315305 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.315499 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.315442 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.317005 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.316988 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.317153 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.317137 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.321861 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.321840 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.321861 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.321854 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrzqj\" (UniqueName: \"kubernetes.io/projected/2dea163b-fc45-4bbf-907e-e5ce1cfdbe88-kube-api-access-vrzqj\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcmhlnf\" (UID: \"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.419085 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.419050 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:52.555032 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.554999 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf"] Jun 11 21:29:52.558275 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:29:52.558252 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dea163b_fc45_4bbf_907e_e5ce1cfdbe88.slice/crio-57b21da9828f1beab255bb8ff63d4b06d892f541a6427ceacf2db38d114cdb87 WatchSource:0}: Error finding container 57b21da9828f1beab255bb8ff63d4b06d892f541a6427ceacf2db38d114cdb87: Status 404 returned error can't find the container with id 57b21da9828f1beab255bb8ff63d4b06d892f541a6427ceacf2db38d114cdb87 Jun 11 21:29:52.957622 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:52.957582 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" event={"ID":"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88","Type":"ContainerStarted","Data":"57b21da9828f1beab255bb8ff63d4b06d892f541a6427ceacf2db38d114cdb87"} Jun 11 21:29:55.072329 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:55.072286 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 21:29:55.072714 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:55.072369 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 21:29:55.072714 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:55.072442 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 21:29:55.977229 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:55.977196 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" event={"ID":"2dea163b-fc45-4bbf-907e-e5ce1cfdbe88","Type":"ContainerStarted","Data":"19e21c33cf4e4f53af8b59a4ecba23eb900b5470f2e0a69c6d8aade4905aa812"} Jun 11 21:29:56.001095 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:56.001033 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" podStartSLOduration=1.489569485 podStartE2EDuration="4.001013525s" totalImagesPullingTime="2.51144404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:29:56.000596621 +0000 UTC m=+567.774536578" watchObservedRunningTime="2026-06-11 21:29:56.001013525 +0000 UTC m=+567.774953482" Jun 11 21:29:56.419232 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:56.419201 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:56.423681 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:56.423658 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:56.982941 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:56.982909 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:29:56.983765 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:29:56.983744 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcmhlnf" Jun 11 21:30:24.114805 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.114774 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s225x"] Jun 11 21:30:24.129082 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.129053 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s225x"] Jun 11 21:30:24.129259 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.129166 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s225x" Jun 11 21:30:24.131624 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.131597 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bxg64\"" Jun 11 21:30:24.131779 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.131756 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 21:30:24.132627 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.132602 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 21:30:24.192855 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.192823 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pdwj\" (UniqueName: \"kubernetes.io/projected/1ab06a73-50aa-4ad0-9f39-bab7fe7013dc-kube-api-access-9pdwj\") pod \"kuadrant-operator-catalog-s225x\" (UID: \"1ab06a73-50aa-4ad0-9f39-bab7fe7013dc\") " pod="kuadrant-system/kuadrant-operator-catalog-s225x" Jun 11 21:30:24.293578 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.293537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pdwj\" (UniqueName: \"kubernetes.io/projected/1ab06a73-50aa-4ad0-9f39-bab7fe7013dc-kube-api-access-9pdwj\") pod \"kuadrant-operator-catalog-s225x\" (UID: \"1ab06a73-50aa-4ad0-9f39-bab7fe7013dc\") " pod="kuadrant-system/kuadrant-operator-catalog-s225x" Jun 11 21:30:24.301179 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.301156 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pdwj\" (UniqueName: \"kubernetes.io/projected/1ab06a73-50aa-4ad0-9f39-bab7fe7013dc-kube-api-access-9pdwj\") pod \"kuadrant-operator-catalog-s225x\" (UID: \"1ab06a73-50aa-4ad0-9f39-bab7fe7013dc\") " pod="kuadrant-system/kuadrant-operator-catalog-s225x" Jun 11 21:30:24.442257 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.442223 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s225x" Jun 11 21:30:24.487649 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.487618 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s225x"] Jun 11 21:30:24.580777 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.580746 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s225x"] Jun 11 21:30:24.584092 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:30:24.584069 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ab06a73_50aa_4ad0_9f39_bab7fe7013dc.slice/crio-4d5a321cc50f9cabdf4c010231228fd88dee5ee3f283da1b2e70da45c688b56b WatchSource:0}: Error finding container 4d5a321cc50f9cabdf4c010231228fd88dee5ee3f283da1b2e70da45c688b56b: Status 404 returned error can't find the container with id 4d5a321cc50f9cabdf4c010231228fd88dee5ee3f283da1b2e70da45c688b56b Jun 11 21:30:24.698104 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.698021 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pkj9n"] Jun 11 21:30:24.703270 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.703251 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pkj9n" Jun 11 21:30:24.709806 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.709782 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pkj9n"] Jun 11 21:30:24.797767 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.797729 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvrvb\" (UniqueName: \"kubernetes.io/projected/f0656a72-4a66-4211-ab56-85d03f2eb412-kube-api-access-kvrvb\") pod \"kuadrant-operator-catalog-pkj9n\" (UID: \"f0656a72-4a66-4211-ab56-85d03f2eb412\") " pod="kuadrant-system/kuadrant-operator-catalog-pkj9n" Jun 11 21:30:24.898866 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.898836 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvrvb\" (UniqueName: \"kubernetes.io/projected/f0656a72-4a66-4211-ab56-85d03f2eb412-kube-api-access-kvrvb\") pod \"kuadrant-operator-catalog-pkj9n\" (UID: \"f0656a72-4a66-4211-ab56-85d03f2eb412\") " pod="kuadrant-system/kuadrant-operator-catalog-pkj9n" Jun 11 21:30:24.907378 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:24.907350 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvrvb\" (UniqueName: \"kubernetes.io/projected/f0656a72-4a66-4211-ab56-85d03f2eb412-kube-api-access-kvrvb\") pod \"kuadrant-operator-catalog-pkj9n\" (UID: \"f0656a72-4a66-4211-ab56-85d03f2eb412\") " pod="kuadrant-system/kuadrant-operator-catalog-pkj9n" Jun 11 21:30:25.014774 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:25.014678 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pkj9n" Jun 11 21:30:25.122266 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:25.122232 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s225x" event={"ID":"1ab06a73-50aa-4ad0-9f39-bab7fe7013dc","Type":"ContainerStarted","Data":"4d5a321cc50f9cabdf4c010231228fd88dee5ee3f283da1b2e70da45c688b56b"} Jun 11 21:30:25.163314 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:25.163288 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pkj9n"] Jun 11 21:30:25.165448 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:30:25.165394 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0656a72_4a66_4211_ab56_85d03f2eb412.slice/crio-e5a4b07b941741baf97c2a560439d475f52efd0fb7fb1182949d6359804e6101 WatchSource:0}: Error finding container e5a4b07b941741baf97c2a560439d475f52efd0fb7fb1182949d6359804e6101: Status 404 returned error can't find the container with id e5a4b07b941741baf97c2a560439d475f52efd0fb7fb1182949d6359804e6101 Jun 11 21:30:26.129274 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:26.129230 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pkj9n" event={"ID":"f0656a72-4a66-4211-ab56-85d03f2eb412","Type":"ContainerStarted","Data":"e5a4b07b941741baf97c2a560439d475f52efd0fb7fb1182949d6359804e6101"} Jun 11 21:30:27.141616 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:27.141571 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pkj9n" event={"ID":"f0656a72-4a66-4211-ab56-85d03f2eb412","Type":"ContainerStarted","Data":"a7f2fc170031e606d745da96e05ad828e705ab3445db5b55c150d4804ed3faa9"} Jun 11 21:30:27.143691 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:27.143641 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s225x" event={"ID":"1ab06a73-50aa-4ad0-9f39-bab7fe7013dc","Type":"ContainerStarted","Data":"675af00df5265ca4490c23e8151e356e1d6f3945e63c4729d01e3062bb62db5e"} Jun 11 21:30:27.143858 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:27.143676 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-s225x" podUID="1ab06a73-50aa-4ad0-9f39-bab7fe7013dc" containerName="registry-server" containerID="cri-o://675af00df5265ca4490c23e8151e356e1d6f3945e63c4729d01e3062bb62db5e" gracePeriod=2 Jun 11 21:30:27.158269 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:27.158206 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pkj9n" podStartSLOduration=1.319736309 podStartE2EDuration="3.158183095s" totalImagesPullingTime="1.838446786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:30:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:30:27.157827282 +0000 UTC m=+598.931767239" watchObservedRunningTime="2026-06-11 21:30:27.158183095 +0000 UTC m=+598.932123052" Jun 11 21:30:27.173540 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:27.173486 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-s225x" podStartSLOduration=0.756150486 podStartE2EDuration="3.173471554s" totalImagesPullingTime="2.417321068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:30:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:30:27.170754202 +0000 UTC m=+598.944694173" watchObservedRunningTime="2026-06-11 21:30:27.173471554 +0000 UTC m=+598.947411511" Jun 11 21:30:27.389911 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:27.389889 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-s225x_1ab06a73-50aa-4ad0-9f39-bab7fe7013dc/registry-server/0.log" Jun 11 21:30:27.392153 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:27.392137 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s225x" Jun 11 21:30:27.526027 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:27.525930 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pdwj\" (UniqueName: \"kubernetes.io/projected/1ab06a73-50aa-4ad0-9f39-bab7fe7013dc-kube-api-access-9pdwj\") pod \"1ab06a73-50aa-4ad0-9f39-bab7fe7013dc\" (UID: \"1ab06a73-50aa-4ad0-9f39-bab7fe7013dc\") " Jun 11 21:30:27.528101 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:27.528069 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ab06a73-50aa-4ad0-9f39-bab7fe7013dc-kube-api-access-9pdwj" (OuterVolumeSpecName: "kube-api-access-9pdwj") pod "1ab06a73-50aa-4ad0-9f39-bab7fe7013dc" (UID: "1ab06a73-50aa-4ad0-9f39-bab7fe7013dc"). InnerVolumeSpecName "kube-api-access-9pdwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:30:27.626737 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:27.626704 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pdwj\" (UniqueName: \"kubernetes.io/projected/1ab06a73-50aa-4ad0-9f39-bab7fe7013dc-kube-api-access-9pdwj\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:30:28.150166 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:28.150140 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-s225x_1ab06a73-50aa-4ad0-9f39-bab7fe7013dc/registry-server/0.log" Jun 11 21:30:28.150655 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:28.150176 2581 generic.go:356] "Generic (PLEG): container finished" podID="1ab06a73-50aa-4ad0-9f39-bab7fe7013dc" containerID="675af00df5265ca4490c23e8151e356e1d6f3945e63c4729d01e3062bb62db5e" exitCode=1 Jun 11 21:30:28.150655 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:28.150222 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s225x" Jun 11 21:30:28.150655 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:28.150276 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s225x" event={"ID":"1ab06a73-50aa-4ad0-9f39-bab7fe7013dc","Type":"ContainerDied","Data":"675af00df5265ca4490c23e8151e356e1d6f3945e63c4729d01e3062bb62db5e"} Jun 11 21:30:28.150655 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:28.150338 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s225x" event={"ID":"1ab06a73-50aa-4ad0-9f39-bab7fe7013dc","Type":"ContainerDied","Data":"4d5a321cc50f9cabdf4c010231228fd88dee5ee3f283da1b2e70da45c688b56b"} Jun 11 21:30:28.150655 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:28.150367 2581 scope.go:117] "RemoveContainer" containerID="675af00df5265ca4490c23e8151e356e1d6f3945e63c4729d01e3062bb62db5e" Jun 11 21:30:28.160089 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:28.160072 2581 scope.go:117] "RemoveContainer" containerID="675af00df5265ca4490c23e8151e356e1d6f3945e63c4729d01e3062bb62db5e" Jun 11 21:30:28.160364 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:30:28.160347 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"675af00df5265ca4490c23e8151e356e1d6f3945e63c4729d01e3062bb62db5e\": container with ID starting with 675af00df5265ca4490c23e8151e356e1d6f3945e63c4729d01e3062bb62db5e not found: ID does not exist" containerID="675af00df5265ca4490c23e8151e356e1d6f3945e63c4729d01e3062bb62db5e" Jun 11 21:30:28.160437 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:28.160373 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675af00df5265ca4490c23e8151e356e1d6f3945e63c4729d01e3062bb62db5e"} err="failed to get container status \"675af00df5265ca4490c23e8151e356e1d6f3945e63c4729d01e3062bb62db5e\": rpc error: code = NotFound desc = could not find container \"675af00df5265ca4490c23e8151e356e1d6f3945e63c4729d01e3062bb62db5e\": container with ID starting with 675af00df5265ca4490c23e8151e356e1d6f3945e63c4729d01e3062bb62db5e not found: ID does not exist" Jun 11 21:30:28.172188 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:28.172163 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s225x"] Jun 11 21:30:28.176566 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:28.176546 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s225x"] Jun 11 21:30:28.694215 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:28.694186 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:30:28.694966 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:28.694943 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:30:28.706733 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:28.706708 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ab06a73-50aa-4ad0-9f39-bab7fe7013dc" path="/var/lib/kubelet/pods/1ab06a73-50aa-4ad0-9f39-bab7fe7013dc/volumes" Jun 11 21:30:35.015130 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:35.015080 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pkj9n" Jun 11 21:30:35.015611 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:35.015150 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pkj9n" Jun 11 21:30:35.037539 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:35.037510 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pkj9n" Jun 11 21:30:35.206468 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:35.206440 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pkj9n" Jun 11 21:30:39.731734 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.731654 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t"] Jun 11 21:30:39.732093 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.732058 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ab06a73-50aa-4ad0-9f39-bab7fe7013dc" containerName="registry-server" Jun 11 21:30:39.732093 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.732071 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ab06a73-50aa-4ad0-9f39-bab7fe7013dc" containerName="registry-server" Jun 11 21:30:39.732169 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.732145 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ab06a73-50aa-4ad0-9f39-bab7fe7013dc" containerName="registry-server" Jun 11 21:30:39.738551 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.738527 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" Jun 11 21:30:39.741139 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.741115 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2kwtd\"" Jun 11 21:30:39.742744 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.742721 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t"] Jun 11 21:30:39.834806 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.834774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06c41b5a-10b0-46ea-8106-0aab05d0ce56-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t\" (UID: \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" Jun 11 21:30:39.834806 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.834818 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06c41b5a-10b0-46ea-8106-0aab05d0ce56-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t\" (UID: \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" Jun 11 21:30:39.835031 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.834855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dt6p\" (UniqueName: \"kubernetes.io/projected/06c41b5a-10b0-46ea-8106-0aab05d0ce56-kube-api-access-9dt6p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t\" (UID: \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" Jun 11 21:30:39.936006 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.935967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06c41b5a-10b0-46ea-8106-0aab05d0ce56-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t\" (UID: \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" Jun 11 21:30:39.936188 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.936026 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dt6p\" (UniqueName: \"kubernetes.io/projected/06c41b5a-10b0-46ea-8106-0aab05d0ce56-kube-api-access-9dt6p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t\" (UID: \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" Jun 11 21:30:39.936188 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.936096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06c41b5a-10b0-46ea-8106-0aab05d0ce56-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t\" (UID: \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" Jun 11 21:30:39.936356 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.936337 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06c41b5a-10b0-46ea-8106-0aab05d0ce56-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t\" (UID: \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" Jun 11 21:30:39.936453 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.936434 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06c41b5a-10b0-46ea-8106-0aab05d0ce56-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t\" (UID: \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" Jun 11 21:30:39.943982 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:39.943955 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dt6p\" (UniqueName: \"kubernetes.io/projected/06c41b5a-10b0-46ea-8106-0aab05d0ce56-kube-api-access-9dt6p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t\" (UID: \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" Jun 11 21:30:40.050473 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.050377 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" Jun 11 21:30:40.185584 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.185559 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t"] Jun 11 21:30:40.187862 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:30:40.187834 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c41b5a_10b0_46ea_8106_0aab05d0ce56.slice/crio-8ecdd2057bfba5d63a61b62702b82b343c5d6edbda20ff43f555d9190fe09861 WatchSource:0}: Error finding container 8ecdd2057bfba5d63a61b62702b82b343c5d6edbda20ff43f555d9190fe09861: Status 404 returned error can't find the container with id 8ecdd2057bfba5d63a61b62702b82b343c5d6edbda20ff43f555d9190fe09861 Jun 11 21:30:40.209014 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.208991 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" event={"ID":"06c41b5a-10b0-46ea-8106-0aab05d0ce56","Type":"ContainerStarted","Data":"8ecdd2057bfba5d63a61b62702b82b343c5d6edbda20ff43f555d9190fe09861"} Jun 11 21:30:40.329320 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.329247 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc"] Jun 11 21:30:40.333099 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.333077 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" Jun 11 21:30:40.340582 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.340558 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc"] Jun 11 21:30:40.441089 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.441054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc\" (UID: \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" Jun 11 21:30:40.441261 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.441119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc\" (UID: \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" Jun 11 21:30:40.441261 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.441203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fwxj\" (UniqueName: \"kubernetes.io/projected/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-kube-api-access-4fwxj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc\" (UID: \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" Jun 11 21:30:40.542166 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.542069 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc\" (UID: \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" Jun 11 21:30:40.542166 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.542132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc\" (UID: \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" Jun 11 21:30:40.553080 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.542184 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fwxj\" (UniqueName: \"kubernetes.io/projected/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-kube-api-access-4fwxj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc\" (UID: \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" Jun 11 21:30:40.553080 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.542538 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc\" (UID: \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" Jun 11 21:30:40.553080 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.542561 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc\" (UID: \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" Jun 11 21:30:40.553080 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.549898 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fwxj\" (UniqueName: \"kubernetes.io/projected/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-kube-api-access-4fwxj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc\" (UID: \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" Jun 11 21:30:40.672713 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.672675 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" Jun 11 21:30:40.803529 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.803506 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc"] Jun 11 21:30:40.805866 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:30:40.805845 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc360fd10_3d19_4479_bf51_e2fe5c1b21a9.slice/crio-484cfdfe840c880df16421d56a07ebafdc551527f6400bcc03b8008b340bff48 WatchSource:0}: Error finding container 484cfdfe840c880df16421d56a07ebafdc551527f6400bcc03b8008b340bff48: Status 404 returned error can't find the container with id 484cfdfe840c880df16421d56a07ebafdc551527f6400bcc03b8008b340bff48 Jun 11 21:30:40.927775 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.927748 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb"] Jun 11 21:30:40.932033 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.932013 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" Jun 11 21:30:40.941428 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:40.939487 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb"] Jun 11 21:30:41.047622 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.047590 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff82448e-9103-4621-903a-339e16f25b2c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb\" (UID: \"ff82448e-9103-4621-903a-339e16f25b2c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" Jun 11 21:30:41.047785 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.047667 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff82448e-9103-4621-903a-339e16f25b2c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb\" (UID: \"ff82448e-9103-4621-903a-339e16f25b2c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" Jun 11 21:30:41.047785 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.047689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbqz2\" (UniqueName: \"kubernetes.io/projected/ff82448e-9103-4621-903a-339e16f25b2c-kube-api-access-dbqz2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb\" (UID: \"ff82448e-9103-4621-903a-339e16f25b2c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" Jun 11 21:30:41.148106 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.148074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff82448e-9103-4621-903a-339e16f25b2c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb\" (UID: \"ff82448e-9103-4621-903a-339e16f25b2c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" Jun 11 21:30:41.148264 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.148111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbqz2\" (UniqueName: \"kubernetes.io/projected/ff82448e-9103-4621-903a-339e16f25b2c-kube-api-access-dbqz2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb\" (UID: \"ff82448e-9103-4621-903a-339e16f25b2c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" Jun 11 21:30:41.148264 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.148161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff82448e-9103-4621-903a-339e16f25b2c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb\" (UID: \"ff82448e-9103-4621-903a-339e16f25b2c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" Jun 11 21:30:41.148518 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.148498 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff82448e-9103-4621-903a-339e16f25b2c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb\" (UID: \"ff82448e-9103-4621-903a-339e16f25b2c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" Jun 11 21:30:41.148563 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.148505 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff82448e-9103-4621-903a-339e16f25b2c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb\" (UID: \"ff82448e-9103-4621-903a-339e16f25b2c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" Jun 11 21:30:41.155978 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.155948 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbqz2\" (UniqueName: \"kubernetes.io/projected/ff82448e-9103-4621-903a-339e16f25b2c-kube-api-access-dbqz2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb\" (UID: \"ff82448e-9103-4621-903a-339e16f25b2c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" Jun 11 21:30:41.215369 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.215286 2581 generic.go:356] "Generic (PLEG): container finished" podID="c360fd10-3d19-4479-bf51-e2fe5c1b21a9" containerID="b5a48f78dc4ead84ca4dbe4b3c850fb32950d13226911877414412e04f042320" exitCode=0 Jun 11 21:30:41.215540 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.215368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" event={"ID":"c360fd10-3d19-4479-bf51-e2fe5c1b21a9","Type":"ContainerDied","Data":"b5a48f78dc4ead84ca4dbe4b3c850fb32950d13226911877414412e04f042320"} Jun 11 21:30:41.215540 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.215458 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" event={"ID":"c360fd10-3d19-4479-bf51-e2fe5c1b21a9","Type":"ContainerStarted","Data":"484cfdfe840c880df16421d56a07ebafdc551527f6400bcc03b8008b340bff48"} Jun 11 21:30:41.217078 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.217059 2581 generic.go:356] "Generic (PLEG): container finished" podID="06c41b5a-10b0-46ea-8106-0aab05d0ce56" containerID="c286da0e806065e0b13c70aec9385c83b5f70c4ee4fb3c05b37a6dbd446c6396" exitCode=0 Jun 11 21:30:41.217166 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.217087 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" event={"ID":"06c41b5a-10b0-46ea-8106-0aab05d0ce56","Type":"ContainerDied","Data":"c286da0e806065e0b13c70aec9385c83b5f70c4ee4fb3c05b37a6dbd446c6396"} Jun 11 21:30:41.273470 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.273438 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" Jun 11 21:30:41.336170 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.336140 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5"] Jun 11 21:30:41.339565 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.339544 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" Jun 11 21:30:41.350919 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.350893 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5"] Jun 11 21:30:41.410877 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.410855 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb"] Jun 11 21:30:41.412609 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:30:41.412583 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff82448e_9103_4621_903a_339e16f25b2c.slice/crio-26ae6ca750acd870b8e819210e4b0d8394431897df4d94473c8a3cac83e1382c WatchSource:0}: Error finding container 26ae6ca750acd870b8e819210e4b0d8394431897df4d94473c8a3cac83e1382c: Status 404 returned error can't find the container with id 26ae6ca750acd870b8e819210e4b0d8394431897df4d94473c8a3cac83e1382c Jun 11 21:30:41.450516 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.450478 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed32aa66-69a6-4768-b133-97f96299da7e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5\" (UID: \"ed32aa66-69a6-4768-b133-97f96299da7e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" Jun 11 21:30:41.450635 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.450545 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzw6r\" (UniqueName: \"kubernetes.io/projected/ed32aa66-69a6-4768-b133-97f96299da7e-kube-api-access-xzw6r\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5\" (UID: \"ed32aa66-69a6-4768-b133-97f96299da7e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" Jun 11 21:30:41.450635 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.450619 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed32aa66-69a6-4768-b133-97f96299da7e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5\" (UID: \"ed32aa66-69a6-4768-b133-97f96299da7e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" Jun 11 21:30:41.551728 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.551691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed32aa66-69a6-4768-b133-97f96299da7e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5\" (UID: \"ed32aa66-69a6-4768-b133-97f96299da7e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" Jun 11 21:30:41.551728 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.551732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzw6r\" (UniqueName: \"kubernetes.io/projected/ed32aa66-69a6-4768-b133-97f96299da7e-kube-api-access-xzw6r\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5\" (UID: \"ed32aa66-69a6-4768-b133-97f96299da7e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" Jun 11 21:30:41.551903 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.551777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed32aa66-69a6-4768-b133-97f96299da7e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5\" (UID: \"ed32aa66-69a6-4768-b133-97f96299da7e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" Jun 11 21:30:41.552055 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.552036 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed32aa66-69a6-4768-b133-97f96299da7e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5\" (UID: \"ed32aa66-69a6-4768-b133-97f96299da7e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" Jun 11 21:30:41.552093 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.552075 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed32aa66-69a6-4768-b133-97f96299da7e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5\" (UID: \"ed32aa66-69a6-4768-b133-97f96299da7e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" Jun 11 21:30:41.559732 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.559712 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzw6r\" (UniqueName: \"kubernetes.io/projected/ed32aa66-69a6-4768-b133-97f96299da7e-kube-api-access-xzw6r\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5\" (UID: \"ed32aa66-69a6-4768-b133-97f96299da7e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" Jun 11 21:30:41.649477 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.649449 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" Jun 11 21:30:41.784576 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:41.784554 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5"] Jun 11 21:30:41.786977 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:30:41.786952 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded32aa66_69a6_4768_b133_97f96299da7e.slice/crio-fccf02aa98822d5a51e725cb0bb0272946a73167bf00ad737b4d017a9f34a199 WatchSource:0}: Error finding container fccf02aa98822d5a51e725cb0bb0272946a73167bf00ad737b4d017a9f34a199: Status 404 returned error can't find the container with id fccf02aa98822d5a51e725cb0bb0272946a73167bf00ad737b4d017a9f34a199 Jun 11 21:30:42.225243 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:42.225216 2581 generic.go:356] "Generic (PLEG): container finished" podID="ff82448e-9103-4621-903a-339e16f25b2c" containerID="4ad40bb9a875002b287a48d4a75bc256c32f717a3b80ae0c9a40f42fd130256f" exitCode=0 Jun 11 21:30:42.225642 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:42.225296 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" event={"ID":"ff82448e-9103-4621-903a-339e16f25b2c","Type":"ContainerDied","Data":"4ad40bb9a875002b287a48d4a75bc256c32f717a3b80ae0c9a40f42fd130256f"} Jun 11 21:30:42.225642 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:42.225357 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" event={"ID":"ff82448e-9103-4621-903a-339e16f25b2c","Type":"ContainerStarted","Data":"26ae6ca750acd870b8e819210e4b0d8394431897df4d94473c8a3cac83e1382c"} Jun 11 21:30:42.226949 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:42.226922 2581 generic.go:356] "Generic (PLEG): container finished" podID="ed32aa66-69a6-4768-b133-97f96299da7e" containerID="7d1e20e35e4c7d420684d6b259a88cfacbc13ea26c3d73b05cef8cfe0f1c471a" exitCode=0 Jun 11 21:30:42.227049 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:42.226985 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" event={"ID":"ed32aa66-69a6-4768-b133-97f96299da7e","Type":"ContainerDied","Data":"7d1e20e35e4c7d420684d6b259a88cfacbc13ea26c3d73b05cef8cfe0f1c471a"} Jun 11 21:30:42.227049 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:42.227021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" event={"ID":"ed32aa66-69a6-4768-b133-97f96299da7e","Type":"ContainerStarted","Data":"fccf02aa98822d5a51e725cb0bb0272946a73167bf00ad737b4d017a9f34a199"} Jun 11 21:30:42.228979 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:42.228961 2581 generic.go:356] "Generic (PLEG): container finished" podID="c360fd10-3d19-4479-bf51-e2fe5c1b21a9" containerID="d33950382dece14ad0bf6e12986439de7e199de8e4e0b51c761a97bca7c722ab" exitCode=0 Jun 11 21:30:42.229059 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:42.229012 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" event={"ID":"c360fd10-3d19-4479-bf51-e2fe5c1b21a9","Type":"ContainerDied","Data":"d33950382dece14ad0bf6e12986439de7e199de8e4e0b51c761a97bca7c722ab"} Jun 11 21:30:43.236901 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:43.236809 2581 generic.go:356] "Generic (PLEG): container finished" podID="c360fd10-3d19-4479-bf51-e2fe5c1b21a9" containerID="29c4e42b86986310eb25b91af4105d070db365466f7a6ff3506cd2ba7ae9e5a2" exitCode=0 Jun 11 21:30:43.237303 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:43.236896 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" event={"ID":"c360fd10-3d19-4479-bf51-e2fe5c1b21a9","Type":"ContainerDied","Data":"29c4e42b86986310eb25b91af4105d070db365466f7a6ff3506cd2ba7ae9e5a2"} Jun 11 21:30:43.238617 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:43.238595 2581 generic.go:356] "Generic (PLEG): container finished" podID="06c41b5a-10b0-46ea-8106-0aab05d0ce56" containerID="b9265cd3b2a3d98c2964a03d9b7d1c09bd5a9562247b48dda6328981ddbee749" exitCode=0 Jun 11 21:30:43.238744 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:43.238675 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" event={"ID":"06c41b5a-10b0-46ea-8106-0aab05d0ce56","Type":"ContainerDied","Data":"b9265cd3b2a3d98c2964a03d9b7d1c09bd5a9562247b48dda6328981ddbee749"} Jun 11 21:30:43.240641 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:43.240619 2581 generic.go:356] "Generic (PLEG): container finished" podID="ff82448e-9103-4621-903a-339e16f25b2c" containerID="f231a6280c4842d72105c3ac0d33fe52105657e30fa40b1a712de13cefb7f0af" exitCode=0 Jun 11 21:30:43.240770 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:43.240652 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" event={"ID":"ff82448e-9103-4621-903a-339e16f25b2c","Type":"ContainerDied","Data":"f231a6280c4842d72105c3ac0d33fe52105657e30fa40b1a712de13cefb7f0af"} Jun 11 21:30:44.247891 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.247801 2581 generic.go:356] "Generic (PLEG): container finished" podID="ed32aa66-69a6-4768-b133-97f96299da7e" containerID="3bda724d63277c8e2d14b6451fa36f70ba0cad90720bf1218b51e417dd661539" exitCode=0 Jun 11 21:30:44.247891 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.247879 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" event={"ID":"ed32aa66-69a6-4768-b133-97f96299da7e","Type":"ContainerDied","Data":"3bda724d63277c8e2d14b6451fa36f70ba0cad90720bf1218b51e417dd661539"} Jun 11 21:30:44.250228 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.250207 2581 generic.go:356] "Generic (PLEG): container finished" podID="06c41b5a-10b0-46ea-8106-0aab05d0ce56" containerID="59636041dfeb95ad541ed76ee29b0741777b0942f77624ec74dbd15279463d1f" exitCode=0 Jun 11 21:30:44.250336 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.250233 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" event={"ID":"06c41b5a-10b0-46ea-8106-0aab05d0ce56","Type":"ContainerDied","Data":"59636041dfeb95ad541ed76ee29b0741777b0942f77624ec74dbd15279463d1f"} Jun 11 21:30:44.252197 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.252179 2581 generic.go:356] "Generic (PLEG): container finished" podID="ff82448e-9103-4621-903a-339e16f25b2c" containerID="857d3335528eb18c60ec7cc74943afa16cbf86aa5ff5bcf13087c64d4dc2904e" exitCode=0 Jun 11 21:30:44.252289 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.252265 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" event={"ID":"ff82448e-9103-4621-903a-339e16f25b2c","Type":"ContainerDied","Data":"857d3335528eb18c60ec7cc74943afa16cbf86aa5ff5bcf13087c64d4dc2904e"} Jun 11 21:30:44.386787 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.386753 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" Jun 11 21:30:44.479094 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.479061 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-bundle\") pod \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\" (UID: \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\") " Jun 11 21:30:44.479245 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.479132 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-util\") pod \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\" (UID: \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\") " Jun 11 21:30:44.479245 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.479180 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fwxj\" (UniqueName: \"kubernetes.io/projected/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-kube-api-access-4fwxj\") pod \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\" (UID: \"c360fd10-3d19-4479-bf51-e2fe5c1b21a9\") " Jun 11 21:30:44.479675 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.479647 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-bundle" (OuterVolumeSpecName: "bundle") pod "c360fd10-3d19-4479-bf51-e2fe5c1b21a9" (UID: "c360fd10-3d19-4479-bf51-e2fe5c1b21a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:30:44.481380 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.481353 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-kube-api-access-4fwxj" (OuterVolumeSpecName: "kube-api-access-4fwxj") pod "c360fd10-3d19-4479-bf51-e2fe5c1b21a9" (UID: "c360fd10-3d19-4479-bf51-e2fe5c1b21a9"). InnerVolumeSpecName "kube-api-access-4fwxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:30:44.484333 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.484303 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-util" (OuterVolumeSpecName: "util") pod "c360fd10-3d19-4479-bf51-e2fe5c1b21a9" (UID: "c360fd10-3d19-4479-bf51-e2fe5c1b21a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:30:44.572715 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.572649 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9b77bcbb7-spwvd"] Jun 11 21:30:44.573176 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.573161 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c360fd10-3d19-4479-bf51-e2fe5c1b21a9" containerName="extract" Jun 11 21:30:44.573221 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.573179 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c360fd10-3d19-4479-bf51-e2fe5c1b21a9" containerName="extract" Jun 11 21:30:44.573221 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.573194 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c360fd10-3d19-4479-bf51-e2fe5c1b21a9" containerName="pull" Jun 11 21:30:44.573221 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.573202 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c360fd10-3d19-4479-bf51-e2fe5c1b21a9" containerName="pull" Jun 11 21:30:44.573309 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.573225 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c360fd10-3d19-4479-bf51-e2fe5c1b21a9" containerName="util" Jun 11 21:30:44.573309 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.573234 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c360fd10-3d19-4479-bf51-e2fe5c1b21a9" containerName="util" Jun 11 21:30:44.573373 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.573350 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c360fd10-3d19-4479-bf51-e2fe5c1b21a9" containerName="extract" Jun 11 21:30:44.576805 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.576789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.579877 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.579856 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:30:44.579877 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.579876 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-util\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:30:44.580016 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.579885 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fwxj\" (UniqueName: \"kubernetes.io/projected/c360fd10-3d19-4479-bf51-e2fe5c1b21a9-kube-api-access-4fwxj\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:30:44.585494 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.585474 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b77bcbb7-spwvd"] Jun 11 21:30:44.680295 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.680262 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d5vv\" (UniqueName: \"kubernetes.io/projected/6027f8fb-18ec-43d3-8d52-40088184715f-kube-api-access-7d5vv\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.680484 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.680310 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6027f8fb-18ec-43d3-8d52-40088184715f-service-ca\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.680484 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.680334 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6027f8fb-18ec-43d3-8d52-40088184715f-console-oauth-config\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.680484 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.680431 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6027f8fb-18ec-43d3-8d52-40088184715f-oauth-serving-cert\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.680663 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.680500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6027f8fb-18ec-43d3-8d52-40088184715f-console-serving-cert\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.680663 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.680527 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6027f8fb-18ec-43d3-8d52-40088184715f-console-config\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.680663 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.680551 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6027f8fb-18ec-43d3-8d52-40088184715f-trusted-ca-bundle\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.781989 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.781957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d5vv\" (UniqueName: \"kubernetes.io/projected/6027f8fb-18ec-43d3-8d52-40088184715f-kube-api-access-7d5vv\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.782149 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.782009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6027f8fb-18ec-43d3-8d52-40088184715f-service-ca\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.782149 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.782030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6027f8fb-18ec-43d3-8d52-40088184715f-console-oauth-config\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.782149 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.782053 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6027f8fb-18ec-43d3-8d52-40088184715f-oauth-serving-cert\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.782149 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.782083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6027f8fb-18ec-43d3-8d52-40088184715f-console-serving-cert\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.782149 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.782131 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6027f8fb-18ec-43d3-8d52-40088184715f-console-config\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.782378 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.782162 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6027f8fb-18ec-43d3-8d52-40088184715f-trusted-ca-bundle\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.782839 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.782812 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6027f8fb-18ec-43d3-8d52-40088184715f-service-ca\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.782953 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.782900 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6027f8fb-18ec-43d3-8d52-40088184715f-oauth-serving-cert\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.782953 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.782900 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6027f8fb-18ec-43d3-8d52-40088184715f-console-config\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.783104 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.783082 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6027f8fb-18ec-43d3-8d52-40088184715f-trusted-ca-bundle\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.784643 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.784614 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6027f8fb-18ec-43d3-8d52-40088184715f-console-oauth-config\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.784733 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.784723 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6027f8fb-18ec-43d3-8d52-40088184715f-console-serving-cert\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.789944 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.789921 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d5vv\" (UniqueName: \"kubernetes.io/projected/6027f8fb-18ec-43d3-8d52-40088184715f-kube-api-access-7d5vv\") pod \"console-9b77bcbb7-spwvd\" (UID: \"6027f8fb-18ec-43d3-8d52-40088184715f\") " pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:44.886830 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:44.886790 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:45.020030 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.019989 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b77bcbb7-spwvd"] Jun 11 21:30:45.022166 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:30:45.022136 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6027f8fb_18ec_43d3_8d52_40088184715f.slice/crio-5877440c2b8c075ac1998c27469c4dbe6f0f2220b7c1a76343e9601fbbe4c483 WatchSource:0}: Error finding container 5877440c2b8c075ac1998c27469c4dbe6f0f2220b7c1a76343e9601fbbe4c483: Status 404 returned error can't find the container with id 5877440c2b8c075ac1998c27469c4dbe6f0f2220b7c1a76343e9601fbbe4c483 Jun 11 21:30:45.259223 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.259122 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b77bcbb7-spwvd" event={"ID":"6027f8fb-18ec-43d3-8d52-40088184715f","Type":"ContainerStarted","Data":"62a6182e73e49c481c103c513baad1db2f1edc2673bbcc074974368a1907104c"} Jun 11 21:30:45.259223 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.259184 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b77bcbb7-spwvd" event={"ID":"6027f8fb-18ec-43d3-8d52-40088184715f","Type":"ContainerStarted","Data":"5877440c2b8c075ac1998c27469c4dbe6f0f2220b7c1a76343e9601fbbe4c483"} Jun 11 21:30:45.260927 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.260907 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" Jun 11 21:30:45.261055 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.260943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc" event={"ID":"c360fd10-3d19-4479-bf51-e2fe5c1b21a9","Type":"ContainerDied","Data":"484cfdfe840c880df16421d56a07ebafdc551527f6400bcc03b8008b340bff48"} Jun 11 21:30:45.261055 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.260975 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="484cfdfe840c880df16421d56a07ebafdc551527f6400bcc03b8008b340bff48" Jun 11 21:30:45.263296 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.263270 2581 generic.go:356] "Generic (PLEG): container finished" podID="ed32aa66-69a6-4768-b133-97f96299da7e" containerID="d4945a4e4c81419d914fdd890ab5723af4e5f0f56d36664fb4a18426d636e42e" exitCode=0 Jun 11 21:30:45.263434 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.263355 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" event={"ID":"ed32aa66-69a6-4768-b133-97f96299da7e","Type":"ContainerDied","Data":"d4945a4e4c81419d914fdd890ab5723af4e5f0f56d36664fb4a18426d636e42e"} Jun 11 21:30:45.276536 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.276493 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9b77bcbb7-spwvd" podStartSLOduration=1.276477637 podStartE2EDuration="1.276477637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:30:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:30:45.275019586 +0000 UTC m=+617.048959555" watchObservedRunningTime="2026-06-11 21:30:45.276477637 +0000 UTC m=+617.050417593" Jun 11 21:30:45.409491 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.409467 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" Jun 11 21:30:45.429594 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.429571 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" Jun 11 21:30:45.488223 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.488191 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff82448e-9103-4621-903a-339e16f25b2c-bundle\") pod \"ff82448e-9103-4621-903a-339e16f25b2c\" (UID: \"ff82448e-9103-4621-903a-339e16f25b2c\") " Jun 11 21:30:45.488223 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.488228 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbqz2\" (UniqueName: \"kubernetes.io/projected/ff82448e-9103-4621-903a-339e16f25b2c-kube-api-access-dbqz2\") pod \"ff82448e-9103-4621-903a-339e16f25b2c\" (UID: \"ff82448e-9103-4621-903a-339e16f25b2c\") " Jun 11 21:30:45.488480 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.488322 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff82448e-9103-4621-903a-339e16f25b2c-util\") pod \"ff82448e-9103-4621-903a-339e16f25b2c\" (UID: \"ff82448e-9103-4621-903a-339e16f25b2c\") " Jun 11 21:30:45.488780 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.488748 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff82448e-9103-4621-903a-339e16f25b2c-bundle" (OuterVolumeSpecName: "bundle") pod "ff82448e-9103-4621-903a-339e16f25b2c" (UID: "ff82448e-9103-4621-903a-339e16f25b2c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:30:45.490337 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.490319 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff82448e-9103-4621-903a-339e16f25b2c-kube-api-access-dbqz2" (OuterVolumeSpecName: "kube-api-access-dbqz2") pod "ff82448e-9103-4621-903a-339e16f25b2c" (UID: "ff82448e-9103-4621-903a-339e16f25b2c"). InnerVolumeSpecName "kube-api-access-dbqz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:30:45.493571 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.493547 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff82448e-9103-4621-903a-339e16f25b2c-util" (OuterVolumeSpecName: "util") pod "ff82448e-9103-4621-903a-339e16f25b2c" (UID: "ff82448e-9103-4621-903a-339e16f25b2c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:30:45.589146 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.589067 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06c41b5a-10b0-46ea-8106-0aab05d0ce56-bundle\") pod \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\" (UID: \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\") " Jun 11 21:30:45.589146 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.589143 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06c41b5a-10b0-46ea-8106-0aab05d0ce56-util\") pod \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\" (UID: \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\") " Jun 11 21:30:45.589350 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.589172 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dt6p\" (UniqueName: \"kubernetes.io/projected/06c41b5a-10b0-46ea-8106-0aab05d0ce56-kube-api-access-9dt6p\") pod \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\" (UID: \"06c41b5a-10b0-46ea-8106-0aab05d0ce56\") " Jun 11 21:30:45.589439 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.589378 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff82448e-9103-4621-903a-339e16f25b2c-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:30:45.589439 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.589390 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbqz2\" (UniqueName: \"kubernetes.io/projected/ff82448e-9103-4621-903a-339e16f25b2c-kube-api-access-dbqz2\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:30:45.589439 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.589424 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff82448e-9103-4621-903a-339e16f25b2c-util\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:30:45.589602 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.589526 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06c41b5a-10b0-46ea-8106-0aab05d0ce56-bundle" (OuterVolumeSpecName: "bundle") pod "06c41b5a-10b0-46ea-8106-0aab05d0ce56" (UID: "06c41b5a-10b0-46ea-8106-0aab05d0ce56"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:30:45.591208 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.591185 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c41b5a-10b0-46ea-8106-0aab05d0ce56-kube-api-access-9dt6p" (OuterVolumeSpecName: "kube-api-access-9dt6p") pod "06c41b5a-10b0-46ea-8106-0aab05d0ce56" (UID: "06c41b5a-10b0-46ea-8106-0aab05d0ce56"). InnerVolumeSpecName "kube-api-access-9dt6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:30:45.633663 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.633627 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06c41b5a-10b0-46ea-8106-0aab05d0ce56-util" (OuterVolumeSpecName: "util") pod "06c41b5a-10b0-46ea-8106-0aab05d0ce56" (UID: "06c41b5a-10b0-46ea-8106-0aab05d0ce56"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:30:45.690126 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.690097 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06c41b5a-10b0-46ea-8106-0aab05d0ce56-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:30:45.690126 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.690122 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06c41b5a-10b0-46ea-8106-0aab05d0ce56-util\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:30:45.690272 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:45.690131 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dt6p\" (UniqueName: \"kubernetes.io/projected/06c41b5a-10b0-46ea-8106-0aab05d0ce56-kube-api-access-9dt6p\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:30:46.270511 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.270428 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" Jun 11 21:30:46.270918 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.270433 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb" event={"ID":"ff82448e-9103-4621-903a-339e16f25b2c","Type":"ContainerDied","Data":"26ae6ca750acd870b8e819210e4b0d8394431897df4d94473c8a3cac83e1382c"} Jun 11 21:30:46.270918 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.270551 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26ae6ca750acd870b8e819210e4b0d8394431897df4d94473c8a3cac83e1382c" Jun 11 21:30:46.272297 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.272269 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" event={"ID":"06c41b5a-10b0-46ea-8106-0aab05d0ce56","Type":"ContainerDied","Data":"8ecdd2057bfba5d63a61b62702b82b343c5d6edbda20ff43f555d9190fe09861"} Jun 11 21:30:46.272427 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.272312 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ecdd2057bfba5d63a61b62702b82b343c5d6edbda20ff43f555d9190fe09861" Jun 11 21:30:46.272573 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.272557 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t" Jun 11 21:30:46.404937 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.404914 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" Jun 11 21:30:46.497565 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.497532 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed32aa66-69a6-4768-b133-97f96299da7e-bundle\") pod \"ed32aa66-69a6-4768-b133-97f96299da7e\" (UID: \"ed32aa66-69a6-4768-b133-97f96299da7e\") " Jun 11 21:30:46.497718 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.497588 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed32aa66-69a6-4768-b133-97f96299da7e-util\") pod \"ed32aa66-69a6-4768-b133-97f96299da7e\" (UID: \"ed32aa66-69a6-4768-b133-97f96299da7e\") " Jun 11 21:30:46.497718 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.497607 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzw6r\" (UniqueName: \"kubernetes.io/projected/ed32aa66-69a6-4768-b133-97f96299da7e-kube-api-access-xzw6r\") pod \"ed32aa66-69a6-4768-b133-97f96299da7e\" (UID: \"ed32aa66-69a6-4768-b133-97f96299da7e\") " Jun 11 21:30:46.498174 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.498137 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed32aa66-69a6-4768-b133-97f96299da7e-bundle" (OuterVolumeSpecName: "bundle") pod "ed32aa66-69a6-4768-b133-97f96299da7e" (UID: "ed32aa66-69a6-4768-b133-97f96299da7e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:30:46.499724 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.499701 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed32aa66-69a6-4768-b133-97f96299da7e-kube-api-access-xzw6r" (OuterVolumeSpecName: "kube-api-access-xzw6r") pod "ed32aa66-69a6-4768-b133-97f96299da7e" (UID: "ed32aa66-69a6-4768-b133-97f96299da7e"). InnerVolumeSpecName "kube-api-access-xzw6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:30:46.505742 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.505699 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed32aa66-69a6-4768-b133-97f96299da7e-util" (OuterVolumeSpecName: "util") pod "ed32aa66-69a6-4768-b133-97f96299da7e" (UID: "ed32aa66-69a6-4768-b133-97f96299da7e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:30:46.598594 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.598513 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed32aa66-69a6-4768-b133-97f96299da7e-util\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:30:46.598594 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.598540 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzw6r\" (UniqueName: \"kubernetes.io/projected/ed32aa66-69a6-4768-b133-97f96299da7e-kube-api-access-xzw6r\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:30:46.598594 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:46.598551 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed32aa66-69a6-4768-b133-97f96299da7e-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:30:47.279788 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:47.279759 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" Jun 11 21:30:47.279788 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:47.279779 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5" event={"ID":"ed32aa66-69a6-4768-b133-97f96299da7e","Type":"ContainerDied","Data":"fccf02aa98822d5a51e725cb0bb0272946a73167bf00ad737b4d017a9f34a199"} Jun 11 21:30:47.280207 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:47.279820 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fccf02aa98822d5a51e725cb0bb0272946a73167bf00ad737b4d017a9f34a199" Jun 11 21:30:54.886961 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:54.886910 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:54.887500 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:54.887013 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:54.891964 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:54.891940 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:55.335144 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:55.335056 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9b77bcbb7-spwvd" Jun 11 21:30:55.379334 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:55.379300 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-848788995f-5ggb9"] Jun 11 21:30:56.709446 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709418 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-czvkt"] Jun 11 21:30:56.709831 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709749 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff82448e-9103-4621-903a-339e16f25b2c" containerName="pull" Jun 11 21:30:56.709831 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709760 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff82448e-9103-4621-903a-339e16f25b2c" containerName="pull" Jun 11 21:30:56.709831 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709772 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06c41b5a-10b0-46ea-8106-0aab05d0ce56" containerName="util" Jun 11 21:30:56.709831 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709778 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c41b5a-10b0-46ea-8106-0aab05d0ce56" containerName="util" Jun 11 21:30:56.709831 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709784 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff82448e-9103-4621-903a-339e16f25b2c" containerName="util" Jun 11 21:30:56.709831 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709790 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff82448e-9103-4621-903a-339e16f25b2c" containerName="util" Jun 11 21:30:56.709831 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709797 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed32aa66-69a6-4768-b133-97f96299da7e" containerName="util" Jun 11 21:30:56.709831 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709802 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed32aa66-69a6-4768-b133-97f96299da7e" containerName="util" Jun 11 21:30:56.709831 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709809 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff82448e-9103-4621-903a-339e16f25b2c" containerName="extract" Jun 11 21:30:56.709831 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709814 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff82448e-9103-4621-903a-339e16f25b2c" containerName="extract" Jun 11 21:30:56.709831 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709822 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06c41b5a-10b0-46ea-8106-0aab05d0ce56" containerName="extract" Jun 11 21:30:56.709831 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709827 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c41b5a-10b0-46ea-8106-0aab05d0ce56" containerName="extract" Jun 11 21:30:56.710298 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709841 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06c41b5a-10b0-46ea-8106-0aab05d0ce56" containerName="pull" Jun 11 21:30:56.710298 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709846 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c41b5a-10b0-46ea-8106-0aab05d0ce56" containerName="pull" Jun 11 21:30:56.710298 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709854 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed32aa66-69a6-4768-b133-97f96299da7e" containerName="extract" Jun 11 21:30:56.710298 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709859 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed32aa66-69a6-4768-b133-97f96299da7e" containerName="extract" Jun 11 21:30:56.710298 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709867 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed32aa66-69a6-4768-b133-97f96299da7e" containerName="pull" Jun 11 21:30:56.710298 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709871 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed32aa66-69a6-4768-b133-97f96299da7e" containerName="pull" Jun 11 21:30:56.710298 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709926 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed32aa66-69a6-4768-b133-97f96299da7e" containerName="extract" Jun 11 21:30:56.710298 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709934 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff82448e-9103-4621-903a-339e16f25b2c" containerName="extract" Jun 11 21:30:56.710298 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.709940 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="06c41b5a-10b0-46ea-8106-0aab05d0ce56" containerName="extract" Jun 11 21:30:56.714523 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.714507 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-czvkt" Jun 11 21:30:56.717264 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.717247 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zdt9w\"" Jun 11 21:30:56.723230 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.723207 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-czvkt"] Jun 11 21:30:56.788856 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.788817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqwv7\" (UniqueName: \"kubernetes.io/projected/b6695649-5176-4205-8ab8-c0c78a6b1b2d-kube-api-access-dqwv7\") pod \"authorino-operator-75cc8d5cb7-czvkt\" (UID: \"b6695649-5176-4205-8ab8-c0c78a6b1b2d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-czvkt" Jun 11 21:30:56.889236 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.889198 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqwv7\" (UniqueName: \"kubernetes.io/projected/b6695649-5176-4205-8ab8-c0c78a6b1b2d-kube-api-access-dqwv7\") pod \"authorino-operator-75cc8d5cb7-czvkt\" (UID: \"b6695649-5176-4205-8ab8-c0c78a6b1b2d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-czvkt" Jun 11 21:30:56.909304 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:56.909269 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqwv7\" (UniqueName: \"kubernetes.io/projected/b6695649-5176-4205-8ab8-c0c78a6b1b2d-kube-api-access-dqwv7\") pod \"authorino-operator-75cc8d5cb7-czvkt\" (UID: \"b6695649-5176-4205-8ab8-c0c78a6b1b2d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-czvkt" Jun 11 21:30:57.025962 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:57.025872 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-czvkt" Jun 11 21:30:57.197041 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:57.197018 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-czvkt"] Jun 11 21:30:57.199231 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:30:57.199205 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6695649_5176_4205_8ab8_c0c78a6b1b2d.slice/crio-69f8e25e2436b09669e20de0b8993613e501f2d94b9da2226ab497e986713aa4 WatchSource:0}: Error finding container 69f8e25e2436b09669e20de0b8993613e501f2d94b9da2226ab497e986713aa4: Status 404 returned error can't find the container with id 69f8e25e2436b09669e20de0b8993613e501f2d94b9da2226ab497e986713aa4 Jun 11 21:30:57.343747 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:57.343658 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-czvkt" event={"ID":"b6695649-5176-4205-8ab8-c0c78a6b1b2d","Type":"ContainerStarted","Data":"69f8e25e2436b09669e20de0b8993613e501f2d94b9da2226ab497e986713aa4"} Jun 11 21:30:59.927198 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:59.927158 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cwwd2"] Jun 11 21:30:59.930900 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:59.930876 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cwwd2" Jun 11 21:30:59.933225 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:59.933199 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 21:30:59.933364 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:59.933292 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9sc22\"" Jun 11 21:30:59.940154 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:30:59.940129 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cwwd2"] Jun 11 21:31:00.013479 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:00.013440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lllsn\" (UniqueName: \"kubernetes.io/projected/aab7df73-7b4f-416f-be33-da5d40b7fa8d-kube-api-access-lllsn\") pod \"dns-operator-controller-manager-864dd78c4c-cwwd2\" (UID: \"aab7df73-7b4f-416f-be33-da5d40b7fa8d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cwwd2" Jun 11 21:31:00.114763 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:00.114663 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lllsn\" (UniqueName: \"kubernetes.io/projected/aab7df73-7b4f-416f-be33-da5d40b7fa8d-kube-api-access-lllsn\") pod \"dns-operator-controller-manager-864dd78c4c-cwwd2\" (UID: \"aab7df73-7b4f-416f-be33-da5d40b7fa8d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cwwd2" Jun 11 21:31:00.129683 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:00.129655 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lllsn\" (UniqueName: \"kubernetes.io/projected/aab7df73-7b4f-416f-be33-da5d40b7fa8d-kube-api-access-lllsn\") pod \"dns-operator-controller-manager-864dd78c4c-cwwd2\" (UID: \"aab7df73-7b4f-416f-be33-da5d40b7fa8d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cwwd2" Jun 11 21:31:00.243597 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:00.243558 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cwwd2" Jun 11 21:31:00.366048 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:00.365956 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-czvkt" event={"ID":"b6695649-5176-4205-8ab8-c0c78a6b1b2d","Type":"ContainerStarted","Data":"99c2af3e00bb689de05402c36c22186c3057ab62df35eb89f5f5ae85da9af0d4"} Jun 11 21:31:00.366048 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:00.366043 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-czvkt" Jun 11 21:31:00.383835 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:00.383775 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-czvkt" podStartSLOduration=1.815516933 podStartE2EDuration="4.383756798s" totalImagesPullingTime="2.568239865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:00.382160446 +0000 UTC m=+632.156100399" watchObservedRunningTime="2026-06-11 21:31:00.383756798 +0000 UTC m=+632.157696754" Jun 11 21:31:00.393780 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:00.393755 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cwwd2"] Jun 11 21:31:00.395794 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:31:00.395762 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab7df73_7b4f_416f_be33_da5d40b7fa8d.slice/crio-12ca7d1a411558adf6ea7a902d171c8675b0436f159a25aa6281f5da5dc121f9 WatchSource:0}: Error finding container 12ca7d1a411558adf6ea7a902d171c8675b0436f159a25aa6281f5da5dc121f9: Status 404 returned error can't find the container with id 12ca7d1a411558adf6ea7a902d171c8675b0436f159a25aa6281f5da5dc121f9 Jun 11 21:31:01.373948 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:01.373915 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cwwd2" event={"ID":"aab7df73-7b4f-416f-be33-da5d40b7fa8d","Type":"ContainerStarted","Data":"12ca7d1a411558adf6ea7a902d171c8675b0436f159a25aa6281f5da5dc121f9"} Jun 11 21:31:03.387751 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:03.387715 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cwwd2" event={"ID":"aab7df73-7b4f-416f-be33-da5d40b7fa8d","Type":"ContainerStarted","Data":"03b5442313c6a357a8a2a311365e68a631c5e95a30ec350f952348cdbac0bdad"} Jun 11 21:31:03.388147 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:03.387835 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cwwd2" Jun 11 21:31:03.407112 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:03.407060 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cwwd2" podStartSLOduration=2.086241202 podStartE2EDuration="4.407044355s" totalImagesPullingTime="2.320803153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:30:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:03.405026562 +0000 UTC m=+635.178966539" watchObservedRunningTime="2026-06-11 21:31:03.407044355 +0000 UTC m=+635.180984375" Jun 11 21:31:06.679418 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:06.679372 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252"] Jun 11 21:31:06.682936 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:06.682921 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" Jun 11 21:31:06.686176 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:06.686151 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hq4zl\"" Jun 11 21:31:06.692713 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:06.692690 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252"] Jun 11 21:31:06.773120 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:06.773086 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7lpt\" (UniqueName: \"kubernetes.io/projected/e25086b2-f883-4a4a-b49e-a3d519bec1e3-kube-api-access-h7lpt\") pod \"limitador-operator-controller-manager-859d7b78bd-6c252\" (UID: \"e25086b2-f883-4a4a-b49e-a3d519bec1e3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" Jun 11 21:31:06.874491 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:06.874468 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7lpt\" (UniqueName: \"kubernetes.io/projected/e25086b2-f883-4a4a-b49e-a3d519bec1e3-kube-api-access-h7lpt\") pod \"limitador-operator-controller-manager-859d7b78bd-6c252\" (UID: \"e25086b2-f883-4a4a-b49e-a3d519bec1e3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" Jun 11 21:31:06.882629 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:06.882605 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7lpt\" (UniqueName: \"kubernetes.io/projected/e25086b2-f883-4a4a-b49e-a3d519bec1e3-kube-api-access-h7lpt\") pod \"limitador-operator-controller-manager-859d7b78bd-6c252\" (UID: \"e25086b2-f883-4a4a-b49e-a3d519bec1e3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" Jun 11 21:31:06.992886 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:06.992852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" Jun 11 21:31:07.133490 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:07.133458 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252"] Jun 11 21:31:07.134849 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:31:07.134822 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25086b2_f883_4a4a_b49e_a3d519bec1e3.slice/crio-7ac35ff57707e3e14e4ee1cde5b70ad0224ecb994fd39bfb58028ac6bd0ef88c WatchSource:0}: Error finding container 7ac35ff57707e3e14e4ee1cde5b70ad0224ecb994fd39bfb58028ac6bd0ef88c: Status 404 returned error can't find the container with id 7ac35ff57707e3e14e4ee1cde5b70ad0224ecb994fd39bfb58028ac6bd0ef88c Jun 11 21:31:07.411330 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:07.411237 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" event={"ID":"e25086b2-f883-4a4a-b49e-a3d519bec1e3","Type":"ContainerStarted","Data":"7ac35ff57707e3e14e4ee1cde5b70ad0224ecb994fd39bfb58028ac6bd0ef88c"} Jun 11 21:31:09.424751 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:09.424713 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" event={"ID":"e25086b2-f883-4a4a-b49e-a3d519bec1e3","Type":"ContainerStarted","Data":"36d18d76c4d149a311512346ad58fa93713aedcbe56ea4b5a3c41e81c8c3382c"} Jun 11 21:31:09.425167 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:09.424809 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" Jun 11 21:31:09.440927 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:09.440866 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" podStartSLOduration=1.474751683 podStartE2EDuration="3.440848629s" totalImagesPullingTime="1.966096946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:31:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:09.439130294 +0000 UTC m=+641.213070269" watchObservedRunningTime="2026-06-11 21:31:09.440848629 +0000 UTC m=+641.214788655" Jun 11 21:31:11.376676 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:11.376645 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-czvkt" Jun 11 21:31:14.396325 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:14.396293 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cwwd2" Jun 11 21:31:15.014780 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.014751 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx"] Jun 11 21:31:15.020845 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.020810 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx" Jun 11 21:31:15.026300 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.025108 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2kwtd\"" Jun 11 21:31:15.026300 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.025415 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 21:31:15.026300 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.025653 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 21:31:15.031074 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.031045 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx"] Jun 11 21:31:15.047050 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.047006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/18bbc26a-b81d-443c-a5b2-a02ee5197da3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hm7hx\" (UID: \"18bbc26a-b81d-443c-a5b2-a02ee5197da3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx" Jun 11 21:31:15.047194 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.047172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28ttg\" (UniqueName: \"kubernetes.io/projected/18bbc26a-b81d-443c-a5b2-a02ee5197da3-kube-api-access-28ttg\") pod \"kuadrant-console-plugin-66b5774985-hm7hx\" (UID: \"18bbc26a-b81d-443c-a5b2-a02ee5197da3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx" Jun 11 21:31:15.047265 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.047215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18bbc26a-b81d-443c-a5b2-a02ee5197da3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hm7hx\" (UID: \"18bbc26a-b81d-443c-a5b2-a02ee5197da3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx" Jun 11 21:31:15.148225 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.148190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28ttg\" (UniqueName: \"kubernetes.io/projected/18bbc26a-b81d-443c-a5b2-a02ee5197da3-kube-api-access-28ttg\") pod \"kuadrant-console-plugin-66b5774985-hm7hx\" (UID: \"18bbc26a-b81d-443c-a5b2-a02ee5197da3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx" Jun 11 21:31:15.148225 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.148227 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18bbc26a-b81d-443c-a5b2-a02ee5197da3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hm7hx\" (UID: \"18bbc26a-b81d-443c-a5b2-a02ee5197da3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx" Jun 11 21:31:15.148469 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.148364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/18bbc26a-b81d-443c-a5b2-a02ee5197da3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hm7hx\" (UID: \"18bbc26a-b81d-443c-a5b2-a02ee5197da3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx" Jun 11 21:31:15.148896 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.148879 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18bbc26a-b81d-443c-a5b2-a02ee5197da3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hm7hx\" (UID: \"18bbc26a-b81d-443c-a5b2-a02ee5197da3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx" Jun 11 21:31:15.150874 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.150853 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/18bbc26a-b81d-443c-a5b2-a02ee5197da3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hm7hx\" (UID: \"18bbc26a-b81d-443c-a5b2-a02ee5197da3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx" Jun 11 21:31:15.161676 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.161656 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28ttg\" (UniqueName: \"kubernetes.io/projected/18bbc26a-b81d-443c-a5b2-a02ee5197da3-kube-api-access-28ttg\") pod \"kuadrant-console-plugin-66b5774985-hm7hx\" (UID: \"18bbc26a-b81d-443c-a5b2-a02ee5197da3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx" Jun 11 21:31:15.336548 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.336464 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx" Jun 11 21:31:15.470606 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:15.470532 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx"] Jun 11 21:31:15.473616 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:31:15.473587 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18bbc26a_b81d_443c_a5b2_a02ee5197da3.slice/crio-fe8da8074f5f13faf6c9091720d9c8e87d86479aada941130cf8090682a71a65 WatchSource:0}: Error finding container fe8da8074f5f13faf6c9091720d9c8e87d86479aada941130cf8090682a71a65: Status 404 returned error can't find the container with id fe8da8074f5f13faf6c9091720d9c8e87d86479aada941130cf8090682a71a65 Jun 11 21:31:16.468452 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:16.468398 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx" event={"ID":"18bbc26a-b81d-443c-a5b2-a02ee5197da3","Type":"ContainerStarted","Data":"fe8da8074f5f13faf6c9091720d9c8e87d86479aada941130cf8090682a71a65"} Jun 11 21:31:20.399966 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:20.399890 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-848788995f-5ggb9" podUID="3ba9e325-bda6-4ec4-9534-fc5c3b94abad" containerName="console" containerID="cri-o://ab73ad4ab6e0db0771261369d92144afc45ce0ad04630d629bbd10cd0e284da7" gracePeriod=15 Jun 11 21:31:20.432118 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:20.432084 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" Jun 11 21:31:21.518115 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.518078 2581 generic.go:356] "Generic (PLEG): container finished" podID="3ba9e325-bda6-4ec4-9534-fc5c3b94abad" containerID="ab73ad4ab6e0db0771261369d92144afc45ce0ad04630d629bbd10cd0e284da7" exitCode=0 Jun 11 21:31:21.518621 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.518204 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848788995f-5ggb9" event={"ID":"3ba9e325-bda6-4ec4-9534-fc5c3b94abad","Type":"ContainerDied","Data":"ab73ad4ab6e0db0771261369d92144afc45ce0ad04630d629bbd10cd0e284da7"} Jun 11 21:31:21.598700 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.598670 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:31:21.718222 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.718106 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-oauth-serving-cert\") pod \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " Jun 11 21:31:21.718222 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.718162 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-service-ca\") pod \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " Jun 11 21:31:21.718222 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.718188 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-serving-cert\") pod \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " Jun 11 21:31:21.718571 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.718247 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-config\") pod \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " Jun 11 21:31:21.718571 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.718265 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-oauth-config\") pod \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " Jun 11 21:31:21.718571 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.718295 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-trusted-ca-bundle\") pod \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " Jun 11 21:31:21.718571 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.718339 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x6fv\" (UniqueName: \"kubernetes.io/projected/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-kube-api-access-4x6fv\") pod \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\" (UID: \"3ba9e325-bda6-4ec4-9534-fc5c3b94abad\") " Jun 11 21:31:21.718788 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.718626 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-service-ca" (OuterVolumeSpecName: "service-ca") pod "3ba9e325-bda6-4ec4-9534-fc5c3b94abad" (UID: "3ba9e325-bda6-4ec4-9534-fc5c3b94abad"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:31:21.718788 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.718760 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-config" (OuterVolumeSpecName: "console-config") pod "3ba9e325-bda6-4ec4-9534-fc5c3b94abad" (UID: "3ba9e325-bda6-4ec4-9534-fc5c3b94abad"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:31:21.718897 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.718811 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3ba9e325-bda6-4ec4-9534-fc5c3b94abad" (UID: "3ba9e325-bda6-4ec4-9534-fc5c3b94abad"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:31:21.719042 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.719020 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3ba9e325-bda6-4ec4-9534-fc5c3b94abad" (UID: "3ba9e325-bda6-4ec4-9534-fc5c3b94abad"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:31:21.720581 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.720554 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3ba9e325-bda6-4ec4-9534-fc5c3b94abad" (UID: "3ba9e325-bda6-4ec4-9534-fc5c3b94abad"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:31:21.720685 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.720577 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3ba9e325-bda6-4ec4-9534-fc5c3b94abad" (UID: "3ba9e325-bda6-4ec4-9534-fc5c3b94abad"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:31:21.720685 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.720670 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-kube-api-access-4x6fv" (OuterVolumeSpecName: "kube-api-access-4x6fv") pod "3ba9e325-bda6-4ec4-9534-fc5c3b94abad" (UID: "3ba9e325-bda6-4ec4-9534-fc5c3b94abad"). InnerVolumeSpecName "kube-api-access-4x6fv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:31:21.819384 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.819330 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x6fv\" (UniqueName: \"kubernetes.io/projected/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-kube-api-access-4x6fv\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:31:21.819384 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.819377 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-oauth-serving-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:31:21.819384 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.819387 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-service-ca\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:31:21.819384 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.819423 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-serving-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:31:21.819702 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.819433 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-config\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:31:21.819702 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.819442 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-console-oauth-config\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:31:21.819702 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:21.819450 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba9e325-bda6-4ec4-9534-fc5c3b94abad-trusted-ca-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:31:22.526677 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:22.526632 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848788995f-5ggb9" Jun 11 21:31:22.527126 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:22.526632 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848788995f-5ggb9" event={"ID":"3ba9e325-bda6-4ec4-9534-fc5c3b94abad","Type":"ContainerDied","Data":"c4d3256e3b9f57cd967183bb22d377d38a569ec3917db5a72e20eb2d36005468"} Jun 11 21:31:22.527126 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:22.526795 2581 scope.go:117] "RemoveContainer" containerID="ab73ad4ab6e0db0771261369d92144afc45ce0ad04630d629bbd10cd0e284da7" Jun 11 21:31:22.553289 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:22.553260 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-848788995f-5ggb9"] Jun 11 21:31:22.558752 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:22.558726 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-848788995f-5ggb9"] Jun 11 21:31:22.709427 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:22.709376 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ba9e325-bda6-4ec4-9534-fc5c3b94abad" path="/var/lib/kubelet/pods/3ba9e325-bda6-4ec4-9534-fc5c3b94abad/volumes" Jun 11 21:31:24.880264 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:24.880079 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252"] Jun 11 21:31:24.880761 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:24.880318 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" podUID="e25086b2-f883-4a4a-b49e-a3d519bec1e3" containerName="manager" containerID="cri-o://36d18d76c4d149a311512346ad58fa93713aedcbe56ea4b5a3c41e81c8c3382c" gracePeriod=2 Jun 11 21:31:24.896764 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:31:24.896714 2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e25086b2-f883-4a4a-b49e-a3d519bec1e3\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-6c252\": pods \"limitador-operator-controller-manager-859d7b78bd-6c252\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" Jun 11 21:31:24.900228 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:24.900204 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252"] Jun 11 21:31:39.351951 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:39.351921 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" Jun 11 21:31:39.353937 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:31:39.353897 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6c252\" is forbidden: User \"system:node:ip-10-0-143-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-27.ec2.internal' and this object" podUID="e25086b2-f883-4a4a-b49e-a3d519bec1e3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" Jun 11 21:31:39.490649 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:39.490568 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7lpt\" (UniqueName: \"kubernetes.io/projected/e25086b2-f883-4a4a-b49e-a3d519bec1e3-kube-api-access-h7lpt\") pod \"e25086b2-f883-4a4a-b49e-a3d519bec1e3\" (UID: \"e25086b2-f883-4a4a-b49e-a3d519bec1e3\") " Jun 11 21:31:39.492653 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:39.492626 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e25086b2-f883-4a4a-b49e-a3d519bec1e3-kube-api-access-h7lpt" (OuterVolumeSpecName: "kube-api-access-h7lpt") pod "e25086b2-f883-4a4a-b49e-a3d519bec1e3" (UID: "e25086b2-f883-4a4a-b49e-a3d519bec1e3"). InnerVolumeSpecName "kube-api-access-h7lpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:31:39.591421 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:39.591367 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7lpt\" (UniqueName: \"kubernetes.io/projected/e25086b2-f883-4a4a-b49e-a3d519bec1e3-kube-api-access-h7lpt\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:31:39.643750 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:39.643707 2581 generic.go:356] "Generic (PLEG): container finished" podID="e25086b2-f883-4a4a-b49e-a3d519bec1e3" containerID="36d18d76c4d149a311512346ad58fa93713aedcbe56ea4b5a3c41e81c8c3382c" exitCode=0 Jun 11 21:31:39.643750 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:39.643751 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" Jun 11 21:31:39.643991 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:39.643812 2581 scope.go:117] "RemoveContainer" containerID="36d18d76c4d149a311512346ad58fa93713aedcbe56ea4b5a3c41e81c8c3382c" Jun 11 21:31:39.646062 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:31:39.646028 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6c252\" is forbidden: User \"system:node:ip-10-0-143-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-27.ec2.internal' and this object" podUID="e25086b2-f883-4a4a-b49e-a3d519bec1e3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" Jun 11 21:31:39.653329 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:39.653312 2581 scope.go:117] "RemoveContainer" containerID="36d18d76c4d149a311512346ad58fa93713aedcbe56ea4b5a3c41e81c8c3382c" Jun 11 21:31:39.653634 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:31:39.653610 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36d18d76c4d149a311512346ad58fa93713aedcbe56ea4b5a3c41e81c8c3382c\": container with ID starting with 36d18d76c4d149a311512346ad58fa93713aedcbe56ea4b5a3c41e81c8c3382c not found: ID does not exist" containerID="36d18d76c4d149a311512346ad58fa93713aedcbe56ea4b5a3c41e81c8c3382c" Jun 11 21:31:39.653692 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:39.653642 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36d18d76c4d149a311512346ad58fa93713aedcbe56ea4b5a3c41e81c8c3382c"} err="failed to get container status \"36d18d76c4d149a311512346ad58fa93713aedcbe56ea4b5a3c41e81c8c3382c\": rpc error: code = NotFound desc = could not find container \"36d18d76c4d149a311512346ad58fa93713aedcbe56ea4b5a3c41e81c8c3382c\": container with ID starting with 36d18d76c4d149a311512346ad58fa93713aedcbe56ea4b5a3c41e81c8c3382c not found: ID does not exist" Jun 11 21:31:39.653822 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:31:39.653803 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6c252\" is forbidden: User \"system:node:ip-10-0-143-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-27.ec2.internal' and this object" podUID="e25086b2-f883-4a4a-b49e-a3d519bec1e3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" Jun 11 21:31:40.651364 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:40.651329 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx" event={"ID":"18bbc26a-b81d-443c-a5b2-a02ee5197da3","Type":"ContainerStarted","Data":"bb4b197697492c1d0276ba97b05b296f4ddb185d85ba0fffd0841bf06db7b77e"} Jun 11 21:31:40.666738 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:40.666681 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hm7hx" podStartSLOduration=2.367985751 podStartE2EDuration="26.66666659s" totalImagesPullingTime="24.298680839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:31:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:40.664884785 +0000 UTC m=+672.438824740" watchObservedRunningTime="2026-06-11 21:31:40.66666659 +0000 UTC m=+672.440606524" Jun 11 21:31:40.666920 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:31:40.666764 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6c252\" is forbidden: User \"system:node:ip-10-0-143-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-27.ec2.internal' and this object" podUID="e25086b2-f883-4a4a-b49e-a3d519bec1e3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6c252" Jun 11 21:31:40.708310 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:40.708281 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e25086b2-f883-4a4a-b49e-a3d519bec1e3" path="/var/lib/kubelet/pods/e25086b2-f883-4a4a-b49e-a3d519bec1e3/volumes" Jun 11 21:31:57.092048 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.092015 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml"] Jun 11 21:31:57.092480 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.092372 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e25086b2-f883-4a4a-b49e-a3d519bec1e3" containerName="manager" Jun 11 21:31:57.092480 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.092384 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e25086b2-f883-4a4a-b49e-a3d519bec1e3" containerName="manager" Jun 11 21:31:57.092480 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.092397 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ba9e325-bda6-4ec4-9534-fc5c3b94abad" containerName="console" Jun 11 21:31:57.092480 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.092422 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ba9e325-bda6-4ec4-9534-fc5c3b94abad" containerName="console" Jun 11 21:31:57.092621 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.092487 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e25086b2-f883-4a4a-b49e-a3d519bec1e3" containerName="manager" Jun 11 21:31:57.092621 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.092499 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ba9e325-bda6-4ec4-9534-fc5c3b94abad" containerName="console" Jun 11 21:31:57.095324 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.095308 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.097692 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.097666 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-k8h4n\"" Jun 11 21:31:57.106677 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.106646 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml"] Jun 11 21:31:57.138532 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.138501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.138695 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.138544 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.138695 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.138573 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bb113c6-175d-42b3-a21c-63f28a914cbe-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.138695 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.138614 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lwlh\" (UniqueName: \"kubernetes.io/projected/0bb113c6-175d-42b3-a21c-63f28a914cbe-kube-api-access-8lwlh\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.138880 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.138730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.138880 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.138766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bb113c6-175d-42b3-a21c-63f28a914cbe-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.138880 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.138804 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.138880 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.138836 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.139075 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.138881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bb113c6-175d-42b3-a21c-63f28a914cbe-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.239670 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.239637 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.239857 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.239674 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bb113c6-175d-42b3-a21c-63f28a914cbe-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.239857 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.239700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.239857 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.239716 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.240042 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.239846 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bb113c6-175d-42b3-a21c-63f28a914cbe-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.240042 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.239949 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.240042 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.239993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.240042 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.240030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bb113c6-175d-42b3-a21c-63f28a914cbe-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.240042 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.240036 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.240329 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.240066 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lwlh\" (UniqueName: \"kubernetes.io/projected/0bb113c6-175d-42b3-a21c-63f28a914cbe-kube-api-access-8lwlh\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.240329 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.240106 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.240329 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.240166 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.240516 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.240450 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.240516 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.240479 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bb113c6-175d-42b3-a21c-63f28a914cbe-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.242204 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.242173 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bb113c6-175d-42b3-a21c-63f28a914cbe-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.242462 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.242446 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bb113c6-175d-42b3-a21c-63f28a914cbe-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.248788 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.248762 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bb113c6-175d-42b3-a21c-63f28a914cbe-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.249113 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.249093 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lwlh\" (UniqueName: \"kubernetes.io/projected/0bb113c6-175d-42b3-a21c-63f28a914cbe-kube-api-access-8lwlh\") pod \"maas-default-gateway-openshift-default-8559cd5744-kk2ml\" (UID: \"0bb113c6-175d-42b3-a21c-63f28a914cbe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.407023 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.406993 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:57.548775 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.548746 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml"] Jun 11 21:31:57.550648 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:31:57.550608 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb113c6_175d_42b3_a21c_63f28a914cbe.slice/crio-9fa3a5bbd02747919d5faaaa57118e6fceb0f723b5d0864b446824c6e3ec27d9 WatchSource:0}: Error finding container 9fa3a5bbd02747919d5faaaa57118e6fceb0f723b5d0864b446824c6e3ec27d9: Status 404 returned error can't find the container with id 9fa3a5bbd02747919d5faaaa57118e6fceb0f723b5d0864b446824c6e3ec27d9 Jun 11 21:31:57.552826 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.552785 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 21:31:57.552922 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.552864 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 21:31:57.552922 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.552894 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 21:31:57.752296 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.752001 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" event={"ID":"0bb113c6-175d-42b3-a21c-63f28a914cbe","Type":"ContainerStarted","Data":"6b5cf4df08419a0732010826c43d6fc307147ef0dda369393e1c4eab67e151d0"} Jun 11 21:31:57.752296 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.752068 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" event={"ID":"0bb113c6-175d-42b3-a21c-63f28a914cbe","Type":"ContainerStarted","Data":"9fa3a5bbd02747919d5faaaa57118e6fceb0f723b5d0864b446824c6e3ec27d9"} Jun 11 21:31:57.772925 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:57.772865 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" podStartSLOduration=0.772844658 podStartE2EDuration="772.844658ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:31:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:57.771716816 +0000 UTC m=+689.545656772" watchObservedRunningTime="2026-06-11 21:31:57.772844658 +0000 UTC m=+689.546784615" Jun 11 21:31:58.408112 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:58.408075 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:58.412638 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:58.412616 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:58.759097 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:58.759004 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:31:58.760049 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:31:58.760030 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:32:11.797449 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:11.797338 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:32:11.806319 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:11.806294 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-d487g" Jun 11 21:32:11.807061 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:11.807036 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:32:11.808521 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:11.808500 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 21:32:11.823506 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:11.823487 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:32:11.882132 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:11.882097 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lz2j\" (UniqueName: \"kubernetes.io/projected/1dcae654-278d-487c-a60f-160d9834b968-kube-api-access-5lz2j\") pod \"limitador-limitador-54d6d988d5-d487g\" (UID: \"1dcae654-278d-487c-a60f-160d9834b968\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d487g" Jun 11 21:32:11.882285 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:11.882137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1dcae654-278d-487c-a60f-160d9834b968-config-file\") pod \"limitador-limitador-54d6d988d5-d487g\" (UID: \"1dcae654-278d-487c-a60f-160d9834b968\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d487g" Jun 11 21:32:11.983454 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:11.983398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lz2j\" (UniqueName: \"kubernetes.io/projected/1dcae654-278d-487c-a60f-160d9834b968-kube-api-access-5lz2j\") pod \"limitador-limitador-54d6d988d5-d487g\" (UID: \"1dcae654-278d-487c-a60f-160d9834b968\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d487g" Jun 11 21:32:11.983454 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:11.983455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1dcae654-278d-487c-a60f-160d9834b968-config-file\") pod \"limitador-limitador-54d6d988d5-d487g\" (UID: \"1dcae654-278d-487c-a60f-160d9834b968\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d487g" Jun 11 21:32:11.984132 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:11.984110 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1dcae654-278d-487c-a60f-160d9834b968-config-file\") pod \"limitador-limitador-54d6d988d5-d487g\" (UID: \"1dcae654-278d-487c-a60f-160d9834b968\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d487g" Jun 11 21:32:11.991390 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:11.991369 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lz2j\" (UniqueName: \"kubernetes.io/projected/1dcae654-278d-487c-a60f-160d9834b968-kube-api-access-5lz2j\") pod \"limitador-limitador-54d6d988d5-d487g\" (UID: \"1dcae654-278d-487c-a60f-160d9834b968\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d487g" Jun 11 21:32:12.117694 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:12.117616 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-d487g" Jun 11 21:32:12.250303 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:12.250274 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:32:12.251539 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:32:12.251515 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dcae654_278d_487c_a60f_160d9834b968.slice/crio-d785ec0048f191f2dfb3e65a187e30e701189f6c30e594fcac0065aac0c76bf7 WatchSource:0}: Error finding container d785ec0048f191f2dfb3e65a187e30e701189f6c30e594fcac0065aac0c76bf7: Status 404 returned error can't find the container with id d785ec0048f191f2dfb3e65a187e30e701189f6c30e594fcac0065aac0c76bf7 Jun 11 21:32:12.396937 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:12.396907 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-cfzgl"] Jun 11 21:32:12.401090 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:12.400990 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cfzgl" Jun 11 21:32:12.403368 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:12.403343 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cfzgl"] Jun 11 21:32:12.403508 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:12.403354 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j4lm2\"" Jun 11 21:32:12.489990 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:12.489962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f6l9\" (UniqueName: \"kubernetes.io/projected/825f8f79-e878-442e-aaea-2ce56c1ab985-kube-api-access-8f6l9\") pod \"authorino-75d556bd77-cfzgl\" (UID: \"825f8f79-e878-442e-aaea-2ce56c1ab985\") " pod="kuadrant-system/authorino-75d556bd77-cfzgl" Jun 11 21:32:12.590724 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:12.590689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f6l9\" (UniqueName: \"kubernetes.io/projected/825f8f79-e878-442e-aaea-2ce56c1ab985-kube-api-access-8f6l9\") pod \"authorino-75d556bd77-cfzgl\" (UID: \"825f8f79-e878-442e-aaea-2ce56c1ab985\") " pod="kuadrant-system/authorino-75d556bd77-cfzgl" Jun 11 21:32:12.598537 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:12.598511 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f6l9\" (UniqueName: \"kubernetes.io/projected/825f8f79-e878-442e-aaea-2ce56c1ab985-kube-api-access-8f6l9\") pod \"authorino-75d556bd77-cfzgl\" (UID: \"825f8f79-e878-442e-aaea-2ce56c1ab985\") " pod="kuadrant-system/authorino-75d556bd77-cfzgl" Jun 11 21:32:12.711642 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:12.711370 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cfzgl" Jun 11 21:32:12.858119 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:12.858022 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-d487g" event={"ID":"1dcae654-278d-487c-a60f-160d9834b968","Type":"ContainerStarted","Data":"d785ec0048f191f2dfb3e65a187e30e701189f6c30e594fcac0065aac0c76bf7"} Jun 11 21:32:12.908786 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:12.908713 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cfzgl"] Jun 11 21:32:12.913903 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:32:12.913848 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod825f8f79_e878_442e_aaea_2ce56c1ab985.slice/crio-fdb8e51ec1651953ff66204d9837ab77668012fa6c5783e880dde9d40fc215f3 WatchSource:0}: Error finding container fdb8e51ec1651953ff66204d9837ab77668012fa6c5783e880dde9d40fc215f3: Status 404 returned error can't find the container with id fdb8e51ec1651953ff66204d9837ab77668012fa6c5783e880dde9d40fc215f3 Jun 11 21:32:13.866181 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:13.866136 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cfzgl" event={"ID":"825f8f79-e878-442e-aaea-2ce56c1ab985","Type":"ContainerStarted","Data":"fdb8e51ec1651953ff66204d9837ab77668012fa6c5783e880dde9d40fc215f3"} Jun 11 21:32:15.883380 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:15.883316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-d487g" event={"ID":"1dcae654-278d-487c-a60f-160d9834b968","Type":"ContainerStarted","Data":"340e29855ba6c0ee97a85406ba3cc08e9b32ac4e135d05661915ee077ae218b9"} Jun 11 21:32:15.883380 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:15.883390 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-d487g" Jun 11 21:32:15.901714 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:15.901656 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-d487g" podStartSLOduration=2.325945257 podStartE2EDuration="4.90163622s" totalImagesPullingTime="2.575690963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:32:15.898186316 +0000 UTC m=+707.672126293" watchObservedRunningTime="2026-06-11 21:32:15.90163622 +0000 UTC m=+707.675576190" Jun 11 21:32:17.895540 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:17.895503 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cfzgl" event={"ID":"825f8f79-e878-442e-aaea-2ce56c1ab985","Type":"ContainerStarted","Data":"efd01b1bdc3dbeecd682c2ab17666c82d095b9ab0c45293596cfdc2a93b85dec"} Jun 11 21:32:17.909326 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:17.909282 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-cfzgl" podStartSLOduration=1.928441249 podStartE2EDuration="5.909267774s" totalImagesPullingTime="3.980826525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:32:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:32:17.908002782 +0000 UTC m=+709.681942737" watchObservedRunningTime="2026-06-11 21:32:17.909267774 +0000 UTC m=+709.683207729" Jun 11 21:32:26.890126 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:26.890097 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-d487g" Jun 11 21:32:41.251490 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.251455 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq"] Jun 11 21:32:41.256494 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.256477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" Jun 11 21:32:41.259044 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.259025 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:32:41.259133 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.259047 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:32:41.259803 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.259791 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rw9rw\"" Jun 11 21:32:41.263300 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.263273 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq"] Jun 11 21:32:41.347481 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.347450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d2cd\" (UniqueName: \"kubernetes.io/projected/f88f827e-397e-4891-8886-27953dd04169-kube-api-access-8d2cd\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq\" (UID: \"f88f827e-397e-4891-8886-27953dd04169\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" Jun 11 21:32:41.347651 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.347488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f88f827e-397e-4891-8886-27953dd04169-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq\" (UID: \"f88f827e-397e-4891-8886-27953dd04169\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" Jun 11 21:32:41.347651 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.347561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f88f827e-397e-4891-8886-27953dd04169-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq\" (UID: \"f88f827e-397e-4891-8886-27953dd04169\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" Jun 11 21:32:41.448692 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.448655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2cd\" (UniqueName: \"kubernetes.io/projected/f88f827e-397e-4891-8886-27953dd04169-kube-api-access-8d2cd\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq\" (UID: \"f88f827e-397e-4891-8886-27953dd04169\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" Jun 11 21:32:41.448847 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.448701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f88f827e-397e-4891-8886-27953dd04169-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq\" (UID: \"f88f827e-397e-4891-8886-27953dd04169\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" Jun 11 21:32:41.448847 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.448741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f88f827e-397e-4891-8886-27953dd04169-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq\" (UID: \"f88f827e-397e-4891-8886-27953dd04169\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" Jun 11 21:32:41.449190 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.449167 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f88f827e-397e-4891-8886-27953dd04169-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq\" (UID: \"f88f827e-397e-4891-8886-27953dd04169\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" Jun 11 21:32:41.449237 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.449175 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f88f827e-397e-4891-8886-27953dd04169-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq\" (UID: \"f88f827e-397e-4891-8886-27953dd04169\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" Jun 11 21:32:41.464065 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.464036 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d2cd\" (UniqueName: \"kubernetes.io/projected/f88f827e-397e-4891-8886-27953dd04169-kube-api-access-8d2cd\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq\" (UID: \"f88f827e-397e-4891-8886-27953dd04169\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" Jun 11 21:32:41.567585 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.567499 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" Jun 11 21:32:41.697499 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:41.697472 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq"] Jun 11 21:32:41.698931 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:32:41.698902 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88f827e_397e_4891_8886_27953dd04169.slice/crio-63464ec8f4f90a5269fabdecd5574facf8bd746dc725df875dd855be96388175 WatchSource:0}: Error finding container 63464ec8f4f90a5269fabdecd5574facf8bd746dc725df875dd855be96388175: Status 404 returned error can't find the container with id 63464ec8f4f90a5269fabdecd5574facf8bd746dc725df875dd855be96388175 Jun 11 21:32:42.030598 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:42.030564 2581 generic.go:356] "Generic (PLEG): container finished" podID="f88f827e-397e-4891-8886-27953dd04169" containerID="b33b3caef57074d257fe1613cae812ff32a99e021dc2e3c8493fdbccda5e966d" exitCode=0 Jun 11 21:32:42.030809 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:42.030666 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" event={"ID":"f88f827e-397e-4891-8886-27953dd04169","Type":"ContainerDied","Data":"b33b3caef57074d257fe1613cae812ff32a99e021dc2e3c8493fdbccda5e966d"} Jun 11 21:32:42.030809 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:42.030717 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" event={"ID":"f88f827e-397e-4891-8886-27953dd04169","Type":"ContainerStarted","Data":"63464ec8f4f90a5269fabdecd5574facf8bd746dc725df875dd855be96388175"} Jun 11 21:32:42.031640 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:42.031624 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:32:43.038142 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:43.038052 2581 generic.go:356] "Generic (PLEG): container finished" podID="f88f827e-397e-4891-8886-27953dd04169" containerID="085a4827ffbc6d410f2444f9410cbad41469bb5463cdd068d36196d94c1c2fd8" exitCode=0 Jun 11 21:32:43.038594 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:43.038140 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" event={"ID":"f88f827e-397e-4891-8886-27953dd04169","Type":"ContainerDied","Data":"085a4827ffbc6d410f2444f9410cbad41469bb5463cdd068d36196d94c1c2fd8"} Jun 11 21:32:44.047919 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:44.047882 2581 generic.go:356] "Generic (PLEG): container finished" podID="f88f827e-397e-4891-8886-27953dd04169" containerID="c1f812bb57267aa56e696af57b04acaad60d59d34494307e174e03f309f141d6" exitCode=0 Jun 11 21:32:44.048454 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:44.047993 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" event={"ID":"f88f827e-397e-4891-8886-27953dd04169","Type":"ContainerDied","Data":"c1f812bb57267aa56e696af57b04acaad60d59d34494307e174e03f309f141d6"} Jun 11 21:32:45.196339 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:45.196312 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" Jun 11 21:32:45.286118 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:45.286090 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f88f827e-397e-4891-8886-27953dd04169-bundle\") pod \"f88f827e-397e-4891-8886-27953dd04169\" (UID: \"f88f827e-397e-4891-8886-27953dd04169\") " Jun 11 21:32:45.286118 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:45.286122 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f88f827e-397e-4891-8886-27953dd04169-util\") pod \"f88f827e-397e-4891-8886-27953dd04169\" (UID: \"f88f827e-397e-4891-8886-27953dd04169\") " Jun 11 21:32:45.286299 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:45.286165 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8d2cd\" (UniqueName: \"kubernetes.io/projected/f88f827e-397e-4891-8886-27953dd04169-kube-api-access-8d2cd\") pod \"f88f827e-397e-4891-8886-27953dd04169\" (UID: \"f88f827e-397e-4891-8886-27953dd04169\") " Jun 11 21:32:45.286605 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:45.286581 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f88f827e-397e-4891-8886-27953dd04169-bundle" (OuterVolumeSpecName: "bundle") pod "f88f827e-397e-4891-8886-27953dd04169" (UID: "f88f827e-397e-4891-8886-27953dd04169"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:32:45.288199 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:45.288169 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f88f827e-397e-4891-8886-27953dd04169-kube-api-access-8d2cd" (OuterVolumeSpecName: "kube-api-access-8d2cd") pod "f88f827e-397e-4891-8886-27953dd04169" (UID: "f88f827e-397e-4891-8886-27953dd04169"). InnerVolumeSpecName "kube-api-access-8d2cd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:32:45.291818 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:45.291794 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f88f827e-397e-4891-8886-27953dd04169-util" (OuterVolumeSpecName: "util") pod "f88f827e-397e-4891-8886-27953dd04169" (UID: "f88f827e-397e-4891-8886-27953dd04169"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:32:45.386820 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:45.386793 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f88f827e-397e-4891-8886-27953dd04169-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:32:45.386820 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:45.386817 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f88f827e-397e-4891-8886-27953dd04169-util\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:32:45.386985 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:45.386828 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d2cd\" (UniqueName: \"kubernetes.io/projected/f88f827e-397e-4891-8886-27953dd04169-kube-api-access-8d2cd\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:32:46.062002 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:46.061963 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" event={"ID":"f88f827e-397e-4891-8886-27953dd04169","Type":"ContainerDied","Data":"63464ec8f4f90a5269fabdecd5574facf8bd746dc725df875dd855be96388175"} Jun 11 21:32:46.062176 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:46.062020 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63464ec8f4f90a5269fabdecd5574facf8bd746dc725df875dd855be96388175" Jun 11 21:32:46.062176 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:32:46.061977 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cv4lq" Jun 11 21:33:35.667473 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.667437 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8srgw"] Jun 11 21:33:35.667952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.667851 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88f827e-397e-4891-8886-27953dd04169" containerName="extract" Jun 11 21:33:35.667952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.667863 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88f827e-397e-4891-8886-27953dd04169" containerName="extract" Jun 11 21:33:35.667952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.667887 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88f827e-397e-4891-8886-27953dd04169" containerName="util" Jun 11 21:33:35.667952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.667896 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88f827e-397e-4891-8886-27953dd04169" containerName="util" Jun 11 21:33:35.667952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.667905 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88f827e-397e-4891-8886-27953dd04169" containerName="pull" Jun 11 21:33:35.667952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.667912 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88f827e-397e-4891-8886-27953dd04169" containerName="pull" Jun 11 21:33:35.668145 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.667987 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f88f827e-397e-4891-8886-27953dd04169" containerName="extract" Jun 11 21:33:35.671569 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.671553 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8srgw" Jun 11 21:33:35.680381 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.680355 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8srgw"] Jun 11 21:33:35.721756 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.721724 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhm4q\" (UniqueName: \"kubernetes.io/projected/37ed8caf-a8c9-4111-87fc-f51880cc5ed1-kube-api-access-fhm4q\") pod \"authorino-5d4b67c446-8srgw\" (UID: \"37ed8caf-a8c9-4111-87fc-f51880cc5ed1\") " pod="kuadrant-system/authorino-5d4b67c446-8srgw" Jun 11 21:33:35.822862 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.822830 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhm4q\" (UniqueName: \"kubernetes.io/projected/37ed8caf-a8c9-4111-87fc-f51880cc5ed1-kube-api-access-fhm4q\") pod \"authorino-5d4b67c446-8srgw\" (UID: \"37ed8caf-a8c9-4111-87fc-f51880cc5ed1\") " pod="kuadrant-system/authorino-5d4b67c446-8srgw" Jun 11 21:33:35.831554 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.831520 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhm4q\" (UniqueName: \"kubernetes.io/projected/37ed8caf-a8c9-4111-87fc-f51880cc5ed1-kube-api-access-fhm4q\") pod \"authorino-5d4b67c446-8srgw\" (UID: \"37ed8caf-a8c9-4111-87fc-f51880cc5ed1\") " pod="kuadrant-system/authorino-5d4b67c446-8srgw" Jun 11 21:33:35.888704 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.888671 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8srgw"] Jun 11 21:33:35.888960 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.888948 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8srgw" Jun 11 21:33:35.913462 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.913438 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-jl4gj"] Jun 11 21:33:35.917252 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.917232 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-jl4gj" Jun 11 21:33:35.920221 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.919766 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 21:33:35.923432 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.923392 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-jl4gj"] Jun 11 21:33:35.938527 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.938503 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-jl4gj"] Jun 11 21:33:35.938781 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:33:35.938760 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-l8v6r tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-l8v6r tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-jl4gj" podUID="083de4bf-4c87-4a34-bd8e-11d88d4d2e20" Jun 11 21:33:35.962699 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.962667 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b97b4877d-7l2rp"] Jun 11 21:33:35.966210 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.966190 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b97b4877d-7l2rp" Jun 11 21:33:35.973294 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:35.973271 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b97b4877d-7l2rp"] Jun 11 21:33:36.024936 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.024908 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4765\" (UniqueName: \"kubernetes.io/projected/e9d31a34-b188-41d1-9a64-c92d411f1e01-kube-api-access-g4765\") pod \"authorino-7b97b4877d-7l2rp\" (UID: \"e9d31a34-b188-41d1-9a64-c92d411f1e01\") " pod="kuadrant-system/authorino-7b97b4877d-7l2rp" Jun 11 21:33:36.025081 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.024946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8v6r\" (UniqueName: \"kubernetes.io/projected/083de4bf-4c87-4a34-bd8e-11d88d4d2e20-kube-api-access-l8v6r\") pod \"authorino-76877994-jl4gj\" (UID: \"083de4bf-4c87-4a34-bd8e-11d88d4d2e20\") " pod="kuadrant-system/authorino-76877994-jl4gj" Jun 11 21:33:36.025081 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.025046 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/083de4bf-4c87-4a34-bd8e-11d88d4d2e20-tls-cert\") pod \"authorino-76877994-jl4gj\" (UID: \"083de4bf-4c87-4a34-bd8e-11d88d4d2e20\") " pod="kuadrant-system/authorino-76877994-jl4gj" Jun 11 21:33:36.025081 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.025069 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e9d31a34-b188-41d1-9a64-c92d411f1e01-tls-cert\") pod \"authorino-7b97b4877d-7l2rp\" (UID: \"e9d31a34-b188-41d1-9a64-c92d411f1e01\") " pod="kuadrant-system/authorino-7b97b4877d-7l2rp" Jun 11 21:33:36.033246 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.033223 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8srgw"] Jun 11 21:33:36.035107 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:33:36.035082 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37ed8caf_a8c9_4111_87fc_f51880cc5ed1.slice/crio-fafe537644f24dcebf956e63fe90ef1a1a6143cb58aff0738f7b18e5fa5b702e WatchSource:0}: Error finding container fafe537644f24dcebf956e63fe90ef1a1a6143cb58aff0738f7b18e5fa5b702e: Status 404 returned error can't find the container with id fafe537644f24dcebf956e63fe90ef1a1a6143cb58aff0738f7b18e5fa5b702e Jun 11 21:33:36.125581 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.125546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/083de4bf-4c87-4a34-bd8e-11d88d4d2e20-tls-cert\") pod \"authorino-76877994-jl4gj\" (UID: \"083de4bf-4c87-4a34-bd8e-11d88d4d2e20\") " pod="kuadrant-system/authorino-76877994-jl4gj" Jun 11 21:33:36.125761 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.125588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e9d31a34-b188-41d1-9a64-c92d411f1e01-tls-cert\") pod \"authorino-7b97b4877d-7l2rp\" (UID: \"e9d31a34-b188-41d1-9a64-c92d411f1e01\") " pod="kuadrant-system/authorino-7b97b4877d-7l2rp" Jun 11 21:33:36.125761 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.125627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4765\" (UniqueName: \"kubernetes.io/projected/e9d31a34-b188-41d1-9a64-c92d411f1e01-kube-api-access-g4765\") pod \"authorino-7b97b4877d-7l2rp\" (UID: \"e9d31a34-b188-41d1-9a64-c92d411f1e01\") " pod="kuadrant-system/authorino-7b97b4877d-7l2rp" Jun 11 21:33:36.125761 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.125666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8v6r\" (UniqueName: \"kubernetes.io/projected/083de4bf-4c87-4a34-bd8e-11d88d4d2e20-kube-api-access-l8v6r\") pod \"authorino-76877994-jl4gj\" (UID: \"083de4bf-4c87-4a34-bd8e-11d88d4d2e20\") " pod="kuadrant-system/authorino-76877994-jl4gj" Jun 11 21:33:36.128033 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.128006 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e9d31a34-b188-41d1-9a64-c92d411f1e01-tls-cert\") pod \"authorino-7b97b4877d-7l2rp\" (UID: \"e9d31a34-b188-41d1-9a64-c92d411f1e01\") " pod="kuadrant-system/authorino-7b97b4877d-7l2rp" Jun 11 21:33:36.128161 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.128141 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/083de4bf-4c87-4a34-bd8e-11d88d4d2e20-tls-cert\") pod \"authorino-76877994-jl4gj\" (UID: \"083de4bf-4c87-4a34-bd8e-11d88d4d2e20\") " pod="kuadrant-system/authorino-76877994-jl4gj" Jun 11 21:33:36.133136 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.133110 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8v6r\" (UniqueName: \"kubernetes.io/projected/083de4bf-4c87-4a34-bd8e-11d88d4d2e20-kube-api-access-l8v6r\") pod \"authorino-76877994-jl4gj\" (UID: \"083de4bf-4c87-4a34-bd8e-11d88d4d2e20\") " pod="kuadrant-system/authorino-76877994-jl4gj" Jun 11 21:33:36.133442 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.133388 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4765\" (UniqueName: \"kubernetes.io/projected/e9d31a34-b188-41d1-9a64-c92d411f1e01-kube-api-access-g4765\") pod \"authorino-7b97b4877d-7l2rp\" (UID: \"e9d31a34-b188-41d1-9a64-c92d411f1e01\") " pod="kuadrant-system/authorino-7b97b4877d-7l2rp" Jun 11 21:33:36.277173 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.277075 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b97b4877d-7l2rp" Jun 11 21:33:36.345313 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.345270 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8srgw" event={"ID":"37ed8caf-a8c9-4111-87fc-f51880cc5ed1","Type":"ContainerStarted","Data":"fafe537644f24dcebf956e63fe90ef1a1a6143cb58aff0738f7b18e5fa5b702e"} Jun 11 21:33:36.345469 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.345391 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-jl4gj" Jun 11 21:33:36.353469 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.353444 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-jl4gj" Jun 11 21:33:36.416871 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.416833 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b97b4877d-7l2rp"] Jun 11 21:33:36.417756 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:33:36.417725 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9d31a34_b188_41d1_9a64_c92d411f1e01.slice/crio-a631fabbc92b8f9e649f22ea4c8225a0990a336eda7c791691304ad754b066c1 WatchSource:0}: Error finding container a631fabbc92b8f9e649f22ea4c8225a0990a336eda7c791691304ad754b066c1: Status 404 returned error can't find the container with id a631fabbc92b8f9e649f22ea4c8225a0990a336eda7c791691304ad754b066c1 Jun 11 21:33:36.428385 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.428364 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8v6r\" (UniqueName: \"kubernetes.io/projected/083de4bf-4c87-4a34-bd8e-11d88d4d2e20-kube-api-access-l8v6r\") pod \"083de4bf-4c87-4a34-bd8e-11d88d4d2e20\" (UID: \"083de4bf-4c87-4a34-bd8e-11d88d4d2e20\") " Jun 11 21:33:36.428504 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.428427 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/083de4bf-4c87-4a34-bd8e-11d88d4d2e20-tls-cert\") pod \"083de4bf-4c87-4a34-bd8e-11d88d4d2e20\" (UID: \"083de4bf-4c87-4a34-bd8e-11d88d4d2e20\") " Jun 11 21:33:36.430538 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.430514 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/083de4bf-4c87-4a34-bd8e-11d88d4d2e20-kube-api-access-l8v6r" (OuterVolumeSpecName: "kube-api-access-l8v6r") pod "083de4bf-4c87-4a34-bd8e-11d88d4d2e20" (UID: "083de4bf-4c87-4a34-bd8e-11d88d4d2e20"). InnerVolumeSpecName "kube-api-access-l8v6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:33:36.430651 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.430599 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/083de4bf-4c87-4a34-bd8e-11d88d4d2e20-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "083de4bf-4c87-4a34-bd8e-11d88d4d2e20" (UID: "083de4bf-4c87-4a34-bd8e-11d88d4d2e20"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:33:36.529746 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.529666 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8v6r\" (UniqueName: \"kubernetes.io/projected/083de4bf-4c87-4a34-bd8e-11d88d4d2e20-kube-api-access-l8v6r\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:33:36.529746 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:36.529692 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/083de4bf-4c87-4a34-bd8e-11d88d4d2e20-tls-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:33:37.353098 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.353061 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8srgw" event={"ID":"37ed8caf-a8c9-4111-87fc-f51880cc5ed1","Type":"ContainerStarted","Data":"7eed4f31a45378c35b16fb8d55512a10fb6808af4c255e7bc579a9fda6f511be"} Jun 11 21:33:37.353098 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.353071 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-8srgw" podUID="37ed8caf-a8c9-4111-87fc-f51880cc5ed1" containerName="authorino" containerID="cri-o://7eed4f31a45378c35b16fb8d55512a10fb6808af4c255e7bc579a9fda6f511be" gracePeriod=30 Jun 11 21:33:37.354797 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.354779 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-jl4gj" Jun 11 21:33:37.354797 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.354789 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b97b4877d-7l2rp" event={"ID":"e9d31a34-b188-41d1-9a64-c92d411f1e01","Type":"ContainerStarted","Data":"b332c7c4c06ee35f8c70f3849edd236ee14edea25e27bb06696777d8650d1323"} Jun 11 21:33:37.354953 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.354820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b97b4877d-7l2rp" event={"ID":"e9d31a34-b188-41d1-9a64-c92d411f1e01","Type":"ContainerStarted","Data":"a631fabbc92b8f9e649f22ea4c8225a0990a336eda7c791691304ad754b066c1"} Jun 11 21:33:37.367470 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.367395 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-8srgw" podStartSLOduration=2.023866212 podStartE2EDuration="2.36737783s" totalImagesPullingTime="343.511618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:33:37.36704007 +0000 UTC m=+789.140980043" watchObservedRunningTime="2026-06-11 21:33:37.36737783 +0000 UTC m=+789.141317787" Jun 11 21:33:37.382386 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.382343 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b97b4877d-7l2rp" podStartSLOduration=2.051472841 podStartE2EDuration="2.38232985s" totalImagesPullingTime="330.857009ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:33:37.380472657 +0000 UTC m=+789.154412660" watchObservedRunningTime="2026-06-11 21:33:37.38232985 +0000 UTC m=+789.156269805" Jun 11 21:33:37.406488 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.406460 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-jl4gj"] Jun 11 21:33:37.412728 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.412704 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-jl4gj"] Jun 11 21:33:37.415133 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.415105 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cfzgl"] Jun 11 21:33:37.415280 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.415260 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-cfzgl" podUID="825f8f79-e878-442e-aaea-2ce56c1ab985" containerName="authorino" containerID="cri-o://efd01b1bdc3dbeecd682c2ab17666c82d095b9ab0c45293596cfdc2a93b85dec" gracePeriod=30 Jun 11 21:33:37.684031 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.684009 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8srgw" Jun 11 21:33:37.687041 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.687021 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cfzgl" Jun 11 21:33:37.742278 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.742247 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f6l9\" (UniqueName: \"kubernetes.io/projected/825f8f79-e878-442e-aaea-2ce56c1ab985-kube-api-access-8f6l9\") pod \"825f8f79-e878-442e-aaea-2ce56c1ab985\" (UID: \"825f8f79-e878-442e-aaea-2ce56c1ab985\") " Jun 11 21:33:37.742278 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.742284 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhm4q\" (UniqueName: \"kubernetes.io/projected/37ed8caf-a8c9-4111-87fc-f51880cc5ed1-kube-api-access-fhm4q\") pod \"37ed8caf-a8c9-4111-87fc-f51880cc5ed1\" (UID: \"37ed8caf-a8c9-4111-87fc-f51880cc5ed1\") " Jun 11 21:33:37.744425 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.744375 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37ed8caf-a8c9-4111-87fc-f51880cc5ed1-kube-api-access-fhm4q" (OuterVolumeSpecName: "kube-api-access-fhm4q") pod "37ed8caf-a8c9-4111-87fc-f51880cc5ed1" (UID: "37ed8caf-a8c9-4111-87fc-f51880cc5ed1"). InnerVolumeSpecName "kube-api-access-fhm4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:33:37.744541 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.744463 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/825f8f79-e878-442e-aaea-2ce56c1ab985-kube-api-access-8f6l9" (OuterVolumeSpecName: "kube-api-access-8f6l9") pod "825f8f79-e878-442e-aaea-2ce56c1ab985" (UID: "825f8f79-e878-442e-aaea-2ce56c1ab985"). InnerVolumeSpecName "kube-api-access-8f6l9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:33:37.843474 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.843445 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f6l9\" (UniqueName: \"kubernetes.io/projected/825f8f79-e878-442e-aaea-2ce56c1ab985-kube-api-access-8f6l9\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:33:37.843474 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:37.843472 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhm4q\" (UniqueName: \"kubernetes.io/projected/37ed8caf-a8c9-4111-87fc-f51880cc5ed1-kube-api-access-fhm4q\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:33:38.361317 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.361285 2581 generic.go:356] "Generic (PLEG): container finished" podID="825f8f79-e878-442e-aaea-2ce56c1ab985" containerID="efd01b1bdc3dbeecd682c2ab17666c82d095b9ab0c45293596cfdc2a93b85dec" exitCode=0 Jun 11 21:33:38.361768 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.361322 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cfzgl" Jun 11 21:33:38.361768 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.361347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cfzgl" event={"ID":"825f8f79-e878-442e-aaea-2ce56c1ab985","Type":"ContainerDied","Data":"efd01b1bdc3dbeecd682c2ab17666c82d095b9ab0c45293596cfdc2a93b85dec"} Jun 11 21:33:38.361768 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.361388 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cfzgl" event={"ID":"825f8f79-e878-442e-aaea-2ce56c1ab985","Type":"ContainerDied","Data":"fdb8e51ec1651953ff66204d9837ab77668012fa6c5783e880dde9d40fc215f3"} Jun 11 21:33:38.361768 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.361432 2581 scope.go:117] "RemoveContainer" containerID="efd01b1bdc3dbeecd682c2ab17666c82d095b9ab0c45293596cfdc2a93b85dec" Jun 11 21:33:38.362832 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.362809 2581 generic.go:356] "Generic (PLEG): container finished" podID="37ed8caf-a8c9-4111-87fc-f51880cc5ed1" containerID="7eed4f31a45378c35b16fb8d55512a10fb6808af4c255e7bc579a9fda6f511be" exitCode=0 Jun 11 21:33:38.362964 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.362843 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8srgw" Jun 11 21:33:38.362964 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.362842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8srgw" event={"ID":"37ed8caf-a8c9-4111-87fc-f51880cc5ed1","Type":"ContainerDied","Data":"7eed4f31a45378c35b16fb8d55512a10fb6808af4c255e7bc579a9fda6f511be"} Jun 11 21:33:38.362964 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.362884 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8srgw" event={"ID":"37ed8caf-a8c9-4111-87fc-f51880cc5ed1","Type":"ContainerDied","Data":"fafe537644f24dcebf956e63fe90ef1a1a6143cb58aff0738f7b18e5fa5b702e"} Jun 11 21:33:38.374426 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.374166 2581 scope.go:117] "RemoveContainer" containerID="efd01b1bdc3dbeecd682c2ab17666c82d095b9ab0c45293596cfdc2a93b85dec" Jun 11 21:33:38.374584 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:33:38.374562 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efd01b1bdc3dbeecd682c2ab17666c82d095b9ab0c45293596cfdc2a93b85dec\": container with ID starting with efd01b1bdc3dbeecd682c2ab17666c82d095b9ab0c45293596cfdc2a93b85dec not found: ID does not exist" containerID="efd01b1bdc3dbeecd682c2ab17666c82d095b9ab0c45293596cfdc2a93b85dec" Jun 11 21:33:38.374654 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.374595 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efd01b1bdc3dbeecd682c2ab17666c82d095b9ab0c45293596cfdc2a93b85dec"} err="failed to get container status \"efd01b1bdc3dbeecd682c2ab17666c82d095b9ab0c45293596cfdc2a93b85dec\": rpc error: code = NotFound desc = could not find container \"efd01b1bdc3dbeecd682c2ab17666c82d095b9ab0c45293596cfdc2a93b85dec\": container with ID starting with efd01b1bdc3dbeecd682c2ab17666c82d095b9ab0c45293596cfdc2a93b85dec not found: ID does not exist" Jun 11 21:33:38.374654 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.374616 2581 scope.go:117] "RemoveContainer" containerID="7eed4f31a45378c35b16fb8d55512a10fb6808af4c255e7bc579a9fda6f511be" Jun 11 21:33:38.383450 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.383426 2581 scope.go:117] "RemoveContainer" containerID="7eed4f31a45378c35b16fb8d55512a10fb6808af4c255e7bc579a9fda6f511be" Jun 11 21:33:38.383704 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:33:38.383686 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eed4f31a45378c35b16fb8d55512a10fb6808af4c255e7bc579a9fda6f511be\": container with ID starting with 7eed4f31a45378c35b16fb8d55512a10fb6808af4c255e7bc579a9fda6f511be not found: ID does not exist" containerID="7eed4f31a45378c35b16fb8d55512a10fb6808af4c255e7bc579a9fda6f511be" Jun 11 21:33:38.383759 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.383710 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eed4f31a45378c35b16fb8d55512a10fb6808af4c255e7bc579a9fda6f511be"} err="failed to get container status \"7eed4f31a45378c35b16fb8d55512a10fb6808af4c255e7bc579a9fda6f511be\": rpc error: code = NotFound desc = could not find container \"7eed4f31a45378c35b16fb8d55512a10fb6808af4c255e7bc579a9fda6f511be\": container with ID starting with 7eed4f31a45378c35b16fb8d55512a10fb6808af4c255e7bc579a9fda6f511be not found: ID does not exist" Jun 11 21:33:38.385178 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.385159 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cfzgl"] Jun 11 21:33:38.390340 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.390324 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cfzgl"] Jun 11 21:33:38.398634 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.398614 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8srgw"] Jun 11 21:33:38.402412 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.402385 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8srgw"] Jun 11 21:33:38.707677 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.707648 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="083de4bf-4c87-4a34-bd8e-11d88d4d2e20" path="/var/lib/kubelet/pods/083de4bf-4c87-4a34-bd8e-11d88d4d2e20/volumes" Jun 11 21:33:38.707892 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.707877 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37ed8caf-a8c9-4111-87fc-f51880cc5ed1" path="/var/lib/kubelet/pods/37ed8caf-a8c9-4111-87fc-f51880cc5ed1/volumes" Jun 11 21:33:38.708185 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:38.708172 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="825f8f79-e878-442e-aaea-2ce56c1ab985" path="/var/lib/kubelet/pods/825f8f79-e878-442e-aaea-2ce56c1ab985/volumes" Jun 11 21:33:41.248060 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.248016 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f5bf9f677-p58f6"] Jun 11 21:33:41.248442 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.248396 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37ed8caf-a8c9-4111-87fc-f51880cc5ed1" containerName="authorino" Jun 11 21:33:41.248442 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.248421 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37ed8caf-a8c9-4111-87fc-f51880cc5ed1" containerName="authorino" Jun 11 21:33:41.248534 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.248445 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825f8f79-e878-442e-aaea-2ce56c1ab985" containerName="authorino" Jun 11 21:33:41.248534 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.248451 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="825f8f79-e878-442e-aaea-2ce56c1ab985" containerName="authorino" Jun 11 21:33:41.248534 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.248509 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="825f8f79-e878-442e-aaea-2ce56c1ab985" containerName="authorino" Jun 11 21:33:41.248534 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.248517 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="37ed8caf-a8c9-4111-87fc-f51880cc5ed1" containerName="authorino" Jun 11 21:33:41.252789 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.252773 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f5bf9f677-p58f6" Jun 11 21:33:41.256687 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.256667 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 21:33:41.256687 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.256686 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d7k2k\"" Jun 11 21:33:41.256843 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.256729 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 21:33:41.263939 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.263914 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f5bf9f677-p58f6"] Jun 11 21:33:41.376691 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.376662 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cc679c7-1274-40b3-a860-e3a46f9c0f23-webhook-cert\") pod \"maas-controller-f5bf9f677-p58f6\" (UID: \"6cc679c7-1274-40b3-a860-e3a46f9c0f23\") " pod="opendatahub/maas-controller-f5bf9f677-p58f6" Jun 11 21:33:41.376861 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.376714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hkwx\" (UniqueName: \"kubernetes.io/projected/6cc679c7-1274-40b3-a860-e3a46f9c0f23-kube-api-access-7hkwx\") pod \"maas-controller-f5bf9f677-p58f6\" (UID: \"6cc679c7-1274-40b3-a860-e3a46f9c0f23\") " pod="opendatahub/maas-controller-f5bf9f677-p58f6" Jun 11 21:33:41.477848 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.477818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cc679c7-1274-40b3-a860-e3a46f9c0f23-webhook-cert\") pod \"maas-controller-f5bf9f677-p58f6\" (UID: \"6cc679c7-1274-40b3-a860-e3a46f9c0f23\") " pod="opendatahub/maas-controller-f5bf9f677-p58f6" Jun 11 21:33:41.478013 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.477870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hkwx\" (UniqueName: \"kubernetes.io/projected/6cc679c7-1274-40b3-a860-e3a46f9c0f23-kube-api-access-7hkwx\") pod \"maas-controller-f5bf9f677-p58f6\" (UID: \"6cc679c7-1274-40b3-a860-e3a46f9c0f23\") " pod="opendatahub/maas-controller-f5bf9f677-p58f6" Jun 11 21:33:41.480322 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.480289 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cc679c7-1274-40b3-a860-e3a46f9c0f23-webhook-cert\") pod \"maas-controller-f5bf9f677-p58f6\" (UID: \"6cc679c7-1274-40b3-a860-e3a46f9c0f23\") " pod="opendatahub/maas-controller-f5bf9f677-p58f6" Jun 11 21:33:41.485082 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.485060 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hkwx\" (UniqueName: \"kubernetes.io/projected/6cc679c7-1274-40b3-a860-e3a46f9c0f23-kube-api-access-7hkwx\") pod \"maas-controller-f5bf9f677-p58f6\" (UID: \"6cc679c7-1274-40b3-a860-e3a46f9c0f23\") " pod="opendatahub/maas-controller-f5bf9f677-p58f6" Jun 11 21:33:41.563830 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.563729 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f5bf9f677-p58f6" Jun 11 21:33:41.693963 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:41.693935 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f5bf9f677-p58f6"] Jun 11 21:33:41.695247 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:33:41.695223 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc679c7_1274_40b3_a860_e3a46f9c0f23.slice/crio-7ee3c24c4ee825ca9774ee6d004e9d407b215d69e83b6017751aed952c6c2445 WatchSource:0}: Error finding container 7ee3c24c4ee825ca9774ee6d004e9d407b215d69e83b6017751aed952c6c2445: Status 404 returned error can't find the container with id 7ee3c24c4ee825ca9774ee6d004e9d407b215d69e83b6017751aed952c6c2445 Jun 11 21:33:42.391900 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:42.391852 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f5bf9f677-p58f6" event={"ID":"6cc679c7-1274-40b3-a860-e3a46f9c0f23","Type":"ContainerStarted","Data":"7ee3c24c4ee825ca9774ee6d004e9d407b215d69e83b6017751aed952c6c2445"} Jun 11 21:33:44.408082 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:44.408038 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f5bf9f677-p58f6" event={"ID":"6cc679c7-1274-40b3-a860-e3a46f9c0f23","Type":"ContainerStarted","Data":"b30ce8bb8eb1715d683a17536cb22920e4070f611999c6ab7a6c6f2a95401f4f"} Jun 11 21:33:44.408643 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:44.408239 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f5bf9f677-p58f6" Jun 11 21:33:44.426328 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:44.426276 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f5bf9f677-p58f6" podStartSLOduration=1.035016721 podStartE2EDuration="3.426260307s" totalImagesPullingTime="2.391243586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:33:44.424613974 +0000 UTC m=+796.198553953" watchObservedRunningTime="2026-06-11 21:33:44.426260307 +0000 UTC m=+796.200200264" Jun 11 21:33:55.418955 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:33:55.418920 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f5bf9f677-p58f6" Jun 11 21:34:15.933652 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:15.933613 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:34:23.631209 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:23.631174 2581 generic.go:356] "Generic (PLEG): container finished" podID="0bb113c6-175d-42b3-a21c-63f28a914cbe" containerID="6b5cf4df08419a0732010826c43d6fc307147ef0dda369393e1c4eab67e151d0" exitCode=0 Jun 11 21:34:23.631688 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:23.631246 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" event={"ID":"0bb113c6-175d-42b3-a21c-63f28a914cbe","Type":"ContainerDied","Data":"6b5cf4df08419a0732010826c43d6fc307147ef0dda369393e1c4eab67e151d0"} Jun 11 21:34:23.631688 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:23.631638 2581 scope.go:117] "RemoveContainer" containerID="6b5cf4df08419a0732010826c43d6fc307147ef0dda369393e1c4eab67e151d0" Jun 11 21:34:23.632591 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:23.632564 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 21:34:23.632669 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:23.632628 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 21:34:23.632669 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:23.632660 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 21:34:24.647286 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:24.647239 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" event={"ID":"0bb113c6-175d-42b3-a21c-63f28a914cbe","Type":"ContainerStarted","Data":"7332f6605681cd83be719a5953549bd2f84f76335ffd6d564ae1265a59c7cf67"} Jun 11 21:34:25.407777 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:25.407743 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:34:25.409071 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:25.409040 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-kk2ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jun 11 21:34:25.409216 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:25.409099 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" podUID="0bb113c6-175d-42b3-a21c-63f28a914cbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jun 11 21:34:26.408095 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:26.408057 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-kk2ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jun 11 21:34:26.408509 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:26.408131 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" podUID="0bb113c6-175d-42b3-a21c-63f28a914cbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jun 11 21:34:27.407636 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:27.407602 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-kk2ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jun 11 21:34:27.407821 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:27.407655 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" podUID="0bb113c6-175d-42b3-a21c-63f28a914cbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jun 11 21:34:28.407365 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:28.407331 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-kk2ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jun 11 21:34:28.407856 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:28.407395 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" podUID="0bb113c6-175d-42b3-a21c-63f28a914cbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jun 11 21:34:28.759796 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:28.759726 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:34:29.411949 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:29.411919 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:34:29.677040 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:34:29.676960 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kk2ml" Jun 11 21:35:28.735292 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:35:28.735206 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:35:28.736353 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:35:28.736329 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:37:07.904074 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:07.904036 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c88857bd8-pq4sq"] Jun 11 21:37:07.908667 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:07.908642 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c88857bd8-pq4sq" Jun 11 21:37:07.910943 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:07.910921 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 21:37:07.911614 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:07.911588 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c88857bd8-pq4sq"] Jun 11 21:37:08.001367 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:08.001335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5845049-deec-4ed2-bdc6-4c506a8ba09e-tls-cert\") pod \"authorino-c88857bd8-pq4sq\" (UID: \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\") " pod="kuadrant-system/authorino-c88857bd8-pq4sq" Jun 11 21:37:08.001591 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:08.001471 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d5845049-deec-4ed2-bdc6-4c506a8ba09e-oidc-ca\") pod \"authorino-c88857bd8-pq4sq\" (UID: \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\") " pod="kuadrant-system/authorino-c88857bd8-pq4sq" Jun 11 21:37:08.001591 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:08.001531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrmvj\" (UniqueName: \"kubernetes.io/projected/d5845049-deec-4ed2-bdc6-4c506a8ba09e-kube-api-access-jrmvj\") pod \"authorino-c88857bd8-pq4sq\" (UID: \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\") " pod="kuadrant-system/authorino-c88857bd8-pq4sq" Jun 11 21:37:08.102145 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:08.102104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrmvj\" (UniqueName: \"kubernetes.io/projected/d5845049-deec-4ed2-bdc6-4c506a8ba09e-kube-api-access-jrmvj\") pod \"authorino-c88857bd8-pq4sq\" (UID: \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\") " pod="kuadrant-system/authorino-c88857bd8-pq4sq" Jun 11 21:37:08.102321 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:08.102269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5845049-deec-4ed2-bdc6-4c506a8ba09e-tls-cert\") pod \"authorino-c88857bd8-pq4sq\" (UID: \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\") " pod="kuadrant-system/authorino-c88857bd8-pq4sq" Jun 11 21:37:08.102453 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:08.102435 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d5845049-deec-4ed2-bdc6-4c506a8ba09e-oidc-ca\") pod \"authorino-c88857bd8-pq4sq\" (UID: \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\") " pod="kuadrant-system/authorino-c88857bd8-pq4sq" Jun 11 21:37:08.103007 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:08.102988 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d5845049-deec-4ed2-bdc6-4c506a8ba09e-oidc-ca\") pod \"authorino-c88857bd8-pq4sq\" (UID: \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\") " pod="kuadrant-system/authorino-c88857bd8-pq4sq" Jun 11 21:37:08.104646 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:08.104624 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5845049-deec-4ed2-bdc6-4c506a8ba09e-tls-cert\") pod \"authorino-c88857bd8-pq4sq\" (UID: \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\") " pod="kuadrant-system/authorino-c88857bd8-pq4sq" Jun 11 21:37:08.109712 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:08.109693 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrmvj\" (UniqueName: \"kubernetes.io/projected/d5845049-deec-4ed2-bdc6-4c506a8ba09e-kube-api-access-jrmvj\") pod \"authorino-c88857bd8-pq4sq\" (UID: \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\") " pod="kuadrant-system/authorino-c88857bd8-pq4sq" Jun 11 21:37:08.218167 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:08.218076 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c88857bd8-pq4sq" Jun 11 21:37:08.356373 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:08.356341 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c88857bd8-pq4sq"] Jun 11 21:37:08.357443 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:37:08.357416 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5845049_deec_4ed2_bdc6_4c506a8ba09e.slice/crio-464efd7d16047302da03eb2c876e6ae652de929dea542dd4d36a5412e98b6a22 WatchSource:0}: Error finding container 464efd7d16047302da03eb2c876e6ae652de929dea542dd4d36a5412e98b6a22: Status 404 returned error can't find the container with id 464efd7d16047302da03eb2c876e6ae652de929dea542dd4d36a5412e98b6a22 Jun 11 21:37:08.588498 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:08.588398 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c88857bd8-pq4sq" event={"ID":"d5845049-deec-4ed2-bdc6-4c506a8ba09e","Type":"ContainerStarted","Data":"464efd7d16047302da03eb2c876e6ae652de929dea542dd4d36a5412e98b6a22"} Jun 11 21:37:09.595201 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:09.595168 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c88857bd8-pq4sq" event={"ID":"d5845049-deec-4ed2-bdc6-4c506a8ba09e","Type":"ContainerStarted","Data":"de66711b62594253afdc49f73df8b2091f99e47a39ac9354b5422c811d191422"} Jun 11 21:37:09.609471 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:09.609416 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c88857bd8-pq4sq" podStartSLOduration=2.2598655819999998 podStartE2EDuration="2.609382641s" totalImagesPullingTime="349.517059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:37:09.608389201 +0000 UTC m=+1001.382329158" watchObservedRunningTime="2026-06-11 21:37:09.609382641 +0000 UTC m=+1001.383322596" Jun 11 21:37:09.635320 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:09.635284 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b97b4877d-7l2rp"] Jun 11 21:37:09.635504 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:09.635483 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7b97b4877d-7l2rp" podUID="e9d31a34-b188-41d1-9a64-c92d411f1e01" containerName="authorino" containerID="cri-o://b332c7c4c06ee35f8c70f3849edd236ee14edea25e27bb06696777d8650d1323" gracePeriod=30 Jun 11 21:37:09.895864 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:09.895828 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b97b4877d-7l2rp" Jun 11 21:37:09.916836 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:09.916808 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4765\" (UniqueName: \"kubernetes.io/projected/e9d31a34-b188-41d1-9a64-c92d411f1e01-kube-api-access-g4765\") pod \"e9d31a34-b188-41d1-9a64-c92d411f1e01\" (UID: \"e9d31a34-b188-41d1-9a64-c92d411f1e01\") " Jun 11 21:37:09.916996 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:09.916931 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e9d31a34-b188-41d1-9a64-c92d411f1e01-tls-cert\") pod \"e9d31a34-b188-41d1-9a64-c92d411f1e01\" (UID: \"e9d31a34-b188-41d1-9a64-c92d411f1e01\") " Jun 11 21:37:09.919230 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:09.919200 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9d31a34-b188-41d1-9a64-c92d411f1e01-kube-api-access-g4765" (OuterVolumeSpecName: "kube-api-access-g4765") pod "e9d31a34-b188-41d1-9a64-c92d411f1e01" (UID: "e9d31a34-b188-41d1-9a64-c92d411f1e01"). InnerVolumeSpecName "kube-api-access-g4765". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:37:09.930064 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:09.930043 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9d31a34-b188-41d1-9a64-c92d411f1e01-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e9d31a34-b188-41d1-9a64-c92d411f1e01" (UID: "e9d31a34-b188-41d1-9a64-c92d411f1e01"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:37:10.018512 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:10.018482 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e9d31a34-b188-41d1-9a64-c92d411f1e01-tls-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:37:10.018512 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:10.018508 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4765\" (UniqueName: \"kubernetes.io/projected/e9d31a34-b188-41d1-9a64-c92d411f1e01-kube-api-access-g4765\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:37:10.602111 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:10.602080 2581 generic.go:356] "Generic (PLEG): container finished" podID="e9d31a34-b188-41d1-9a64-c92d411f1e01" containerID="b332c7c4c06ee35f8c70f3849edd236ee14edea25e27bb06696777d8650d1323" exitCode=0 Jun 11 21:37:10.602621 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:10.602132 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b97b4877d-7l2rp" Jun 11 21:37:10.602621 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:10.602167 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b97b4877d-7l2rp" event={"ID":"e9d31a34-b188-41d1-9a64-c92d411f1e01","Type":"ContainerDied","Data":"b332c7c4c06ee35f8c70f3849edd236ee14edea25e27bb06696777d8650d1323"} Jun 11 21:37:10.602621 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:10.602221 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b97b4877d-7l2rp" event={"ID":"e9d31a34-b188-41d1-9a64-c92d411f1e01","Type":"ContainerDied","Data":"a631fabbc92b8f9e649f22ea4c8225a0990a336eda7c791691304ad754b066c1"} Jun 11 21:37:10.602621 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:10.602238 2581 scope.go:117] "RemoveContainer" containerID="b332c7c4c06ee35f8c70f3849edd236ee14edea25e27bb06696777d8650d1323" Jun 11 21:37:10.612081 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:10.612064 2581 scope.go:117] "RemoveContainer" containerID="b332c7c4c06ee35f8c70f3849edd236ee14edea25e27bb06696777d8650d1323" Jun 11 21:37:10.612310 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:37:10.612293 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b332c7c4c06ee35f8c70f3849edd236ee14edea25e27bb06696777d8650d1323\": container with ID starting with b332c7c4c06ee35f8c70f3849edd236ee14edea25e27bb06696777d8650d1323 not found: ID does not exist" containerID="b332c7c4c06ee35f8c70f3849edd236ee14edea25e27bb06696777d8650d1323" Jun 11 21:37:10.612355 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:10.612321 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b332c7c4c06ee35f8c70f3849edd236ee14edea25e27bb06696777d8650d1323"} err="failed to get container status \"b332c7c4c06ee35f8c70f3849edd236ee14edea25e27bb06696777d8650d1323\": rpc error: code = NotFound desc = could not find container \"b332c7c4c06ee35f8c70f3849edd236ee14edea25e27bb06696777d8650d1323\": container with ID starting with b332c7c4c06ee35f8c70f3849edd236ee14edea25e27bb06696777d8650d1323 not found: ID does not exist" Jun 11 21:37:10.625172 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:10.625150 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b97b4877d-7l2rp"] Jun 11 21:37:10.628667 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:10.628636 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b97b4877d-7l2rp"] Jun 11 21:37:10.707592 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:10.707565 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9d31a34-b188-41d1-9a64-c92d411f1e01" path="/var/lib/kubelet/pods/e9d31a34-b188-41d1-9a64-c92d411f1e01/volumes" Jun 11 21:37:21.233169 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:21.233131 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:37:27.891593 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.891553 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb"] Jun 11 21:37:27.891992 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.891978 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d31a34-b188-41d1-9a64-c92d411f1e01" containerName="authorino" Jun 11 21:37:27.892039 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.891994 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d31a34-b188-41d1-9a64-c92d411f1e01" containerName="authorino" Jun 11 21:37:27.892074 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.892064 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9d31a34-b188-41d1-9a64-c92d411f1e01" containerName="authorino" Jun 11 21:37:27.895537 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.895514 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:27.898890 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.898859 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 21:37:27.898890 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.898890 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 21:37:27.899133 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.898958 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 21:37:27.899133 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.898966 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hw8jb\"" Jun 11 21:37:27.904783 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.904762 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb"] Jun 11 21:37:27.988158 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.988126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efe9e8fd-8eab-4152-ac55-45842ee7d923-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:27.988346 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.988174 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efe9e8fd-8eab-4152-ac55-45842ee7d923-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:27.988346 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.988206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/efe9e8fd-8eab-4152-ac55-45842ee7d923-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:27.988346 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.988223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spw2k\" (UniqueName: \"kubernetes.io/projected/efe9e8fd-8eab-4152-ac55-45842ee7d923-kube-api-access-spw2k\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:27.988346 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.988244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efe9e8fd-8eab-4152-ac55-45842ee7d923-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:27.988346 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:27.988309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efe9e8fd-8eab-4152-ac55-45842ee7d923-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:28.089512 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.089472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efe9e8fd-8eab-4152-ac55-45842ee7d923-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:28.089715 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.089566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efe9e8fd-8eab-4152-ac55-45842ee7d923-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:28.089715 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.089619 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efe9e8fd-8eab-4152-ac55-45842ee7d923-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:28.089715 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.089702 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/efe9e8fd-8eab-4152-ac55-45842ee7d923-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:28.089957 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.089745 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spw2k\" (UniqueName: \"kubernetes.io/projected/efe9e8fd-8eab-4152-ac55-45842ee7d923-kube-api-access-spw2k\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:28.089957 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.089797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efe9e8fd-8eab-4152-ac55-45842ee7d923-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:28.090054 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.090005 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efe9e8fd-8eab-4152-ac55-45842ee7d923-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:28.090146 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.090122 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/efe9e8fd-8eab-4152-ac55-45842ee7d923-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:28.090194 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.090160 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efe9e8fd-8eab-4152-ac55-45842ee7d923-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:28.091844 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.091823 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efe9e8fd-8eab-4152-ac55-45842ee7d923-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:28.092176 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.092153 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efe9e8fd-8eab-4152-ac55-45842ee7d923-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:28.097341 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.097315 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spw2k\" (UniqueName: \"kubernetes.io/projected/efe9e8fd-8eab-4152-ac55-45842ee7d923-kube-api-access-spw2k\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6bmpb\" (UID: \"efe9e8fd-8eab-4152-ac55-45842ee7d923\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:28.206997 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.206904 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:28.346334 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.346309 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb"] Jun 11 21:37:28.347798 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:37:28.347768 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe9e8fd_8eab_4152_ac55_45842ee7d923.slice/crio-ac0b6a30f5e4dabd29994d6b6aad9fb6c0a39830d4399d4aacbb4cc1342f1383 WatchSource:0}: Error finding container ac0b6a30f5e4dabd29994d6b6aad9fb6c0a39830d4399d4aacbb4cc1342f1383: Status 404 returned error can't find the container with id ac0b6a30f5e4dabd29994d6b6aad9fb6c0a39830d4399d4aacbb4cc1342f1383 Jun 11 21:37:28.600656 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.600572 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:37:28.714589 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:28.714557 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" event={"ID":"efe9e8fd-8eab-4152-ac55-45842ee7d923","Type":"ContainerStarted","Data":"ac0b6a30f5e4dabd29994d6b6aad9fb6c0a39830d4399d4aacbb4cc1342f1383"} Jun 11 21:37:32.743341 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:32.743302 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" event={"ID":"efe9e8fd-8eab-4152-ac55-45842ee7d923","Type":"ContainerStarted","Data":"a95d676a9ba33b520fa08f35e8d14d0aa4ba9eed4fdb9f503815109ba2f9d215"} Jun 11 21:37:33.753587 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:33.753555 2581 generic.go:356] "Generic (PLEG): container finished" podID="efe9e8fd-8eab-4152-ac55-45842ee7d923" containerID="a95d676a9ba33b520fa08f35e8d14d0aa4ba9eed4fdb9f503815109ba2f9d215" exitCode=0 Jun 11 21:37:33.754041 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:33.753597 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" event={"ID":"efe9e8fd-8eab-4152-ac55-45842ee7d923","Type":"ContainerDied","Data":"a95d676a9ba33b520fa08f35e8d14d0aa4ba9eed4fdb9f503815109ba2f9d215"} Jun 11 21:37:35.767586 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:35.767551 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" event={"ID":"efe9e8fd-8eab-4152-ac55-45842ee7d923","Type":"ContainerStarted","Data":"e15af5048ead15f8b12ca6dbb484fb1936ffc45e62beb19f4472844228fa0e40"} Jun 11 21:37:35.786481 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:35.786428 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" podStartSLOduration=2.359199128 podStartE2EDuration="8.786391783s" totalImagesPullingTime="5.11817041s" totalInitContainerRuntime="1.309022245s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:37:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:37:35.78393033 +0000 UTC m=+1027.557870310" watchObservedRunningTime="2026-06-11 21:37:35.786391783 +0000 UTC m=+1027.560331767" Jun 11 21:37:38.207362 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:38.207329 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:38.207883 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:38.207505 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:38.220397 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:38.220374 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:38.796512 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:38.796486 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6bmpb" Jun 11 21:37:40.601538 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:40.601507 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:37:58.483564 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.483531 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr"] Jun 11 21:37:58.499325 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.499297 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr"] Jun 11 21:37:58.499524 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.499392 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.501701 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.501679 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 21:37:58.564368 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.564339 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjftv\" (UniqueName: \"kubernetes.io/projected/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-kube-api-access-bjftv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.564517 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.564375 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.564517 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.564454 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.564517 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.564490 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.564517 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.564511 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.564683 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.564548 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.665054 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.665022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjftv\" (UniqueName: \"kubernetes.io/projected/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-kube-api-access-bjftv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.665054 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.665058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.665294 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.665088 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.665294 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.665122 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.665294 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.665142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.665294 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.665179 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.665548 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.665507 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.665548 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.665536 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.665662 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.665587 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.667372 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.667347 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.667667 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.667646 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.674486 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.674464 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjftv\" (UniqueName: \"kubernetes.io/projected/c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0-kube-api-access-bjftv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr\" (UID: \"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.812818 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.812747 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:37:58.955589 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:37:58.955551 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9dd7b8a_1104_4e04_9b5f_4c891d5ad2a0.slice/crio-5c525cccb82bb9752d2d9131cde7c9ae589af08d64b35aa1ca2f0610cf9ca751 WatchSource:0}: Error finding container 5c525cccb82bb9752d2d9131cde7c9ae589af08d64b35aa1ca2f0610cf9ca751: Status 404 returned error can't find the container with id 5c525cccb82bb9752d2d9131cde7c9ae589af08d64b35aa1ca2f0610cf9ca751 Jun 11 21:37:58.955858 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:58.955822 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr"] Jun 11 21:37:59.207792 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:59.207752 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:37:59.909140 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:59.909107 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" event={"ID":"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0","Type":"ContainerStarted","Data":"15f4f38031fc5aa7e679eb326567579a5fc734f6cdb0201823cf7ba2bd33963b"} Jun 11 21:37:59.909526 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:37:59.909159 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" event={"ID":"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0","Type":"ContainerStarted","Data":"5c525cccb82bb9752d2d9131cde7c9ae589af08d64b35aa1ca2f0610cf9ca751"} Jun 11 21:38:00.915725 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:00.915691 2581 generic.go:356] "Generic (PLEG): container finished" podID="c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0" containerID="15f4f38031fc5aa7e679eb326567579a5fc734f6cdb0201823cf7ba2bd33963b" exitCode=0 Jun 11 21:38:00.916182 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:00.915778 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" event={"ID":"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0","Type":"ContainerDied","Data":"15f4f38031fc5aa7e679eb326567579a5fc734f6cdb0201823cf7ba2bd33963b"} Jun 11 21:38:00.916268 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:00.916239 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:38:01.924257 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:01.924214 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" event={"ID":"c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0","Type":"ContainerStarted","Data":"2adbbf3651110b054f9e9631335cdac98fd0887c689f8d264c7db51e76603bef"} Jun 11 21:38:01.941733 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:01.941689 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" podStartSLOduration=2.466668566 podStartE2EDuration="3.94167417s" totalImagesPullingTime="196.934819ms" totalInitContainerRuntime="1.278070785s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:37:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:38:01.940250492 +0000 UTC m=+1053.714190450" watchObservedRunningTime="2026-06-11 21:38:01.94167417 +0000 UTC m=+1053.715614149" Jun 11 21:38:08.812853 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:08.812814 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:38:08.813335 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:08.812881 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:38:08.825507 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:08.825484 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:38:08.978421 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:08.978381 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr" Jun 11 21:38:09.503723 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:09.503644 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:38:11.477275 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.477245 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf"] Jun 11 21:38:11.482290 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.482268 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.484639 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.484617 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 21:38:11.489116 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.489092 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf"] Jun 11 21:38:11.579351 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.579314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbe5e9e6-b08b-4321-aed2-6d79154df58b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.579543 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.579427 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbe5e9e6-b08b-4321-aed2-6d79154df58b-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.579543 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.579473 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dbe5e9e6-b08b-4321-aed2-6d79154df58b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.579728 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.579553 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbe5e9e6-b08b-4321-aed2-6d79154df58b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.579728 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.579617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbe5e9e6-b08b-4321-aed2-6d79154df58b-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.579728 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.579649 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q94mj\" (UniqueName: \"kubernetes.io/projected/dbe5e9e6-b08b-4321-aed2-6d79154df58b-kube-api-access-q94mj\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.680598 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.680561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbe5e9e6-b08b-4321-aed2-6d79154df58b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.680784 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.680614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbe5e9e6-b08b-4321-aed2-6d79154df58b-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.680784 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.680641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dbe5e9e6-b08b-4321-aed2-6d79154df58b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.680784 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.680680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbe5e9e6-b08b-4321-aed2-6d79154df58b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.680784 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.680730 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbe5e9e6-b08b-4321-aed2-6d79154df58b-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.680784 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.680761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q94mj\" (UniqueName: \"kubernetes.io/projected/dbe5e9e6-b08b-4321-aed2-6d79154df58b-kube-api-access-q94mj\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.681147 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.681122 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbe5e9e6-b08b-4321-aed2-6d79154df58b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.681229 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.681163 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dbe5e9e6-b08b-4321-aed2-6d79154df58b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.681229 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.681209 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbe5e9e6-b08b-4321-aed2-6d79154df58b-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.682903 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.682880 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbe5e9e6-b08b-4321-aed2-6d79154df58b-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.683012 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.682997 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbe5e9e6-b08b-4321-aed2-6d79154df58b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.688936 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.688918 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q94mj\" (UniqueName: \"kubernetes.io/projected/dbe5e9e6-b08b-4321-aed2-6d79154df58b-kube-api-access-q94mj\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5q7kf\" (UID: \"dbe5e9e6-b08b-4321-aed2-6d79154df58b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.793974 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.793896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:11.928134 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.928102 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf"] Jun 11 21:38:11.929772 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:38:11.929751 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe5e9e6_b08b_4321_aed2_6d79154df58b.slice/crio-e8a19239385838cc391cbf0f8935c9747e988856e72193147e8f15cd383947ab WatchSource:0}: Error finding container e8a19239385838cc391cbf0f8935c9747e988856e72193147e8f15cd383947ab: Status 404 returned error can't find the container with id e8a19239385838cc391cbf0f8935c9747e988856e72193147e8f15cd383947ab Jun 11 21:38:11.984641 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:11.984618 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" event={"ID":"dbe5e9e6-b08b-4321-aed2-6d79154df58b","Type":"ContainerStarted","Data":"e8a19239385838cc391cbf0f8935c9747e988856e72193147e8f15cd383947ab"} Jun 11 21:38:12.991764 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:12.991728 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" event={"ID":"dbe5e9e6-b08b-4321-aed2-6d79154df58b","Type":"ContainerStarted","Data":"c1d0434203ccdc03e4bfe258208bbf94b7596bdf3be93c9d0332bd7ae431127f"} Jun 11 21:38:13.096754 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:13.096718 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:38:13.999919 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:13.999889 2581 generic.go:356] "Generic (PLEG): container finished" podID="dbe5e9e6-b08b-4321-aed2-6d79154df58b" containerID="c1d0434203ccdc03e4bfe258208bbf94b7596bdf3be93c9d0332bd7ae431127f" exitCode=0 Jun 11 21:38:14.000421 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:13.999967 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" event={"ID":"dbe5e9e6-b08b-4321-aed2-6d79154df58b","Type":"ContainerDied","Data":"c1d0434203ccdc03e4bfe258208bbf94b7596bdf3be93c9d0332bd7ae431127f"} Jun 11 21:38:15.008172 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:15.008138 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" event={"ID":"dbe5e9e6-b08b-4321-aed2-6d79154df58b","Type":"ContainerStarted","Data":"c8ae412652052e44ca63f98d0d3486fde41e0772994ab8b49b6985a5e1edca31"} Jun 11 21:38:15.026327 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:15.026278 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" podStartSLOduration=2.494400341 podStartE2EDuration="4.026261535s" totalImagesPullingTime="206.738953ms" totalInitContainerRuntime="1.325122241s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:38:15.023935461 +0000 UTC m=+1066.797875417" watchObservedRunningTime="2026-06-11 21:38:15.026261535 +0000 UTC m=+1066.800201490" Jun 11 21:38:21.794949 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:21.794913 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:21.795333 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:21.794966 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:21.807435 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:21.807395 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:38:22.061066 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:38:22.060978 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5q7kf" Jun 11 21:39:16.849361 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:16.849323 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6ff9684985-t2gjz"] Jun 11 21:39:16.852901 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:16.852882 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6ff9684985-t2gjz" Jun 11 21:39:16.861629 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:16.861609 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6ff9684985-t2gjz"] Jun 11 21:39:16.986145 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:16.986105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2mtm\" (UniqueName: \"kubernetes.io/projected/d2b085a5-a4a3-4140-bf35-2e5228181005-kube-api-access-n2mtm\") pod \"authorino-6ff9684985-t2gjz\" (UID: \"d2b085a5-a4a3-4140-bf35-2e5228181005\") " pod="kuadrant-system/authorino-6ff9684985-t2gjz" Jun 11 21:39:16.986351 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:16.986169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d2b085a5-a4a3-4140-bf35-2e5228181005-oidc-ca\") pod \"authorino-6ff9684985-t2gjz\" (UID: \"d2b085a5-a4a3-4140-bf35-2e5228181005\") " pod="kuadrant-system/authorino-6ff9684985-t2gjz" Jun 11 21:39:16.986351 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:16.986224 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2b085a5-a4a3-4140-bf35-2e5228181005-tls-cert\") pod \"authorino-6ff9684985-t2gjz\" (UID: \"d2b085a5-a4a3-4140-bf35-2e5228181005\") " pod="kuadrant-system/authorino-6ff9684985-t2gjz" Jun 11 21:39:17.086944 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:17.086904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2b085a5-a4a3-4140-bf35-2e5228181005-tls-cert\") pod \"authorino-6ff9684985-t2gjz\" (UID: \"d2b085a5-a4a3-4140-bf35-2e5228181005\") " pod="kuadrant-system/authorino-6ff9684985-t2gjz" Jun 11 21:39:17.087134 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:17.087015 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2mtm\" (UniqueName: \"kubernetes.io/projected/d2b085a5-a4a3-4140-bf35-2e5228181005-kube-api-access-n2mtm\") pod \"authorino-6ff9684985-t2gjz\" (UID: \"d2b085a5-a4a3-4140-bf35-2e5228181005\") " pod="kuadrant-system/authorino-6ff9684985-t2gjz" Jun 11 21:39:17.087134 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:17.087074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d2b085a5-a4a3-4140-bf35-2e5228181005-oidc-ca\") pod \"authorino-6ff9684985-t2gjz\" (UID: \"d2b085a5-a4a3-4140-bf35-2e5228181005\") " pod="kuadrant-system/authorino-6ff9684985-t2gjz" Jun 11 21:39:17.087684 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:17.087664 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d2b085a5-a4a3-4140-bf35-2e5228181005-oidc-ca\") pod \"authorino-6ff9684985-t2gjz\" (UID: \"d2b085a5-a4a3-4140-bf35-2e5228181005\") " pod="kuadrant-system/authorino-6ff9684985-t2gjz" Jun 11 21:39:17.089531 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:17.089512 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2b085a5-a4a3-4140-bf35-2e5228181005-tls-cert\") pod \"authorino-6ff9684985-t2gjz\" (UID: \"d2b085a5-a4a3-4140-bf35-2e5228181005\") " pod="kuadrant-system/authorino-6ff9684985-t2gjz" Jun 11 21:39:17.094069 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:17.094048 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2mtm\" (UniqueName: \"kubernetes.io/projected/d2b085a5-a4a3-4140-bf35-2e5228181005-kube-api-access-n2mtm\") pod \"authorino-6ff9684985-t2gjz\" (UID: \"d2b085a5-a4a3-4140-bf35-2e5228181005\") " pod="kuadrant-system/authorino-6ff9684985-t2gjz" Jun 11 21:39:17.164393 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:17.164358 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6ff9684985-t2gjz" Jun 11 21:39:17.300535 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:17.300510 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6ff9684985-t2gjz"] Jun 11 21:39:17.302107 ip-10-0-143-27 kubenswrapper[2581]: W0611 21:39:17.302081 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2b085a5_a4a3_4140_bf35_2e5228181005.slice/crio-751999f76126ef3accb2489600d38908e62da10d3cb31e37d20fa3b9cdcd3711 WatchSource:0}: Error finding container 751999f76126ef3accb2489600d38908e62da10d3cb31e37d20fa3b9cdcd3711: Status 404 returned error can't find the container with id 751999f76126ef3accb2489600d38908e62da10d3cb31e37d20fa3b9cdcd3711 Jun 11 21:39:17.379855 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:17.379818 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6ff9684985-t2gjz" event={"ID":"d2b085a5-a4a3-4140-bf35-2e5228181005","Type":"ContainerStarted","Data":"751999f76126ef3accb2489600d38908e62da10d3cb31e37d20fa3b9cdcd3711"} Jun 11 21:39:18.388793 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:18.388746 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6ff9684985-t2gjz" event={"ID":"d2b085a5-a4a3-4140-bf35-2e5228181005","Type":"ContainerStarted","Data":"eb6de065572914ef4e94989539b6692a8300736474731fd9e562421e6b78cd52"} Jun 11 21:39:18.407556 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:18.407510 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6ff9684985-t2gjz" podStartSLOduration=2.037272655 podStartE2EDuration="2.407493355s" totalImagesPullingTime="370.2207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:39:18.405456766 +0000 UTC m=+1130.179396724" watchObservedRunningTime="2026-06-11 21:39:18.407493355 +0000 UTC m=+1130.181433310" Jun 11 21:39:18.445434 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:18.445125 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c88857bd8-pq4sq"] Jun 11 21:39:18.449424 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:18.446466 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-c88857bd8-pq4sq" podUID="d5845049-deec-4ed2-bdc6-4c506a8ba09e" containerName="authorino" containerID="cri-o://de66711b62594253afdc49f73df8b2091f99e47a39ac9354b5422c811d191422" gracePeriod=30 Jun 11 21:39:18.723314 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:18.723290 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c88857bd8-pq4sq" Jun 11 21:39:18.805192 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:18.805158 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d5845049-deec-4ed2-bdc6-4c506a8ba09e-oidc-ca\") pod \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\" (UID: \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\") " Jun 11 21:39:18.805365 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:18.805256 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrmvj\" (UniqueName: \"kubernetes.io/projected/d5845049-deec-4ed2-bdc6-4c506a8ba09e-kube-api-access-jrmvj\") pod \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\" (UID: \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\") " Jun 11 21:39:18.805365 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:18.805361 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5845049-deec-4ed2-bdc6-4c506a8ba09e-tls-cert\") pod \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\" (UID: \"d5845049-deec-4ed2-bdc6-4c506a8ba09e\") " Jun 11 21:39:18.807731 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:18.807704 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5845049-deec-4ed2-bdc6-4c506a8ba09e-kube-api-access-jrmvj" (OuterVolumeSpecName: "kube-api-access-jrmvj") pod "d5845049-deec-4ed2-bdc6-4c506a8ba09e" (UID: "d5845049-deec-4ed2-bdc6-4c506a8ba09e"). InnerVolumeSpecName "kube-api-access-jrmvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:39:18.812421 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:18.812374 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5845049-deec-4ed2-bdc6-4c506a8ba09e-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "d5845049-deec-4ed2-bdc6-4c506a8ba09e" (UID: "d5845049-deec-4ed2-bdc6-4c506a8ba09e"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:39:18.818131 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:18.818106 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5845049-deec-4ed2-bdc6-4c506a8ba09e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d5845049-deec-4ed2-bdc6-4c506a8ba09e" (UID: "d5845049-deec-4ed2-bdc6-4c506a8ba09e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:39:18.907429 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:18.907383 2581 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d5845049-deec-4ed2-bdc6-4c506a8ba09e-oidc-ca\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:39:18.907429 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:18.907429 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrmvj\" (UniqueName: \"kubernetes.io/projected/d5845049-deec-4ed2-bdc6-4c506a8ba09e-kube-api-access-jrmvj\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:39:18.907636 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:18.907440 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5845049-deec-4ed2-bdc6-4c506a8ba09e-tls-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:39:19.396006 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:19.395973 2581 generic.go:356] "Generic (PLEG): container finished" podID="d5845049-deec-4ed2-bdc6-4c506a8ba09e" containerID="de66711b62594253afdc49f73df8b2091f99e47a39ac9354b5422c811d191422" exitCode=0 Jun 11 21:39:19.396512 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:19.396025 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c88857bd8-pq4sq" Jun 11 21:39:19.396512 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:19.396064 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c88857bd8-pq4sq" event={"ID":"d5845049-deec-4ed2-bdc6-4c506a8ba09e","Type":"ContainerDied","Data":"de66711b62594253afdc49f73df8b2091f99e47a39ac9354b5422c811d191422"} Jun 11 21:39:19.396512 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:19.396104 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c88857bd8-pq4sq" event={"ID":"d5845049-deec-4ed2-bdc6-4c506a8ba09e","Type":"ContainerDied","Data":"464efd7d16047302da03eb2c876e6ae652de929dea542dd4d36a5412e98b6a22"} Jun 11 21:39:19.396512 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:19.396123 2581 scope.go:117] "RemoveContainer" containerID="de66711b62594253afdc49f73df8b2091f99e47a39ac9354b5422c811d191422" Jun 11 21:39:19.408837 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:19.406675 2581 scope.go:117] "RemoveContainer" containerID="de66711b62594253afdc49f73df8b2091f99e47a39ac9354b5422c811d191422" Jun 11 21:39:19.408837 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:39:19.407021 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de66711b62594253afdc49f73df8b2091f99e47a39ac9354b5422c811d191422\": container with ID starting with de66711b62594253afdc49f73df8b2091f99e47a39ac9354b5422c811d191422 not found: ID does not exist" containerID="de66711b62594253afdc49f73df8b2091f99e47a39ac9354b5422c811d191422" Jun 11 21:39:19.408837 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:19.407051 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de66711b62594253afdc49f73df8b2091f99e47a39ac9354b5422c811d191422"} err="failed to get container status \"de66711b62594253afdc49f73df8b2091f99e47a39ac9354b5422c811d191422\": rpc error: code = NotFound desc = could not find container \"de66711b62594253afdc49f73df8b2091f99e47a39ac9354b5422c811d191422\": container with ID starting with de66711b62594253afdc49f73df8b2091f99e47a39ac9354b5422c811d191422 not found: ID does not exist" Jun 11 21:39:19.417727 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:19.417707 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c88857bd8-pq4sq"] Jun 11 21:39:19.423392 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:19.423371 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c88857bd8-pq4sq"] Jun 11 21:39:20.709072 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:20.709045 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5845049-deec-4ed2-bdc6-4c506a8ba09e" path="/var/lib/kubelet/pods/d5845049-deec-4ed2-bdc6-4c506a8ba09e/volumes" Jun 11 21:39:50.395098 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:50.395066 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:39:59.803138 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:39:59.803102 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:40:09.601030 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:09.600994 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:40:19.100052 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:19.100016 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:40:28.776485 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:28.776457 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:40:28.779693 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:28.779670 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:40:29.009690 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:29.009654 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:40:38.396693 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:38.396658 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:40:46.115035 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.114985 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f5bf9f677-p58f6"] Jun 11 21:40:46.115500 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.115232 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-f5bf9f677-p58f6" podUID="6cc679c7-1274-40b3-a860-e3a46f9c0f23" containerName="manager" containerID="cri-o://b30ce8bb8eb1715d683a17536cb22920e4070f611999c6ab7a6c6f2a95401f4f" gracePeriod=30 Jun 11 21:40:46.371254 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.371188 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f5bf9f677-p58f6" Jun 11 21:40:46.446886 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.446855 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cc679c7-1274-40b3-a860-e3a46f9c0f23-webhook-cert\") pod \"6cc679c7-1274-40b3-a860-e3a46f9c0f23\" (UID: \"6cc679c7-1274-40b3-a860-e3a46f9c0f23\") " Jun 11 21:40:46.447065 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.446924 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hkwx\" (UniqueName: \"kubernetes.io/projected/6cc679c7-1274-40b3-a860-e3a46f9c0f23-kube-api-access-7hkwx\") pod \"6cc679c7-1274-40b3-a860-e3a46f9c0f23\" (UID: \"6cc679c7-1274-40b3-a860-e3a46f9c0f23\") " Jun 11 21:40:46.449042 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.449015 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cc679c7-1274-40b3-a860-e3a46f9c0f23-kube-api-access-7hkwx" (OuterVolumeSpecName: "kube-api-access-7hkwx") pod "6cc679c7-1274-40b3-a860-e3a46f9c0f23" (UID: "6cc679c7-1274-40b3-a860-e3a46f9c0f23"). InnerVolumeSpecName "kube-api-access-7hkwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:40:46.449153 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.449040 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cc679c7-1274-40b3-a860-e3a46f9c0f23-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6cc679c7-1274-40b3-a860-e3a46f9c0f23" (UID: "6cc679c7-1274-40b3-a860-e3a46f9c0f23"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:40:46.548094 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.548060 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cc679c7-1274-40b3-a860-e3a46f9c0f23-webhook-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:40:46.548094 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.548088 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hkwx\" (UniqueName: \"kubernetes.io/projected/6cc679c7-1274-40b3-a860-e3a46f9c0f23-kube-api-access-7hkwx\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Jun 11 21:40:46.932529 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.932496 2581 generic.go:356] "Generic (PLEG): container finished" podID="6cc679c7-1274-40b3-a860-e3a46f9c0f23" containerID="b30ce8bb8eb1715d683a17536cb22920e4070f611999c6ab7a6c6f2a95401f4f" exitCode=0 Jun 11 21:40:46.932703 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.932545 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f5bf9f677-p58f6" Jun 11 21:40:46.932703 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.932584 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f5bf9f677-p58f6" event={"ID":"6cc679c7-1274-40b3-a860-e3a46f9c0f23","Type":"ContainerDied","Data":"b30ce8bb8eb1715d683a17536cb22920e4070f611999c6ab7a6c6f2a95401f4f"} Jun 11 21:40:46.932703 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.932632 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f5bf9f677-p58f6" event={"ID":"6cc679c7-1274-40b3-a860-e3a46f9c0f23","Type":"ContainerDied","Data":"7ee3c24c4ee825ca9774ee6d004e9d407b215d69e83b6017751aed952c6c2445"} Jun 11 21:40:46.932703 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.932652 2581 scope.go:117] "RemoveContainer" containerID="b30ce8bb8eb1715d683a17536cb22920e4070f611999c6ab7a6c6f2a95401f4f" Jun 11 21:40:46.941887 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.941867 2581 scope.go:117] "RemoveContainer" containerID="b30ce8bb8eb1715d683a17536cb22920e4070f611999c6ab7a6c6f2a95401f4f" Jun 11 21:40:46.942144 ip-10-0-143-27 kubenswrapper[2581]: E0611 21:40:46.942126 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b30ce8bb8eb1715d683a17536cb22920e4070f611999c6ab7a6c6f2a95401f4f\": container with ID starting with b30ce8bb8eb1715d683a17536cb22920e4070f611999c6ab7a6c6f2a95401f4f not found: ID does not exist" containerID="b30ce8bb8eb1715d683a17536cb22920e4070f611999c6ab7a6c6f2a95401f4f" Jun 11 21:40:46.942212 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.942152 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b30ce8bb8eb1715d683a17536cb22920e4070f611999c6ab7a6c6f2a95401f4f"} err="failed to get container status \"b30ce8bb8eb1715d683a17536cb22920e4070f611999c6ab7a6c6f2a95401f4f\": rpc error: code = NotFound desc = could not find container \"b30ce8bb8eb1715d683a17536cb22920e4070f611999c6ab7a6c6f2a95401f4f\": container with ID starting with b30ce8bb8eb1715d683a17536cb22920e4070f611999c6ab7a6c6f2a95401f4f not found: ID does not exist" Jun 11 21:40:46.949007 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.948976 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f5bf9f677-p58f6"] Jun 11 21:40:46.957442 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:46.953048 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f5bf9f677-p58f6"] Jun 11 21:40:48.708535 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:40:48.708501 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cc679c7-1274-40b3-a860-e3a46f9c0f23" path="/var/lib/kubelet/pods/6cc679c7-1274-40b3-a860-e3a46f9c0f23/volumes" Jun 11 21:41:11.697348 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:41:11.697255 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:41:15.596660 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:41:15.596622 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:41:50.995694 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:41:50.995655 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:42:07.105825 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:42:07.105790 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:42:45.201016 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:42:45.200930 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:43:02.197250 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:43:02.197213 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:43:16.400981 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:43:16.400941 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:43:31.599239 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:43:31.599205 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:43:35.295040 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:43:35.295006 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:44:31.797766 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:44:31.797667 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:44:40.695450 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:44:40.695411 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:44:57.499913 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:44:57.499882 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:45:06.099868 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:45:06.099833 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:45:23.794057 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:45:23.794024 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:45:28.824884 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:45:28.824858 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:45:28.828821 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:45:28.828798 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:45:32.093830 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:45:32.093793 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:46:04.494547 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:46:04.494504 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:46:14.094182 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:46:14.094145 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:46:21.806711 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:46:21.806680 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:46:29.591363 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:46:29.591324 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:46:37.998187 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:46:37.998149 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:46:46.804583 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:46:46.804547 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:46:50.798337 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:46:50.798296 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:47:03.494155 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:47:03.494123 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:47:17.100341 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:47:17.100264 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:47:45.298015 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:47:45.297980 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:47:47.901181 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:47:47.901146 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:48:05.405194 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:48:05.405160 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:48:12.304027 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:48:12.303994 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:48:31.315969 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:48:31.315928 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:48:36.304149 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:48:36.304114 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:48:40.094846 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:48:40.094762 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:48:50.198702 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:48:50.198665 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:48:58.100304 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:48:58.100267 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:49:07.500248 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:49:07.500213 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:49:15.204677 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:49:15.204647 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:49:25.299320 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:49:25.299282 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:49:32.797146 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:49:32.797109 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:49:40.695949 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:49:40.695835 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:49:48.997952 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:49:48.997903 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:50:28.876192 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:50:28.876160 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:50:28.880023 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:50:28.879996 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:52:17.602343 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:52:17.602309 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:52:21.599430 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:52:21.599380 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:52:48.709206 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:52:48.709170 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:52:52.297443 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:52:52.297395 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:53:02.802624 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:53:02.802582 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:53:11.595511 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:53:11.595428 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:53:21.012919 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:53:21.012883 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:53:32.009649 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:53:32.009620 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:53:41.500290 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:53:41.500252 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:53:50.300384 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:53:50.300345 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:53:59.942456 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:53:59.942421 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:54:09.705697 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:54:09.705661 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:54:19.616774 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:54:19.616736 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:54:24.904602 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:54:24.904568 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:54:52.306757 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:54:52.306719 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:55:28.926659 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:55:28.926619 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:55:28.928728 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:55:28.928705 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 21:55:35.199224 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:55:35.199192 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:55:43.604190 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:55:43.604148 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:55:52.507469 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:55:52.507429 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:56:01.211185 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:56:01.211147 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:56:10.803592 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:56:10.803513 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:56:22.432509 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:56:22.432467 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:56:31.599630 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:56:31.599588 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:56:36.805368 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:56:36.805322 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:56:45.003173 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:56:45.003132 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:56:52.695502 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:56:52.695464 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:57:00.295193 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:57:00.295157 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:57:10.802981 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:57:10.802948 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:57:30.297101 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:57:30.297060 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:57:37.702729 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:57:37.702688 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:57:46.212247 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:57:46.212038 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:57:54.893700 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:57:54.893667 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:58:11.798593 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:58:11.798563 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:58:20.100852 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:58:20.100819 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:58:30.102106 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:58:30.102069 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:58:37.694671 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:58:37.694635 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:58:47.498772 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:58:47.498733 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:58:55.208636 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:58:55.208599 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:59:05.102609 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:59:05.102567 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:59:17.108000 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:59:17.107911 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:59:27.406142 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:59:27.406109 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:59:39.404039 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:59:39.404000 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:59:48.906628 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:59:48.906590 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 21:59:54.103911 ip-10-0-143-27 kubenswrapper[2581]: I0611 21:59:54.103868 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 22:00:01.213258 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:00:01.213221 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 22:00:06.499570 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:00:06.499534 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 22:00:21.002749 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:00:21.002714 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 22:00:28.981431 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:00:28.981379 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 22:00:28.986362 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:00:28.986340 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhllk_2a3f8c72-9b49-4e04-8a55-558ecbc70a57/ovn-acl-logging/0.log" Jun 11 22:00:29.703739 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:00:29.703704 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 22:00:39.005448 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:00:39.005412 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 22:00:45.005098 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:00:45.005018 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 22:01:06.901723 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:06.901687 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 22:01:18.699452 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:18.699413 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 22:01:24.912509 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:24.912474 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d487g"] Jun 11 22:01:52.525842 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:52.525810 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6ff9684985-t2gjz_d2b085a5-a4a3-4140-bf35-2e5228181005/authorino/0.log" Jun 11 22:01:57.118715 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:57.118683 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5bc579744d-7pd22_dd016104-07f0-4664-856c-84725af31488/nginx/0.log" Jun 11 22:01:58.307933 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:58.307898 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75f49467f8-jg7lj_6fa9368c-aacd-4ccd-b7f5-c156d3a53239/manager/0.log" Jun 11 22:01:58.314565 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:58.314542 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75f49467f8-jg7lj_6fa9368c-aacd-4ccd-b7f5-c156d3a53239/copy-manifests/0.log" Jun 11 22:01:59.302801 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:59.302775 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t_06c41b5a-10b0-46ea-8106-0aab05d0ce56/util/0.log" Jun 11 22:01:59.310115 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:59.310092 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t_06c41b5a-10b0-46ea-8106-0aab05d0ce56/pull/0.log" Jun 11 22:01:59.315752 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:59.315735 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t_06c41b5a-10b0-46ea-8106-0aab05d0ce56/extract/0.log" Jun 11 22:01:59.425990 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:59.425963 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb_ff82448e-9103-4621-903a-339e16f25b2c/util/0.log" Jun 11 22:01:59.432276 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:59.432248 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb_ff82448e-9103-4621-903a-339e16f25b2c/pull/0.log" Jun 11 22:01:59.438042 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:59.438022 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb_ff82448e-9103-4621-903a-339e16f25b2c/extract/0.log" Jun 11 22:01:59.552711 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:59.552687 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5_ed32aa66-69a6-4768-b133-97f96299da7e/extract/0.log" Jun 11 22:01:59.559081 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:59.559012 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5_ed32aa66-69a6-4768-b133-97f96299da7e/util/0.log" Jun 11 22:01:59.564872 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:59.564850 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5_ed32aa66-69a6-4768-b133-97f96299da7e/pull/0.log" Jun 11 22:01:59.673750 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:59.673723 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc_c360fd10-3d19-4479-bf51-e2fe5c1b21a9/extract/0.log" Jun 11 22:01:59.684384 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:59.684358 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc_c360fd10-3d19-4479-bf51-e2fe5c1b21a9/util/0.log" Jun 11 22:01:59.691122 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:59.691091 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc_c360fd10-3d19-4479-bf51-e2fe5c1b21a9/pull/0.log" Jun 11 22:01:59.813987 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:59.813873 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6ff9684985-t2gjz_d2b085a5-a4a3-4140-bf35-2e5228181005/authorino/0.log" Jun 11 22:01:59.933625 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:01:59.933593 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-czvkt_b6695649-5176-4205-8ab8-c0c78a6b1b2d/manager/0.log" Jun 11 22:02:00.052714 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:00.052684 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cwwd2_aab7df73-7b4f-416f-be33-da5d40b7fa8d/manager/0.log" Jun 11 22:02:00.162636 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:00.162610 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hm7hx_18bbc26a-b81d-443c-a5b2-a02ee5197da3/kuadrant-console-plugin/0.log" Jun 11 22:02:00.288869 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:00.288837 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pkj9n_f0656a72-4a66-4211-ab56-85d03f2eb412/registry-server/0.log" Jun 11 22:02:00.543192 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:00.543115 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-d487g_1dcae654-278d-487c-a60f-160d9834b968/limitador/0.log" Jun 11 22:02:01.014872 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:01.014839 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcmhlnf_2dea163b-fc45-4bbf-907e-e5ce1cfdbe88/istio-proxy/0.log" Jun 11 22:02:01.477556 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:01.477527 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kk2ml_0bb113c6-175d-42b3-a21c-63f28a914cbe/istio-proxy/1.log" Jun 11 22:02:01.820207 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:01.820118 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-595dc98f7b-hphqq_197e0956-cb50-413d-8ace-dac9967f2a80/router/0.log" Jun 11 22:02:02.288975 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:02.288950 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-6bmpb_efe9e8fd-8eab-4152-ac55-45842ee7d923/storage-initializer/0.log" Jun 11 22:02:02.296495 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:02.296468 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-6bmpb_efe9e8fd-8eab-4152-ac55-45842ee7d923/main/0.log" Jun 11 22:02:02.530283 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:02.530253 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr_c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0/main/0.log" Jun 11 22:02:02.538807 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:02.538780 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq66fr_c9dd7b8a-1104-4e04-9b5f-4c891d5ad2a0/storage-initializer/0.log" Jun 11 22:02:02.767287 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:02.767255 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-5q7kf_dbe5e9e6-b08b-4321-aed2-6d79154df58b/storage-initializer/0.log" Jun 11 22:02:02.774553 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:02.774531 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-5q7kf_dbe5e9e6-b08b-4321-aed2-6d79154df58b/main/0.log" Jun 11 22:02:06.872014 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:06.871978 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lfrc4/must-gather-cd9ld"] Jun 11 22:02:06.872393 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:06.872374 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5845049-deec-4ed2-bdc6-4c506a8ba09e" containerName="authorino" Jun 11 22:02:06.872393 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:06.872385 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5845049-deec-4ed2-bdc6-4c506a8ba09e" containerName="authorino" Jun 11 22:02:06.872509 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:06.872417 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cc679c7-1274-40b3-a860-e3a46f9c0f23" containerName="manager" Jun 11 22:02:06.872509 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:06.872423 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cc679c7-1274-40b3-a860-e3a46f9c0f23" containerName="manager" Jun 11 22:02:06.872509 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:06.872501 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cc679c7-1274-40b3-a860-e3a46f9c0f23" containerName="manager" Jun 11 22:02:06.872613 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:06.872511 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5845049-deec-4ed2-bdc6-4c506a8ba09e" containerName="authorino" Jun 11 22:02:06.875918 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:06.875899 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfrc4/must-gather-cd9ld" Jun 11 22:02:06.878236 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:06.878215 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lfrc4\"/\"default-dockercfg-vbjnd\"" Jun 11 22:02:06.878358 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:06.878257 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lfrc4\"/\"kube-root-ca.crt\"" Jun 11 22:02:06.879149 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:06.879062 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lfrc4\"/\"openshift-service-ca.crt\"" Jun 11 22:02:06.882988 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:06.882967 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfrc4/must-gather-cd9ld"] Jun 11 22:02:06.938219 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:06.938193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6972cf3b-3c89-4b47-98c5-0b2b2225a890-must-gather-output\") pod \"must-gather-cd9ld\" (UID: \"6972cf3b-3c89-4b47-98c5-0b2b2225a890\") " pod="openshift-must-gather-lfrc4/must-gather-cd9ld" Jun 11 22:02:06.938379 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:06.938289 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5b5b\" (UniqueName: \"kubernetes.io/projected/6972cf3b-3c89-4b47-98c5-0b2b2225a890-kube-api-access-r5b5b\") pod \"must-gather-cd9ld\" (UID: \"6972cf3b-3c89-4b47-98c5-0b2b2225a890\") " pod="openshift-must-gather-lfrc4/must-gather-cd9ld" Jun 11 22:02:07.038773 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:07.038734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6972cf3b-3c89-4b47-98c5-0b2b2225a890-must-gather-output\") pod \"must-gather-cd9ld\" (UID: \"6972cf3b-3c89-4b47-98c5-0b2b2225a890\") " pod="openshift-must-gather-lfrc4/must-gather-cd9ld" Jun 11 22:02:07.038972 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:07.038827 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5b5b\" (UniqueName: \"kubernetes.io/projected/6972cf3b-3c89-4b47-98c5-0b2b2225a890-kube-api-access-r5b5b\") pod \"must-gather-cd9ld\" (UID: \"6972cf3b-3c89-4b47-98c5-0b2b2225a890\") " pod="openshift-must-gather-lfrc4/must-gather-cd9ld" Jun 11 22:02:07.039156 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:07.039133 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6972cf3b-3c89-4b47-98c5-0b2b2225a890-must-gather-output\") pod \"must-gather-cd9ld\" (UID: \"6972cf3b-3c89-4b47-98c5-0b2b2225a890\") " pod="openshift-must-gather-lfrc4/must-gather-cd9ld" Jun 11 22:02:07.046660 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:07.046631 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5b5b\" (UniqueName: \"kubernetes.io/projected/6972cf3b-3c89-4b47-98c5-0b2b2225a890-kube-api-access-r5b5b\") pod \"must-gather-cd9ld\" (UID: \"6972cf3b-3c89-4b47-98c5-0b2b2225a890\") " pod="openshift-must-gather-lfrc4/must-gather-cd9ld" Jun 11 22:02:07.187102 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:07.187019 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfrc4/must-gather-cd9ld" Jun 11 22:02:07.349000 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:07.348971 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfrc4/must-gather-cd9ld"] Jun 11 22:02:07.350346 ip-10-0-143-27 kubenswrapper[2581]: W0611 22:02:07.350320 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6972cf3b_3c89_4b47_98c5_0b2b2225a890.slice/crio-57976998ea68dfad560101afcf4f1f6a4d8dc2772211893b7c1ec11072326f09 WatchSource:0}: Error finding container 57976998ea68dfad560101afcf4f1f6a4d8dc2772211893b7c1ec11072326f09: Status 404 returned error can't find the container with id 57976998ea68dfad560101afcf4f1f6a4d8dc2772211893b7c1ec11072326f09 Jun 11 22:02:07.352383 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:07.352366 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 22:02:07.513523 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:07.513435 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfrc4/must-gather-cd9ld" event={"ID":"6972cf3b-3c89-4b47-98c5-0b2b2225a890","Type":"ContainerStarted","Data":"57976998ea68dfad560101afcf4f1f6a4d8dc2772211893b7c1ec11072326f09"} Jun 11 22:02:08.523916 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:08.523811 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfrc4/must-gather-cd9ld" event={"ID":"6972cf3b-3c89-4b47-98c5-0b2b2225a890","Type":"ContainerStarted","Data":"686dfcdad90ba34d845d20e06a93ebd3b1f3058b1f0e0fc21fc48450bebffa5e"} Jun 11 22:02:08.523916 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:08.523871 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfrc4/must-gather-cd9ld" event={"ID":"6972cf3b-3c89-4b47-98c5-0b2b2225a890","Type":"ContainerStarted","Data":"0f6d5767114c9824dbb351cb52c418a4de3b10e5990152919bd22699079f84d4"} Jun 11 22:02:08.541052 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:08.541004 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lfrc4/must-gather-cd9ld" podStartSLOduration=1.713249706 podStartE2EDuration="2.540989258s" totalImagesPullingTime="827.739552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:02:08.539128445 +0000 UTC m=+2500.313068408" watchObservedRunningTime="2026-06-11 22:02:08.540989258 +0000 UTC m=+2500.314929235" Jun 11 22:02:10.011053 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:10.010950 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g45jc_38e4770b-2228-4dff-802c-db3c7594d72c/global-pull-secret-syncer/0.log" Jun 11 22:02:10.179816 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:10.179782 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zcw2n_7dcf034e-3c12-488a-a82f-98b3e1cc1e3f/konnectivity-agent/0.log" Jun 11 22:02:10.248361 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:10.248335 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-27.ec2.internal_38e720e009b609e953d4b31cfb6f1c73/haproxy/0.log" Jun 11 22:02:14.388532 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:14.388485 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t_06c41b5a-10b0-46ea-8106-0aab05d0ce56/extract/0.log" Jun 11 22:02:14.417013 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:14.416986 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t_06c41b5a-10b0-46ea-8106-0aab05d0ce56/util/0.log" Jun 11 22:02:14.437913 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:14.437878 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bjs7t_06c41b5a-10b0-46ea-8106-0aab05d0ce56/pull/0.log" Jun 11 22:02:14.476459 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:14.476089 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb_ff82448e-9103-4621-903a-339e16f25b2c/extract/0.log" Jun 11 22:02:14.501874 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:14.501845 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb_ff82448e-9103-4621-903a-339e16f25b2c/util/0.log" Jun 11 22:02:14.532246 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:14.532217 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07btkb_ff82448e-9103-4621-903a-339e16f25b2c/pull/0.log" Jun 11 22:02:14.562242 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:14.562196 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5_ed32aa66-69a6-4768-b133-97f96299da7e/extract/0.log" Jun 11 22:02:14.585876 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:14.585846 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5_ed32aa66-69a6-4768-b133-97f96299da7e/util/0.log" Jun 11 22:02:14.608501 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:14.608471 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kfl5_ed32aa66-69a6-4768-b133-97f96299da7e/pull/0.log" Jun 11 22:02:14.636277 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:14.636251 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc_c360fd10-3d19-4479-bf51-e2fe5c1b21a9/extract/0.log" Jun 11 22:02:14.657934 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:14.657861 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc_c360fd10-3d19-4479-bf51-e2fe5c1b21a9/util/0.log" Jun 11 22:02:14.680527 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:14.680449 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzqvc_c360fd10-3d19-4479-bf51-e2fe5c1b21a9/pull/0.log" Jun 11 22:02:15.082378 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:15.082299 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6ff9684985-t2gjz_d2b085a5-a4a3-4140-bf35-2e5228181005/authorino/0.log" Jun 11 22:02:15.135936 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:15.135714 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-czvkt_b6695649-5176-4205-8ab8-c0c78a6b1b2d/manager/0.log" Jun 11 22:02:15.161365 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:15.161334 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cwwd2_aab7df73-7b4f-416f-be33-da5d40b7fa8d/manager/0.log" Jun 11 22:02:15.197267 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:15.197090 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hm7hx_18bbc26a-b81d-443c-a5b2-a02ee5197da3/kuadrant-console-plugin/0.log" Jun 11 22:02:15.253241 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:15.253208 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pkj9n_f0656a72-4a66-4211-ab56-85d03f2eb412/registry-server/0.log" Jun 11 22:02:15.439660 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:15.439633 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-d487g_1dcae654-278d-487c-a60f-160d9834b968/limitador/0.log" Jun 11 22:02:17.389015 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:17.388977 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-c7f42_f6386dd8-a909-4ecb-a26a-57b7e30d74f1/kube-state-metrics/0.log" Jun 11 22:02:17.407144 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:17.407116 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-c7f42_f6386dd8-a909-4ecb-a26a-57b7e30d74f1/kube-rbac-proxy-main/0.log" Jun 11 22:02:17.428563 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:17.428528 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-c7f42_f6386dd8-a909-4ecb-a26a-57b7e30d74f1/kube-rbac-proxy-self/0.log" Jun 11 22:02:17.479202 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:17.479109 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-tk28d_e87dfe88-0c22-4d15-98fe-2c767529645b/monitoring-plugin/0.log" Jun 11 22:02:17.527332 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:17.527301 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4th7l_a8bb4f4b-ed55-45c3-b976-d9a19dec98ce/node-exporter/0.log" Jun 11 22:02:17.548037 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:17.547967 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4th7l_a8bb4f4b-ed55-45c3-b976-d9a19dec98ce/kube-rbac-proxy/0.log" Jun 11 22:02:17.569051 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:17.568891 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4th7l_a8bb4f4b-ed55-45c3-b976-d9a19dec98ce/init-textfile/0.log" Jun 11 22:02:17.743817 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:17.743735 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pk2ck_2a4d587f-1f04-4ca5-b62d-3389bf663668/kube-rbac-proxy-main/0.log" Jun 11 22:02:17.766203 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:17.766161 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pk2ck_2a4d587f-1f04-4ca5-b62d-3389bf663668/kube-rbac-proxy-self/0.log" Jun 11 22:02:17.789012 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:17.788980 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pk2ck_2a4d587f-1f04-4ca5-b62d-3389bf663668/openshift-state-metrics/0.log" Jun 11 22:02:18.038658 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:18.038577 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-zhfcj_092b43c6-0f72-43f9-a7e3-372a64128f1f/prometheus-operator-admission-webhook/0.log" Jun 11 22:02:18.184913 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:18.184886 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5498774f75-4qhxz_6f6c8464-9329-4d8e-95f9-c53b24b2d9ae/thanos-query/0.log" Jun 11 22:02:18.205005 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:18.204973 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5498774f75-4qhxz_6f6c8464-9329-4d8e-95f9-c53b24b2d9ae/kube-rbac-proxy-web/0.log" Jun 11 22:02:18.227687 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:18.227659 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5498774f75-4qhxz_6f6c8464-9329-4d8e-95f9-c53b24b2d9ae/kube-rbac-proxy/0.log" Jun 11 22:02:18.248478 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:18.248447 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5498774f75-4qhxz_6f6c8464-9329-4d8e-95f9-c53b24b2d9ae/prom-label-proxy/0.log" Jun 11 22:02:18.271453 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:18.271392 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5498774f75-4qhxz_6f6c8464-9329-4d8e-95f9-c53b24b2d9ae/kube-rbac-proxy-rules/0.log" Jun 11 22:02:18.292597 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:18.292495 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5498774f75-4qhxz_6f6c8464-9329-4d8e-95f9-c53b24b2d9ae/kube-rbac-proxy-metrics/0.log" Jun 11 22:02:19.671966 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:19.671933 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-8jrp2_98aa7006-7fc7-4375-8d9f-51a8f9e0171a/networking-console-plugin/0.log" Jun 11 22:02:20.941420 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:20.941381 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9b77bcbb7-spwvd_6027f8fb-18ec-43d3-8d52-40088184715f/console/0.log" Jun 11 22:02:21.685560 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.685528 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-xd9h4_6a05d46a-3e83-441f-aeb3-391fe0481fe4/volume-data-source-validator/0.log" Jun 11 22:02:21.702650 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.702609 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6"] Jun 11 22:02:21.712044 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.711395 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.712646 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.712616 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6"] Jun 11 22:02:21.810674 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.810628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df0b73af-2194-4978-84fb-7003dbf7cd73-lib-modules\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.810934 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.810913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df0b73af-2194-4978-84fb-7003dbf7cd73-podres\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.811088 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.811072 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtmtk\" (UniqueName: \"kubernetes.io/projected/df0b73af-2194-4978-84fb-7003dbf7cd73-kube-api-access-dtmtk\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.811293 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.811276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df0b73af-2194-4978-84fb-7003dbf7cd73-proc\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.811456 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.811440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df0b73af-2194-4978-84fb-7003dbf7cd73-sys\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.912547 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.912499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmtk\" (UniqueName: \"kubernetes.io/projected/df0b73af-2194-4978-84fb-7003dbf7cd73-kube-api-access-dtmtk\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.912723 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.912640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df0b73af-2194-4978-84fb-7003dbf7cd73-proc\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.912723 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.912692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df0b73af-2194-4978-84fb-7003dbf7cd73-sys\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.912864 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.912744 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df0b73af-2194-4978-84fb-7003dbf7cd73-lib-modules\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.912864 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.912767 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df0b73af-2194-4978-84fb-7003dbf7cd73-podres\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.912986 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.912944 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df0b73af-2194-4978-84fb-7003dbf7cd73-podres\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.913161 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.913135 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df0b73af-2194-4978-84fb-7003dbf7cd73-sys\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.913321 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.913303 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df0b73af-2194-4978-84fb-7003dbf7cd73-proc\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.913480 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.913455 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df0b73af-2194-4978-84fb-7003dbf7cd73-lib-modules\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:21.920521 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:21.920496 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtmtk\" (UniqueName: \"kubernetes.io/projected/df0b73af-2194-4978-84fb-7003dbf7cd73-kube-api-access-dtmtk\") pod \"perf-node-gather-daemonset-6kmg6\" (UID: \"df0b73af-2194-4978-84fb-7003dbf7cd73\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:22.025591 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:22.025493 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:22.227704 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:22.227674 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6"] Jun 11 22:02:22.673715 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:22.673670 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" event={"ID":"df0b73af-2194-4978-84fb-7003dbf7cd73","Type":"ContainerStarted","Data":"c0526919f6bee027e04b5274bd2c24bd69db698fe1826f8db627139725dd2a3d"} Jun 11 22:02:22.673929 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:22.673744 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" event={"ID":"df0b73af-2194-4978-84fb-7003dbf7cd73","Type":"ContainerStarted","Data":"06c7dd5f63888c3105670f76b96878a7e8916c5c85886a374a3e84d90b1c7827"} Jun 11 22:02:22.674184 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:22.674162 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:22.692684 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:22.692626 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" podStartSLOduration=1.6926086740000001 podStartE2EDuration="1.692608674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:02:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:02:22.689556034 +0000 UTC m=+2514.463496009" watchObservedRunningTime="2026-06-11 22:02:22.692608674 +0000 UTC m=+2514.466548631" Jun 11 22:02:22.898807 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:22.898778 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8vn6m_cddedd15-ffbc-40cc-9327-b496b9474e62/dns/0.log" Jun 11 22:02:22.923491 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:22.923458 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8vn6m_cddedd15-ffbc-40cc-9327-b496b9474e62/kube-rbac-proxy/0.log" Jun 11 22:02:23.052220 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:23.052153 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xd2qc_95b638f6-e8d8-46fb-821b-dc717ecf393d/dns-node-resolver/0.log" Jun 11 22:02:23.639103 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:23.639074 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5478n_1c69230f-56d8-4a47-99de-65e6ca8ace50/node-ca/0.log" Jun 11 22:02:24.613183 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:24.613153 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcmhlnf_2dea163b-fc45-4bbf-907e-e5ce1cfdbe88/istio-proxy/0.log" Jun 11 22:02:24.793863 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:24.793827 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kk2ml_0bb113c6-175d-42b3-a21c-63f28a914cbe/istio-proxy/0.log" Jun 11 22:02:24.863442 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:24.863345 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kk2ml_0bb113c6-175d-42b3-a21c-63f28a914cbe/istio-proxy/1.log" Jun 11 22:02:25.020062 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:25.020035 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-595dc98f7b-hphqq_197e0956-cb50-413d-8ace-dac9967f2a80/router/0.log" Jun 11 22:02:25.631225 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:25.631198 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5l5kw_3bcfddbf-7cfb-4f14-8fa4-89e702554ddb/serve-healthcheck-canary/0.log" Jun 11 22:02:26.209091 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:26.209056 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-zl8nl_cbfce66f-8c70-4439-96bf-0fa73ae1a6af/insights-operator/0.log" Jun 11 22:02:26.213797 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:26.213769 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-zl8nl_cbfce66f-8c70-4439-96bf-0fa73ae1a6af/insights-operator/1.log" Jun 11 22:02:26.300641 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:26.300612 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qnszc_5317c62d-38f6-46b0-b670-2c3dd8be6dff/kube-rbac-proxy/0.log" Jun 11 22:02:26.324357 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:26.324329 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qnszc_5317c62d-38f6-46b0-b670-2c3dd8be6dff/exporter/0.log" Jun 11 22:02:26.347983 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:26.347929 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qnszc_5317c62d-38f6-46b0-b670-2c3dd8be6dff/extractor/0.log" Jun 11 22:02:28.612805 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:28.612767 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5bc579744d-7pd22_dd016104-07f0-4664-856c-84725af31488/nginx/0.log" Jun 11 22:02:28.691963 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:28.691934 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-6kmg6" Jun 11 22:02:29.258958 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:29.258926 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75f49467f8-jg7lj_6fa9368c-aacd-4ccd-b7f5-c156d3a53239/manager/0.log" Jun 11 22:02:29.285146 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:29.285118 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75f49467f8-jg7lj_6fa9368c-aacd-4ccd-b7f5-c156d3a53239/copy-manifests/0.log" Jun 11 22:02:31.037314 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:31.037280 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56b9fd76f8-lghkl_707dc652-4859-4945-942e-42ddecadc248/manager/0.log" Jun 11 22:02:34.900222 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:34.900191 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcmhlnf_2dea163b-fc45-4bbf-907e-e5ce1cfdbe88/istio-proxy/0.log" Jun 11 22:02:35.061681 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:35.061654 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kk2ml_0bb113c6-175d-42b3-a21c-63f28a914cbe/istio-proxy/0.log" Jun 11 22:02:35.124231 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:35.124200 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kk2ml_0bb113c6-175d-42b3-a21c-63f28a914cbe/istio-proxy/1.log" Jun 11 22:02:35.265912 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:35.265842 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-595dc98f7b-hphqq_197e0956-cb50-413d-8ace-dac9967f2a80/router/0.log" Jun 11 22:02:36.356020 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:36.355979 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcmhlnf_2dea163b-fc45-4bbf-907e-e5ce1cfdbe88/istio-proxy/0.log" Jun 11 22:02:36.502974 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:36.502930 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kk2ml_0bb113c6-175d-42b3-a21c-63f28a914cbe/istio-proxy/0.log" Jun 11 22:02:36.564038 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:36.564002 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kk2ml_0bb113c6-175d-42b3-a21c-63f28a914cbe/istio-proxy/1.log" Jun 11 22:02:36.698422 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:36.698374 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-595dc98f7b-hphqq_197e0956-cb50-413d-8ace-dac9967f2a80/router/0.log" Jun 11 22:02:36.938312 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:36.938280 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-nhxxh_29bb2707-c217-4af7-bed1-b2a0800942ec/kube-storage-version-migrator-operator/1.log" Jun 11 22:02:36.940111 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:36.940059 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-nhxxh_29bb2707-c217-4af7-bed1-b2a0800942ec/kube-storage-version-migrator-operator/0.log" Jun 11 22:02:38.320081 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:38.320049 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcmhlnf_2dea163b-fc45-4bbf-907e-e5ce1cfdbe88/istio-proxy/0.log" Jun 11 22:02:38.511177 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:38.511148 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kk2ml_0bb113c6-175d-42b3-a21c-63f28a914cbe/istio-proxy/0.log" Jun 11 22:02:38.559454 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:38.559424 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9jlb_a95ef77e-0ed6-41b7-ac1d-55b120e47925/kube-multus-additional-cni-plugins/0.log" Jun 11 22:02:38.592946 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:38.592860 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9jlb_a95ef77e-0ed6-41b7-ac1d-55b120e47925/egress-router-binary-copy/0.log" Jun 11 22:02:38.594771 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:38.594744 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kk2ml_0bb113c6-175d-42b3-a21c-63f28a914cbe/istio-proxy/1.log" Jun 11 22:02:38.613254 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:38.613235 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9jlb_a95ef77e-0ed6-41b7-ac1d-55b120e47925/cni-plugins/0.log" Jun 11 22:02:38.634473 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:38.634454 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9jlb_a95ef77e-0ed6-41b7-ac1d-55b120e47925/bond-cni-plugin/0.log" Jun 11 22:02:38.656606 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:38.656588 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9jlb_a95ef77e-0ed6-41b7-ac1d-55b120e47925/routeoverride-cni/0.log" Jun 11 22:02:38.677703 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:38.677685 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9jlb_a95ef77e-0ed6-41b7-ac1d-55b120e47925/whereabouts-cni-bincopy/0.log" Jun 11 22:02:38.698973 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:38.698954 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9jlb_a95ef77e-0ed6-41b7-ac1d-55b120e47925/whereabouts-cni/0.log" Jun 11 22:02:38.720486 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:38.720466 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-595dc98f7b-hphqq_197e0956-cb50-413d-8ace-dac9967f2a80/router/0.log" Jun 11 22:02:38.742551 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:38.742530 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g26gz_8253ee99-b103-44c9-a010-4dfe7bd592c5/kube-multus/0.log" Jun 11 22:02:38.919475 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:38.919450 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k5xgg_0e097be0-6ad1-4fea-9652-09fe7e0b89e1/network-metrics-daemon/0.log" Jun 11 22:02:38.946616 ip-10-0-143-27 kubenswrapper[2581]: I0611 22:02:38.946583 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k5xgg_0e097be0-6ad1-4fea-9652-09fe7e0b89e1/kube-rbac-proxy/0.log"