Jun 03 19:20:54.729344 ip-10-0-137-13 systemd[1]: Starting Kubernetes Kubelet... Jun 03 19:20:55.130833 ip-10-0-137-13 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:20:55.130833 ip-10-0-137-13 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 19:20:55.130833 ip-10-0-137-13 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:20:55.130833 ip-10-0-137-13 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 19:20:55.130833 ip-10-0-137-13 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:20:55.131882 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.131791 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 19:20:55.136803 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136781 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:55.136803 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136800 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:55.136803 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136805 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:55.136803 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136809 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136812 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136815 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136818 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136821 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136824 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136826 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136829 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136832 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136834 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136837 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136839 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136842 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136845 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136847 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136850 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136852 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136855 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136857 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136862 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:55.136982 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136866 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136872 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136875 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136877 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136881 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136884 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136887 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136890 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136893 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136896 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136899 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136901 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136905 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136907 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136910 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136914 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136916 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136919 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136921 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136924 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:55.137893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136927 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136930 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136932 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136935 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136937 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136940 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136942 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136946 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136948 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136951 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136953 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136956 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136958 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136961 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136963 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136966 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136968 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136971 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136975 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:55.138381 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136978 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136982 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136986 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136989 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136992 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136995 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.136998 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137001 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137004 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137006 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137009 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137012 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137014 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137017 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137020 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137023 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137025 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137028 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137030 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:55.138821 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137033 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137035 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137038 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137041 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137043 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137046 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137048 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137051 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137053 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137056 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137071 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137073 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137076 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137079 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137082 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137085 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137087 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137809 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137816 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137820 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:55.139289 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137825 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137828 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137831 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137833 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137836 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137839 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137842 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137844 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137847 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137850 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137853 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137855 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137858 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137860 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137863 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137866 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137869 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137872 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137874 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137877 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:55.139750 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137880 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137882 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137885 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137887 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137890 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137892 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137895 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137898 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137901 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137904 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137906 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137909 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137912 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137914 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137917 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137919 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137922 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137925 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137927 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137930 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:55.140245 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137932 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137935 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137937 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137940 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137942 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137945 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137948 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137950 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137953 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137956 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137958 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137961 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137963 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137966 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137968 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137971 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137973 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137976 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137978 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137981 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:55.140725 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137983 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137986 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137988 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137991 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137993 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137996 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.137998 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138001 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138003 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138006 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138008 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138011 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138013 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138016 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138018 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138021 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138023 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138028 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138032 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:55.141214 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138034 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138037 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138041 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138045 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138047 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138050 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138053 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138069 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138073 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138077 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138080 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138083 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138086 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138089 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138092 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138095 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138463 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138468 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138471 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:55.141659 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138473 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138476 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138479 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138481 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138484 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138486 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138489 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138491 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138494 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138496 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138499 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138502 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138505 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138507 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138510 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138514 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138516 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138519 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138523 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:55.142112 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138527 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138530 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138533 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138541 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138544 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138547 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138550 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138553 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138555 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138558 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138561 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138564 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138566 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138569 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138572 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138574 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138577 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138579 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138582 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138584 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:55.142558 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138587 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138589 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138592 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138594 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138596 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138599 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138603 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138605 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138608 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138611 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138614 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138616 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138619 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138621 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138624 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138628 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138631 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138633 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138636 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138638 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:55.143049 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138641 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138643 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138646 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138648 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138651 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138654 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138656 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138659 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138661 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138664 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138666 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138671 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138674 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138679 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138682 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138685 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138688 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138690 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138693 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:55.143522 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138695 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138698 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138700 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138705 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138707 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138710 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138712 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138715 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138718 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138721 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138723 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138726 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138728 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138731 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138733 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138736 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.138738 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138811 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138818 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138824 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138829 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 19:20:55.143959 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138833 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138836 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138840 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138844 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138851 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138854 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138857 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138860 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138872 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138876 2577 flags.go:64] FLAG: --cgroup-root="" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138878 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138882 2577 flags.go:64] FLAG: --client-ca-file="" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138885 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138889 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138893 2577 flags.go:64] FLAG: --cluster-domain="" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138896 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138900 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138903 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138906 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138912 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138914 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138917 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138921 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138924 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 03 19:20:55.144504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138927 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138930 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138933 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138936 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138940 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138943 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138945 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138948 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138951 2577 flags.go:64] FLAG: --enable-server="true" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138954 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138958 2577 flags.go:64] FLAG: --event-burst="100" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138961 2577 flags.go:64] FLAG: --event-qps="50" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138965 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138968 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138971 2577 flags.go:64] FLAG: --eviction-hard="" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138975 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138978 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138981 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138984 2577 flags.go:64] FLAG: --eviction-soft="" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138987 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138990 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138992 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138995 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.138998 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139002 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 19:20:55.145194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139004 2577 flags.go:64] FLAG: --feature-gates="" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139008 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139013 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139016 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139019 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139022 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139025 2577 flags.go:64] FLAG: --help="false" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139027 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139031 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139033 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139036 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139040 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139043 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139045 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139048 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139051 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139054 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139057 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139072 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139076 2577 flags.go:64] FLAG: --kube-reserved="" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139079 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139082 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139085 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139088 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 19:20:55.145912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139091 2577 flags.go:64] FLAG: --lock-file="" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139094 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139097 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139099 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139105 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139108 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139111 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139114 2577 flags.go:64] FLAG: --logging-format="text" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139118 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139121 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139125 2577 flags.go:64] FLAG: --manifest-url="" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139128 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139132 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139135 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139139 2577 flags.go:64] FLAG: --max-pods="110" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139142 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139145 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139147 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139150 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139153 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139156 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139159 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139166 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139169 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139172 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 19:20:55.146928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139175 2577 flags.go:64] FLAG: --pod-cidr="" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139178 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139184 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139188 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139191 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139194 2577 flags.go:64] FLAG: --port="10250" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139197 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139200 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06432a10a23b6cd22" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139203 2577 flags.go:64] FLAG: --qos-reserved="" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139206 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139209 2577 flags.go:64] FLAG: --register-node="true" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139212 2577 flags.go:64] FLAG: --register-with-taints="" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139215 2577 flags.go:64] FLAG: --registry-burst="10" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139218 2577 flags.go:64] FLAG: --registry-qps="5" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139221 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139224 2577 flags.go:64] FLAG: --reserved-memory="" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139228 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139232 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139235 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139238 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139241 2577 flags.go:64] FLAG: --runonce="false" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139243 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139246 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139249 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139252 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 19:20:55.147997 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139255 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139258 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139261 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139264 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139266 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139269 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139272 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139274 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139277 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139281 2577 flags.go:64] FLAG: --system-cgroups="" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139287 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139292 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139295 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139298 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139302 2577 flags.go:64] FLAG: --tls-min-version="" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139304 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139307 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139310 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139313 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139316 2577 flags.go:64] FLAG: --v="2" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139320 2577 flags.go:64] FLAG: --version="false" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139323 2577 flags.go:64] FLAG: --vmodule="" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139327 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.139330 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 19:20:55.148644 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139443 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139446 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139450 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139452 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139455 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139458 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139460 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139463 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139465 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139468 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139470 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139473 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139475 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139478 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139480 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139483 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139485 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139489 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139493 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:55.149593 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139495 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139498 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139500 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139503 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139506 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139508 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139511 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139513 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139516 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139518 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139521 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139523 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139526 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139530 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139533 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139536 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139538 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139541 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139544 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139546 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:55.150352 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139548 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139551 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139553 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139556 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139558 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139561 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139563 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139566 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139568 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139571 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139573 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139577 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139582 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139585 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139588 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139591 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139594 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139597 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139600 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:55.150835 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139603 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139606 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139608 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139611 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139613 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139616 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139619 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139621 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139627 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139630 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139632 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139635 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139637 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139640 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139642 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139644 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139647 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139650 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139652 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139655 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:55.151521 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139657 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139660 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139662 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139666 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139672 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139674 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139677 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139680 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139682 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139685 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139687 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139689 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139692 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139694 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139697 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139700 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139703 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139705 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139708 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:55.152204 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.139710 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.140447 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.147983 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.148003 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.148758 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.148774 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148870 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148878 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148883 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148888 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148893 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148898 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148902 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148907 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148911 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:55.152968 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148915 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148919 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148923 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148927 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148932 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148936 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148940 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148944 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148949 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148953 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148957 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148961 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148966 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148970 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148977 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148983 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148987 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148992 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.148997 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:55.153484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149001 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149011 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149016 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149020 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149025 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149029 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149035 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149040 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149045 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149049 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149053 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149079 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149086 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149091 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149095 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149099 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149104 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149108 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149112 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:55.154072 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149116 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149120 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149124 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149128 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149133 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149137 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149141 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149146 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149150 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149154 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149158 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149162 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149166 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149170 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149175 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149180 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149185 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149189 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149193 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149197 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:55.154534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149201 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149205 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149210 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149214 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149218 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149222 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149226 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149229 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149233 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149238 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149242 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149246 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149250 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149254 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149258 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149262 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149266 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149269 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149275 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149279 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:55.155028 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149284 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149288 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149292 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149296 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149300 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149304 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149308 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149313 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149317 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149322 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149326 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.149334 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149530 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149538 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149543 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:55.155580 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149548 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149552 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149556 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149560 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149567 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149573 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149578 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149582 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149587 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149591 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149619 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149626 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149631 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149636 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149640 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149645 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149650 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149654 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149659 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:55.155941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149663 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149668 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149673 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149677 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149681 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149685 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149689 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149700 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149705 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149711 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149717 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149722 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149726 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149730 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149734 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149738 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149742 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149746 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149750 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149754 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:55.156482 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149758 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149762 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149767 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149771 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149775 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149779 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149783 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149787 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149791 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149796 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149800 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149804 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149808 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149812 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149816 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149820 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149824 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149828 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149832 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149836 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:55.156970 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149842 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149846 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149850 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149854 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149860 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149866 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149872 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149876 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149881 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149885 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149889 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149893 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149897 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149901 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149905 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149909 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149913 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149917 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149921 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149925 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:55.157484 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149930 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149934 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149938 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149942 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149946 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149950 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149954 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149959 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149963 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149970 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149976 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149981 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149986 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149991 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149995 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:55.158071 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:55.149999 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:55.158430 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.150007 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:20:55.158430 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.151186 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 19:20:55.158430 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.153768 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 19:20:55.158430 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.155299 2577 server.go:1019] "Starting client certificate rotation" Jun 03 19:20:55.158430 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.155418 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:20:55.158430 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.155447 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:20:55.159148 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.159102 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:20:55.162407 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.162259 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:20:55.169804 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.169788 2577 log.go:25] "Validated CRI v1 runtime API" Jun 03 19:20:55.172616 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.172602 2577 log.go:25] "Validated CRI v1 image API" Jun 03 19:20:55.174099 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.174079 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 19:20:55.176795 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.176773 2577 fs.go:135] Filesystem UUIDs: map[24df55b0-6830-4ef8-8d80-a5eb725c2005:/dev/nvme0n1p3 2b7fd63d-297b-4eed-b1f1-0e2718c374e4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 03 19:20:55.176863 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.176795 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 19:20:55.181711 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.181601 2577 manager.go:216] Machine: {Timestamp:2026-06-03 19:20:55.180384699 +0000 UTC m=+0.334184670 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3197484 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ca87c7569f7dcabdae6e8c3b0edbe SystemUUID:ec2ca87c-7569-f7dc-abda-e6e8c3b0edbe BootID:debc911f-a3c3-45cc-a01a-e606d616f951 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:44:98:b8:c8:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:44:98:b8:c8:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:60:18:94:e2:73 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 19:20:55.181711 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.181702 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 19:20:55.181829 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.181780 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 19:20:55.184196 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.184176 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:20:55.184519 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.184491 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 19:20:55.184652 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.184520 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-13.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 19:20:55.185105 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.185096 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 19:20:55.185142 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.185108 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 19:20:55.185142 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.185115 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:20:55.185653 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.185643 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:20:55.186391 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.186382 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 19:20:55.189096 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.189085 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:20:55.189209 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.189200 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 19:20:55.189240 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.189228 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 03 19:20:55.189240 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.189238 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 19:20:55.189293 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.189281 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 19:20:55.189293 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.189291 2577 kubelet.go:398] "Adding apiserver pod source" Jun 03 19:20:55.189351 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.189313 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 19:20:55.189687 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.189673 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:20:55.189737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.189698 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:20:55.191659 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.191642 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 19:20:55.193697 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.193675 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 19:20:55.193782 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.193722 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 19:20:55.194572 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.194550 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 19:20:55.194647 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.194577 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 19:20:55.194647 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.194589 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 19:20:55.194647 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.194598 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 19:20:55.194647 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.194619 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 19:20:55.194647 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.194627 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 19:20:55.194877 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.194860 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 19:20:55.194927 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.194879 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 19:20:55.194927 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.194889 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 19:20:55.194927 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.194898 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 19:20:55.194927 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.194911 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 19:20:55.194927 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.194923 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 19:20:55.195933 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.195916 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 19:20:55.196007 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.195951 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 19:20:55.199685 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.199638 2577 server.go:1268] "Started kubelet" Jun 03 19:20:55.199760 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.199712 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 19:20:55.199802 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.199752 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 19:20:55.199841 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.199817 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 19:20:55.200295 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.200034 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-13.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 19:20:55.200677 ip-10-0-137-13 systemd[1]: Started Kubernetes Kubelet. Jun 03 19:20:55.201308 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.200794 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 19:20:55.201308 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.200865 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 03 19:20:55.201308 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.201161 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 19:20:55.201308 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.201210 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-13.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 19:20:55.205331 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.205313 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dblqq" Jun 03 19:20:55.206023 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.205131 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-13.ec2.internal.18b5a876a39ef61d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-13.ec2.internal,UID:ip-10-0-137-13.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-13.ec2.internal,},FirstTimestamp:2026-06-03 19:20:55.199610397 +0000 UTC m=+0.353410368,LastTimestamp:2026-06-03 19:20:55.199610397 +0000 UTC m=+0.353410368,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-13.ec2.internal,}" Jun 03 19:20:55.206334 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.206318 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 19:20:55.206549 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.206534 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 19:20:55.206602 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.206547 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 19:20:55.206661 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.206651 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-13.ec2.internal\" not found" Jun 03 19:20:55.207160 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.207073 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 19:20:55.207160 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.207102 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 19:20:55.207160 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.207112 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 19:20:55.207344 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.207251 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 03 19:20:55.207344 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.207262 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 03 19:20:55.207433 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.207423 2577 factory.go:55] Registering systemd factory Jun 03 19:20:55.207504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.207442 2577 factory.go:223] Registration of the systemd container factory successfully Jun 03 19:20:55.207663 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.207646 2577 factory.go:153] Registering CRI-O factory Jun 03 19:20:55.207663 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.207662 2577 factory.go:223] Registration of the crio container factory successfully Jun 03 19:20:55.207751 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.207714 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 19:20:55.207751 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.207740 2577 factory.go:103] Registering Raw factory Jun 03 19:20:55.207833 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.207758 2577 manager.go:1196] Started watching for new ooms in manager Jun 03 19:20:55.208146 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.208135 2577 manager.go:349] Starting recovery of all containers Jun 03 19:20:55.214438 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.214420 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dblqq" Jun 03 19:20:55.217018 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.216988 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-13.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 19:20:55.217125 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.217048 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 19:20:55.219475 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.219460 2577 manager.go:354] Recovery completed Jun 03 19:20:55.224514 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.224503 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:55.226318 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.226300 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:55.226382 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.226329 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:55.226382 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.226340 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:55.226844 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.226829 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 19:20:55.226918 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.226845 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 19:20:55.226918 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.226849 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:55.226918 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.226870 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:20:55.227596 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.227580 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:55.227672 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.227610 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:55.227672 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.227624 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:55.227947 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.227923 2577 policy_none.go:49] "None policy: Start" Jun 03 19:20:55.227947 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.227940 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 19:20:55.228038 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.227950 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 19:20:55.228861 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.228850 2577 policy_none.go:47] "Start" Jun 03 19:20:55.262710 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.262694 2577 manager.go:337] "Starting Device Plugin manager" Jun 03 19:20:55.271626 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.262749 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 19:20:55.271626 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.262759 2577 server.go:87] "Starting device plugin registration server" Jun 03 19:20:55.271626 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.262991 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 19:20:55.271626 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.263004 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 19:20:55.271626 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.263110 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 19:20:55.271626 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.263188 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 19:20:55.271626 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.263196 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 19:20:55.271626 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.264034 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 19:20:55.271626 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.264103 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-13.ec2.internal\" not found" Jun 03 19:20:55.271626 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.271512 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 19:20:55.272591 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.272575 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 19:20:55.272640 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.272611 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 19:20:55.272640 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.272632 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 19:20:55.272706 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.272663 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 19:20:55.274783 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.274757 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:55.363572 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.363534 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:55.365053 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.365035 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:55.365136 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.365084 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:55.365136 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.365095 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:55.365136 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.365118 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.372790 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.372756 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-13.ec2.internal"] Jun 03 19:20:55.372862 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.372834 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:55.373726 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.373711 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.373773 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.373734 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-13.ec2.internal\": node \"ip-10-0-137-13.ec2.internal\" not found" Jun 03 19:20:55.374245 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.374230 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:55.374294 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.374256 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:55.374294 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.374267 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:55.375415 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.375404 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:55.375534 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.375519 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.375576 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.375550 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:55.376276 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.376263 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:55.376332 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.376286 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:55.376332 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.376300 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:55.376394 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.376349 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:55.376394 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.376366 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:55.376394 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.376375 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:55.377535 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.377517 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.377609 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.377548 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:55.379985 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.379967 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:55.380098 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.379997 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:55.380098 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.380010 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:55.389409 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.389388 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-13.ec2.internal\" not found" Jun 03 19:20:55.400545 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.400529 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-13.ec2.internal\" not found" node="ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.404806 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.404790 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-13.ec2.internal\" not found" node="ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.407882 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.407867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aba584d3128a6123134dfb0f7b4799f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal\" (UID: \"aba584d3128a6123134dfb0f7b4799f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.407957 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.407890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7eb3c1cfcb49aa68904ca072c5dfae8e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-13.ec2.internal\" (UID: \"7eb3c1cfcb49aa68904ca072c5dfae8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.407957 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.407908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aba584d3128a6123134dfb0f7b4799f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal\" (UID: \"aba584d3128a6123134dfb0f7b4799f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.489744 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.489678 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-13.ec2.internal\" not found" Jun 03 19:20:55.508537 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.508510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7eb3c1cfcb49aa68904ca072c5dfae8e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-13.ec2.internal\" (UID: \"7eb3c1cfcb49aa68904ca072c5dfae8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.508608 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.508543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aba584d3128a6123134dfb0f7b4799f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal\" (UID: \"aba584d3128a6123134dfb0f7b4799f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.508608 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.508562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aba584d3128a6123134dfb0f7b4799f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal\" (UID: \"aba584d3128a6123134dfb0f7b4799f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.508608 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.508594 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aba584d3128a6123134dfb0f7b4799f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal\" (UID: \"aba584d3128a6123134dfb0f7b4799f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.508704 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.508599 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7eb3c1cfcb49aa68904ca072c5dfae8e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-13.ec2.internal\" (UID: \"7eb3c1cfcb49aa68904ca072c5dfae8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.508704 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.508617 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aba584d3128a6123134dfb0f7b4799f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal\" (UID: \"aba584d3128a6123134dfb0f7b4799f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.590469 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.590430 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-13.ec2.internal\" not found" Jun 03 19:20:55.691095 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.691048 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-13.ec2.internal\" not found" Jun 03 19:20:55.703216 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.703192 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.708750 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:55.708729 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-13.ec2.internal" Jun 03 19:20:55.791278 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.791178 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-13.ec2.internal\" not found" Jun 03 19:20:55.891691 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.891655 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-13.ec2.internal\" not found" Jun 03 19:20:55.992292 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:55.992252 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-13.ec2.internal\" not found" Jun 03 19:20:56.092899 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:56.092827 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-13.ec2.internal\" not found" Jun 03 19:20:56.124860 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:56.124682 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba584d3128a6123134dfb0f7b4799f8.slice/crio-21e2a457efc3d0d08e040bcb602dc03724ac92550ef83c4498af50b18020ad78 WatchSource:0}: Error finding container 21e2a457efc3d0d08e040bcb602dc03724ac92550ef83c4498af50b18020ad78: Status 404 returned error can't find the container with id 21e2a457efc3d0d08e040bcb602dc03724ac92550ef83c4498af50b18020ad78 Jun 03 19:20:56.125140 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:56.125119 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb3c1cfcb49aa68904ca072c5dfae8e.slice/crio-9e19a2d9557181df91bc83f2c843dc9067df68ddab647b74da8cee667e85a671 WatchSource:0}: Error finding container 9e19a2d9557181df91bc83f2c843dc9067df68ddab647b74da8cee667e85a671: Status 404 returned error can't find the container with id 9e19a2d9557181df91bc83f2c843dc9067df68ddab647b74da8cee667e85a671 Jun 03 19:20:56.132039 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:56.132023 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:20:56.154814 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:56.154789 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 19:20:56.154963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:56.154944 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 19:20:56.193302 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:56.193271 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-13.ec2.internal\" not found" Jun 03 19:20:56.217143 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:56.217097 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 19:15:55 +0000 UTC" deadline="2027-12-19 09:33:31.028347139 +0000 UTC" Jun 03 19:20:56.217143 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:56.217139 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13526h12m34.811211216s" Jun 03 19:20:56.276885 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:56.276839 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-13.ec2.internal" event={"ID":"7eb3c1cfcb49aa68904ca072c5dfae8e","Type":"ContainerStarted","Data":"9e19a2d9557181df91bc83f2c843dc9067df68ddab647b74da8cee667e85a671"} Jun 03 19:20:56.277704 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:56.277685 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal" event={"ID":"aba584d3128a6123134dfb0f7b4799f8","Type":"ContainerStarted","Data":"21e2a457efc3d0d08e040bcb602dc03724ac92550ef83c4498af50b18020ad78"} Jun 03 19:20:56.293864 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:56.293823 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-13.ec2.internal\" not found" Jun 03 19:20:56.390872 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:56.390788 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:56.407210 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:56.407184 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal" Jun 03 19:20:56.420430 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:56.420410 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:20:56.422214 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:56.422195 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-13.ec2.internal" Jun 03 19:20:56.434222 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:56.434203 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:20:56.653397 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:56.653307 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:56.666924 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:56.666892 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:57.183622 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.183585 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:57.190601 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.190577 2577 apiserver.go:52] "Watching apiserver" Jun 03 19:20:57.201471 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.201447 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 19:20:57.201922 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.201889 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-13.ec2.internal","openshift-cluster-node-tuning-operator/tuned-z7lk2","openshift-image-registry/node-ca-zqdtg","openshift-multus/multus-additional-cni-plugins-b9v8s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5","openshift-dns/node-resolver-sn9xs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal","openshift-multus/multus-n7g4g","openshift-multus/network-metrics-daemon-s7c4p","openshift-network-diagnostics/network-check-target-p9vvq","openshift-network-operator/iptables-alerter-nlc45","openshift-ovn-kubernetes/ovnkube-node-jzxkd","kube-system/global-pull-secret-syncer-mqnqr","kube-system/konnectivity-agent-mb5qw"] Jun 03 19:20:57.203400 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.203380 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:20:57.203517 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.203463 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:20:57.204452 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.204423 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:20:57.204563 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.204500 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:20:57.205904 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.205881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zqdtg" Jun 03 19:20:57.206974 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.206955 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 19:20:57.207082 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.206997 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.208276 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.208256 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.208896 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.208752 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 19:20:57.208896 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.208790 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8jrb2\"" Jun 03 19:20:57.209177 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.209116 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 19:20:57.209177 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.209137 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 19:20:57.210716 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.210462 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 19:20:57.210716 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.210462 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 19:20:57.210716 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.210505 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 19:20:57.210716 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.210614 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4bzd2\"" Jun 03 19:20:57.210716 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.210712 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sn9xs" Jun 03 19:20:57.211029 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.210740 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 19:20:57.211029 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.210806 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 19:20:57.211029 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.210941 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mgswd\"" Jun 03 19:20:57.211344 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.211323 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 19:20:57.211589 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.211570 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 19:20:57.212078 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.211998 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 19:20:57.212173 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.212155 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:20:57.212309 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.212243 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:20:57.214102 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.213607 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 19:20:57.214102 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.214014 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 19:20:57.214532 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.214340 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9wbtv\"" Jun 03 19:20:57.214957 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.214924 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mb5qw" Jun 03 19:20:57.216675 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.216652 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.217510 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h5q5\" (UniqueName: \"kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5\") pod \"network-check-target-p9vvq\" (UID: \"15ad0998-4dc6-4890-9184-5e504eb46b77\") " pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:20:57.217599 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-dbus\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:20:57.217599 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7347a83b-e12c-4675-abe4-87c8bf2b2a44-host\") pod \"node-ca-zqdtg\" (UID: \"7347a83b-e12c-4675-abe4-87c8bf2b2a44\") " pod="openshift-image-registry/node-ca-zqdtg" Jun 03 19:20:57.217599 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa17f395-1ee9-4474-b12f-c79309f369e8-system-cni-dir\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.217599 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa17f395-1ee9-4474-b12f-c79309f369e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.217813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217613 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-etc-selinux\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.217813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217656 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:20:57.217813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8c8g\" (UniqueName: \"kubernetes.io/projected/7347a83b-e12c-4675-abe4-87c8bf2b2a44-kube-api-access-c8c8g\") pod \"node-ca-zqdtg\" (UID: \"7347a83b-e12c-4675-abe4-87c8bf2b2a44\") " pod="openshift-image-registry/node-ca-zqdtg" Jun 03 19:20:57.217813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa17f395-1ee9-4474-b12f-c79309f369e8-os-release\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.217813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217749 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa17f395-1ee9-4474-b12f-c79309f369e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.217813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa17f395-1ee9-4474-b12f-c79309f369e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.217813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-socket-dir\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.218218 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-kubelet-config\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:20:57.218218 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7347a83b-e12c-4675-abe4-87c8bf2b2a44-serviceca\") pod \"node-ca-zqdtg\" (UID: \"7347a83b-e12c-4675-abe4-87c8bf2b2a44\") " pod="openshift-image-registry/node-ca-zqdtg" Jun 03 19:20:57.218218 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa17f395-1ee9-4474-b12f-c79309f369e8-cnibin\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.218218 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-device-dir\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.218218 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.217975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-sys-fs\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.218218 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.218009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa17f395-1ee9-4474-b12f-c79309f369e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.218218 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.218042 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlk6j\" (UniqueName: \"kubernetes.io/projected/fa17f395-1ee9-4474-b12f-c79309f369e8-kube-api-access-tlk6j\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.218218 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.218142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.218218 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.218166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-registration-dir\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.218218 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.218192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jppg9\" (UniqueName: \"kubernetes.io/projected/9468a394-94c2-4c0b-9360-37fe6976b942-kube-api-access-jppg9\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.218686 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.218342 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 19:20:57.218686 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.218367 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7bqjp\"" Jun 03 19:20:57.218686 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.218586 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 19:20:57.218686 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.218624 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.219625 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.219606 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 19:20:57.219625 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.219617 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:20:57.219768 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.219608 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-425bm\"" Jun 03 19:20:57.219889 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.219859 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nlc45" Jun 03 19:20:57.221127 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.221109 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.221319 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.221300 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:20:57.222499 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.222475 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nb6jm\"" Jun 03 19:20:57.222499 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.222494 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 19:20:57.222744 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.222723 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:20:57.223592 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.223575 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 19:20:57.223668 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.223639 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-77cdc\"" Jun 03 19:20:57.223668 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.223580 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 19:20:57.225940 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.225924 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 19:20:57.226073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.226047 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xqt6d\"" Jun 03 19:20:57.226477 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.226292 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 19:20:57.226477 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.226300 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 19:20:57.226477 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.226307 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 19:20:57.226477 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.226378 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 19:20:57.226477 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.226390 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 19:20:57.242382 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.242362 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hkkbd" Jun 03 19:20:57.250309 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.250292 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hkkbd" Jun 03 19:20:57.307851 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.307819 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 19:20:57.318760 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.318732 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adf23483-48d6-4496-a6ae-5a656a1289e6-host-slash\") pod \"iptables-alerter-nlc45\" (UID: \"adf23483-48d6-4496-a6ae-5a656a1289e6\") " pod="openshift-network-operator/iptables-alerter-nlc45" Jun 03 19:20:57.318915 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.318769 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b80904c-705a-43ea-a92e-aec87054d9a9-ovnkube-script-lib\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.318915 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.318788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85f61ce5-2bce-478c-96a4-4082d38e04aa-hosts-file\") pod \"node-resolver-sn9xs\" (UID: \"85f61ce5-2bce-478c-96a4-4082d38e04aa\") " pod="openshift-dns/node-resolver-sn9xs" Jun 03 19:20:57.318915 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.318804 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-systemd\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.318915 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.318845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wld2g\" (UniqueName: \"kubernetes.io/projected/adf23483-48d6-4496-a6ae-5a656a1289e6-kube-api-access-wld2g\") pod \"iptables-alerter-nlc45\" (UID: \"adf23483-48d6-4496-a6ae-5a656a1289e6\") " pod="openshift-network-operator/iptables-alerter-nlc45" Jun 03 19:20:57.318915 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.318894 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h5q5\" (UniqueName: \"kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5\") pod \"network-check-target-p9vvq\" (UID: \"15ad0998-4dc6-4890-9184-5e504eb46b77\") " pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:20:57.319160 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.318921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7347a83b-e12c-4675-abe4-87c8bf2b2a44-host\") pod \"node-ca-zqdtg\" (UID: \"7347a83b-e12c-4675-abe4-87c8bf2b2a44\") " pod="openshift-image-registry/node-ca-zqdtg" Jun 03 19:20:57.319160 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.318946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa17f395-1ee9-4474-b12f-c79309f369e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.319160 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.318969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-sysconfig\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.319160 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.318990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-host\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.319160 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319009 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7347a83b-e12c-4675-abe4-87c8bf2b2a44-host\") pod \"node-ca-zqdtg\" (UID: \"7347a83b-e12c-4675-abe4-87c8bf2b2a44\") " pod="openshift-image-registry/node-ca-zqdtg" Jun 03 19:20:57.319160 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whwfm\" (UniqueName: \"kubernetes.io/projected/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-kube-api-access-whwfm\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.319160 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa17f395-1ee9-4474-b12f-c79309f369e8-os-release\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.319160 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa17f395-1ee9-4474-b12f-c79309f369e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.319508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319174 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa17f395-1ee9-4474-b12f-c79309f369e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.319508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319213 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85f61ce5-2bce-478c-96a4-4082d38e04aa-tmp-dir\") pod \"node-resolver-sn9xs\" (UID: \"85f61ce5-2bce-478c-96a4-4082d38e04aa\") " pod="openshift-dns/node-resolver-sn9xs" Jun 03 19:20:57.319508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa17f395-1ee9-4474-b12f-c79309f369e8-os-release\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.319508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319233 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt8nc\" (UniqueName: \"kubernetes.io/projected/995cd1f6-5df5-45c1-80cf-1921f567c92f-kube-api-access-kt8nc\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:20:57.319508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319254 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-multus-socket-dir-parent\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.319508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-run-k8s-cni-cncf-io\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.319508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-hostroot\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.319508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-kubelet\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.319508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7347a83b-e12c-4675-abe4-87c8bf2b2a44-serviceca\") pod \"node-ca-zqdtg\" (UID: \"7347a83b-e12c-4675-abe4-87c8bf2b2a44\") " pod="openshift-image-registry/node-ca-zqdtg" Jun 03 19:20:57.319508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319368 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-device-dir\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.319508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-etc-kubernetes\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.319508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319477 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-device-dir\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.319508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-var-lib-openvswitch\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.319508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319507 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-node-log\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319525 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-var-lib-cni-multus\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa17f395-1ee9-4474-b12f-c79309f369e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319596 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlk6j\" (UniqueName: \"kubernetes.io/projected/fa17f395-1ee9-4474-b12f-c79309f369e8-kube-api-access-tlk6j\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319711 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa17f395-1ee9-4474-b12f-c79309f369e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319734 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jppg9\" (UniqueName: \"kubernetes.io/projected/9468a394-94c2-4c0b-9360-37fe6976b942-kube-api-access-jppg9\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319766 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7347a83b-e12c-4675-abe4-87c8bf2b2a44-serviceca\") pod \"node-ca-zqdtg\" (UID: \"7347a83b-e12c-4675-abe4-87c8bf2b2a44\") " pod="openshift-image-registry/node-ca-zqdtg" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7362bdb-bb9f-45ef-886c-6681b6477b0a-cni-binary-copy\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319823 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-multus-conf-dir\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfhbv\" (UniqueName: \"kubernetes.io/projected/f7362bdb-bb9f-45ef-886c-6681b6477b0a-kube-api-access-wfhbv\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-var-lib-cni-bin\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319894 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-dbus\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319936 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c01f875-c8ce-40f5-93b4-24b85c92f915-agent-certs\") pod \"konnectivity-agent-mb5qw\" (UID: \"3c01f875-c8ce-40f5-93b4-24b85c92f915\") " pod="kube-system/konnectivity-agent-mb5qw" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319954 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-run-netns\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.319976 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-run-netns\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.320073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320037 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jgcn\" (UniqueName: \"kubernetes.io/projected/5b80904c-705a-43ea-a92e-aec87054d9a9-kube-api-access-6jgcn\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320036 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa17f395-1ee9-4474-b12f-c79309f369e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320105 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-dbus\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320112 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-socket-dir\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320183 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-run\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.320186 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320206 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-var-lib-kubelet\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320231 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-cnibin\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.320264 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret podName:6f5da0f5-156c-4957-9bda-9ca3ee8424d5 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:57.820243045 +0000 UTC m=+2.974043014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret") pod "global-pull-secret-syncer-mqnqr" (UID: "6f5da0f5-156c-4957-9bda-9ca3ee8424d5") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adf23483-48d6-4496-a6ae-5a656a1289e6-iptables-alerter-script\") pod \"iptables-alerter-nlc45\" (UID: \"adf23483-48d6-4496-a6ae-5a656a1289e6\") " pod="openshift-network-operator/iptables-alerter-nlc45" Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320288 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-socket-dir\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320317 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-run-systemd\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320348 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b80904c-705a-43ea-a92e-aec87054d9a9-env-overrides\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320377 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-kubernetes\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.320846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320430 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-log-socket\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320461 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-cni-netd\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320509 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-multus-cni-dir\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-os-release\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320553 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-systemd-units\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-run-openvswitch\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-modprobe-d\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-tuned\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320638 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c01f875-c8ce-40f5-93b4-24b85c92f915-konnectivity-ca\") pod \"konnectivity-agent-mb5qw\" (UID: \"3c01f875-c8ce-40f5-93b4-24b85c92f915\") " pod="kube-system/konnectivity-agent-mb5qw" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-kubelet-config\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa17f395-1ee9-4474-b12f-c79309f369e8-cnibin\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-kubelet-config\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-sys-fs\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8vwc\" (UniqueName: \"kubernetes.io/projected/85f61ce5-2bce-478c-96a4-4082d38e04aa-kube-api-access-p8vwc\") pod \"node-resolver-sn9xs\" (UID: \"85f61ce5-2bce-478c-96a4-4082d38e04aa\") " pod="openshift-dns/node-resolver-sn9xs" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320779 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-sys-fs\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320779 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-slash\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.321476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-cni-bin\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320814 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa17f395-1ee9-4474-b12f-c79309f369e8-cnibin\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320858 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b80904c-705a-43ea-a92e-aec87054d9a9-ovnkube-config\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-registration-dir\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-sysctl-d\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320963 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-registration-dir\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-sysctl-conf\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.320996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-lib-modules\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321030 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b80904c-705a-43ea-a92e-aec87054d9a9-ovn-node-metrics-cert\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa17f395-1ee9-4474-b12f-c79309f369e8-system-cni-dir\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321127 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa17f395-1ee9-4474-b12f-c79309f369e8-system-cni-dir\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-etc-selinux\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321197 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9468a394-94c2-4c0b-9360-37fe6976b942-etc-selinux\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-sys\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-tmp\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.322051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321276 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-etc-openvswitch\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.322571 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8c8g\" (UniqueName: \"kubernetes.io/projected/7347a83b-e12c-4675-abe4-87c8bf2b2a44-kube-api-access-c8c8g\") pod \"node-ca-zqdtg\" (UID: \"7347a83b-e12c-4675-abe4-87c8bf2b2a44\") " pod="openshift-image-registry/node-ca-zqdtg" Jun 03 19:20:57.322571 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa17f395-1ee9-4474-b12f-c79309f369e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.322571 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321364 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7362bdb-bb9f-45ef-886c-6681b6477b0a-multus-daemon-config\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.322571 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-run-ovn\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.322571 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321429 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-system-cni-dir\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.322571 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-var-lib-kubelet\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.322571 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321497 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-run-multus-certs\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.322571 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.321759 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa17f395-1ee9-4474-b12f-c79309f369e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.329546 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.329527 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:20:57.329546 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.329548 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:20:57.329673 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.329560 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4h5q5 for pod openshift-network-diagnostics/network-check-target-p9vvq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:57.329673 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.329620 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5 podName:15ad0998-4dc6-4890-9184-5e504eb46b77 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:57.829606995 +0000 UTC m=+2.983406956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4h5q5" (UniqueName: "kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5") pod "network-check-target-p9vvq" (UID: "15ad0998-4dc6-4890-9184-5e504eb46b77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:57.330495 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.330467 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 19:20:57.333629 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.333602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlk6j\" (UniqueName: \"kubernetes.io/projected/fa17f395-1ee9-4474-b12f-c79309f369e8-kube-api-access-tlk6j\") pod \"multus-additional-cni-plugins-b9v8s\" (UID: \"fa17f395-1ee9-4474-b12f-c79309f369e8\") " pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.333728 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.333663 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jppg9\" (UniqueName: \"kubernetes.io/projected/9468a394-94c2-4c0b-9360-37fe6976b942-kube-api-access-jppg9\") pod \"aws-ebs-csi-driver-node-4gwk5\" (UID: \"9468a394-94c2-4c0b-9360-37fe6976b942\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.336624 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.336603 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8c8g\" (UniqueName: \"kubernetes.io/projected/7347a83b-e12c-4675-abe4-87c8bf2b2a44-kube-api-access-c8c8g\") pod \"node-ca-zqdtg\" (UID: \"7347a83b-e12c-4675-abe4-87c8bf2b2a44\") " pod="openshift-image-registry/node-ca-zqdtg" Jun 03 19:20:57.422726 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422683 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-run-k8s-cni-cncf-io\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.422726 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-hostroot\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-kubelet\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-etc-kubernetes\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422777 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-run-k8s-cni-cncf-io\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422801 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-var-lib-openvswitch\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-node-log\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422845 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-var-lib-cni-multus\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422870 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-etc-kubernetes\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422881 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7362bdb-bb9f-45ef-886c-6681b6477b0a-cni-binary-copy\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422885 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-var-lib-cni-multus\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422893 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-hostroot\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422869 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-var-lib-openvswitch\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422835 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-kubelet\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422912 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-node-log\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-multus-conf-dir\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.422963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfhbv\" (UniqueName: \"kubernetes.io/projected/f7362bdb-bb9f-45ef-886c-6681b6477b0a-kube-api-access-wfhbv\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.422979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-var-lib-cni-bin\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c01f875-c8ce-40f5-93b4-24b85c92f915-agent-certs\") pod \"konnectivity-agent-mb5qw\" (UID: \"3c01f875-c8ce-40f5-93b4-24b85c92f915\") " pod="kube-system/konnectivity-agent-mb5qw" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423007 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-multus-conf-dir\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-run-netns\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423043 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-var-lib-cni-bin\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423095 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-run-netns\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-run-netns\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423132 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jgcn\" (UniqueName: \"kubernetes.io/projected/5b80904c-705a-43ea-a92e-aec87054d9a9-kube-api-access-6jgcn\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423105 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-run-netns\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-run\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423214 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423222 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-var-lib-kubelet\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423252 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-cnibin\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423283 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-run\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423326 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-cnibin\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423255 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-var-lib-kubelet\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.423619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423283 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adf23483-48d6-4496-a6ae-5a656a1289e6-iptables-alerter-script\") pod \"iptables-alerter-nlc45\" (UID: \"adf23483-48d6-4496-a6ae-5a656a1289e6\") " pod="openshift-network-operator/iptables-alerter-nlc45" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-run-systemd\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b80904c-705a-43ea-a92e-aec87054d9a9-env-overrides\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423424 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7362bdb-bb9f-45ef-886c-6681b6477b0a-cni-binary-copy\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-kubernetes\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423445 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-run-systemd\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423468 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-kubernetes\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423475 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-log-socket\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-cni-netd\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423509 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-log-socket\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423526 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423547 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-cni-netd\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-multus-cni-dir\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423584 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-os-release\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-multus-cni-dir\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-systemd-units\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-run-openvswitch\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-modprobe-d\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.424392 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.423670 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-tuned\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423687 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-os-release\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423636 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-systemd-units\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423709 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c01f875-c8ce-40f5-93b4-24b85c92f915-konnectivity-ca\") pod \"konnectivity-agent-mb5qw\" (UID: \"3c01f875-c8ce-40f5-93b4-24b85c92f915\") " pod="kube-system/konnectivity-agent-mb5qw" Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.423720 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs podName:995cd1f6-5df5-45c1-80cf-1921f567c92f nodeName:}" failed. No retries permitted until 2026-06-03 19:20:57.92370451 +0000 UTC m=+3.077504469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs") pod "network-metrics-daemon-s7c4p" (UID: "995cd1f6-5df5-45c1-80cf-1921f567c92f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423742 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-run-openvswitch\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423794 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adf23483-48d6-4496-a6ae-5a656a1289e6-iptables-alerter-script\") pod \"iptables-alerter-nlc45\" (UID: \"adf23483-48d6-4496-a6ae-5a656a1289e6\") " pod="openshift-network-operator/iptables-alerter-nlc45" Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423810 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-modprobe-d\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423866 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b80904c-705a-43ea-a92e-aec87054d9a9-env-overrides\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423870 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8vwc\" (UniqueName: \"kubernetes.io/projected/85f61ce5-2bce-478c-96a4-4082d38e04aa-kube-api-access-p8vwc\") pod \"node-resolver-sn9xs\" (UID: \"85f61ce5-2bce-478c-96a4-4082d38e04aa\") " pod="openshift-dns/node-resolver-sn9xs" Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-slash\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-cni-bin\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.423984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b80904c-705a-43ea-a92e-aec87054d9a9-ovnkube-config\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424020 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-sysctl-d\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.425201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424025 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424041 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-sysctl-conf\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-lib-modules\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424096 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-slash\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b80904c-705a-43ea-a92e-aec87054d9a9-ovn-node-metrics-cert\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424132 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-sys\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-tmp\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-etc-openvswitch\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7362bdb-bb9f-45ef-886c-6681b6477b0a-multus-daemon-config\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424210 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-sysctl-d\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424214 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-sysctl-conf\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424244 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c01f875-c8ce-40f5-93b4-24b85c92f915-konnectivity-ca\") pod \"konnectivity-agent-mb5qw\" (UID: \"3c01f875-c8ce-40f5-93b4-24b85c92f915\") " pod="kube-system/konnectivity-agent-mb5qw" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424230 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-run-ovn\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424284 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-run-ovn\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424288 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-etc-openvswitch\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-system-cni-dir\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424135 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b80904c-705a-43ea-a92e-aec87054d9a9-host-cni-bin\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424248 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-lib-modules\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.425908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-sys\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424343 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-system-cni-dir\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-var-lib-kubelet\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424414 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-var-lib-kubelet\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424416 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-run-multus-certs\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adf23483-48d6-4496-a6ae-5a656a1289e6-host-slash\") pod \"iptables-alerter-nlc45\" (UID: \"adf23483-48d6-4496-a6ae-5a656a1289e6\") " pod="openshift-network-operator/iptables-alerter-nlc45" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424455 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-host-run-multus-certs\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424498 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adf23483-48d6-4496-a6ae-5a656a1289e6-host-slash\") pod \"iptables-alerter-nlc45\" (UID: \"adf23483-48d6-4496-a6ae-5a656a1289e6\") " pod="openshift-network-operator/iptables-alerter-nlc45" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424532 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b80904c-705a-43ea-a92e-aec87054d9a9-ovnkube-script-lib\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424551 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b80904c-705a-43ea-a92e-aec87054d9a9-ovnkube-config\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85f61ce5-2bce-478c-96a4-4082d38e04aa-hosts-file\") pod \"node-resolver-sn9xs\" (UID: \"85f61ce5-2bce-478c-96a4-4082d38e04aa\") " pod="openshift-dns/node-resolver-sn9xs" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-systemd\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wld2g\" (UniqueName: \"kubernetes.io/projected/adf23483-48d6-4496-a6ae-5a656a1289e6-kube-api-access-wld2g\") pod \"iptables-alerter-nlc45\" (UID: \"adf23483-48d6-4496-a6ae-5a656a1289e6\") " pod="openshift-network-operator/iptables-alerter-nlc45" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424609 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85f61ce5-2bce-478c-96a4-4082d38e04aa-hosts-file\") pod \"node-resolver-sn9xs\" (UID: \"85f61ce5-2bce-478c-96a4-4082d38e04aa\") " pod="openshift-dns/node-resolver-sn9xs" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-sysconfig\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424656 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-systemd\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-host\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whwfm\" (UniqueName: \"kubernetes.io/projected/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-kube-api-access-whwfm\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.426737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85f61ce5-2bce-478c-96a4-4082d38e04aa-tmp-dir\") pod \"node-resolver-sn9xs\" (UID: \"85f61ce5-2bce-478c-96a4-4082d38e04aa\") " pod="openshift-dns/node-resolver-sn9xs" Jun 03 19:20:57.427586 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424745 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt8nc\" (UniqueName: \"kubernetes.io/projected/995cd1f6-5df5-45c1-80cf-1921f567c92f-kube-api-access-kt8nc\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:20:57.427586 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-multus-socket-dir-parent\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.427586 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424812 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7362bdb-bb9f-45ef-886c-6681b6477b0a-multus-daemon-config\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.427586 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424844 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7362bdb-bb9f-45ef-886c-6681b6477b0a-multus-socket-dir-parent\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.427586 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.424910 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-sysconfig\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.427586 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.425024 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b80904c-705a-43ea-a92e-aec87054d9a9-ovnkube-script-lib\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.427586 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.425127 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-host\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.427586 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.425154 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85f61ce5-2bce-478c-96a4-4082d38e04aa-tmp-dir\") pod \"node-resolver-sn9xs\" (UID: \"85f61ce5-2bce-478c-96a4-4082d38e04aa\") " pod="openshift-dns/node-resolver-sn9xs" Jun 03 19:20:57.427586 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.426282 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-etc-tuned\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.427586 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.426636 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-tmp\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.427586 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.426833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c01f875-c8ce-40f5-93b4-24b85c92f915-agent-certs\") pod \"konnectivity-agent-mb5qw\" (UID: \"3c01f875-c8ce-40f5-93b4-24b85c92f915\") " pod="kube-system/konnectivity-agent-mb5qw" Jun 03 19:20:57.428248 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.428231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b80904c-705a-43ea-a92e-aec87054d9a9-ovn-node-metrics-cert\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.435994 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.435932 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jgcn\" (UniqueName: \"kubernetes.io/projected/5b80904c-705a-43ea-a92e-aec87054d9a9-kube-api-access-6jgcn\") pod \"ovnkube-node-jzxkd\" (UID: \"5b80904c-705a-43ea-a92e-aec87054d9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.442159 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.441693 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8vwc\" (UniqueName: \"kubernetes.io/projected/85f61ce5-2bce-478c-96a4-4082d38e04aa-kube-api-access-p8vwc\") pod \"node-resolver-sn9xs\" (UID: \"85f61ce5-2bce-478c-96a4-4082d38e04aa\") " pod="openshift-dns/node-resolver-sn9xs" Jun 03 19:20:57.442159 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.442106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whwfm\" (UniqueName: \"kubernetes.io/projected/b5effdf9-fff6-46b8-932a-df3c0e8a1dd3-kube-api-access-whwfm\") pod \"tuned-z7lk2\" (UID: \"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.442499 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.442476 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wld2g\" (UniqueName: \"kubernetes.io/projected/adf23483-48d6-4496-a6ae-5a656a1289e6-kube-api-access-wld2g\") pod \"iptables-alerter-nlc45\" (UID: \"adf23483-48d6-4496-a6ae-5a656a1289e6\") " pod="openshift-network-operator/iptables-alerter-nlc45" Jun 03 19:20:57.442765 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.442745 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt8nc\" (UniqueName: \"kubernetes.io/projected/995cd1f6-5df5-45c1-80cf-1921f567c92f-kube-api-access-kt8nc\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:20:57.443015 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.442993 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfhbv\" (UniqueName: \"kubernetes.io/projected/f7362bdb-bb9f-45ef-886c-6681b6477b0a-kube-api-access-wfhbv\") pod \"multus-n7g4g\" (UID: \"f7362bdb-bb9f-45ef-886c-6681b6477b0a\") " pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.518418 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.518364 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zqdtg" Jun 03 19:20:57.526241 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.526216 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b9v8s" Jun 03 19:20:57.533916 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.533896 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" Jun 03 19:20:57.537375 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.537358 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sn9xs" Jun 03 19:20:57.543658 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.543643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mb5qw" Jun 03 19:20:57.548957 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.548940 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" Jun 03 19:20:57.555439 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.555423 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n7g4g" Jun 03 19:20:57.564317 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.564297 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nlc45" Jun 03 19:20:57.568865 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.568848 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:20:57.826753 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.826649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:20:57.826919 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.826801 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:57.826919 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.826877 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret podName:6f5da0f5-156c-4957-9bda-9ca3ee8424d5 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:58.826846899 +0000 UTC m=+3.980646861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret") pod "global-pull-secret-syncer-mqnqr" (UID: "6f5da0f5-156c-4957-9bda-9ca3ee8424d5") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:57.867776 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:57.867740 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7347a83b_e12c_4675_abe4_87c8bf2b2a44.slice/crio-258d92e575012c7260f7fd1dabb5cf1f7c7c55207d74bf2db0e39888ff618fc0 WatchSource:0}: Error finding container 258d92e575012c7260f7fd1dabb5cf1f7c7c55207d74bf2db0e39888ff618fc0: Status 404 returned error can't find the container with id 258d92e575012c7260f7fd1dabb5cf1f7c7c55207d74bf2db0e39888ff618fc0 Jun 03 19:20:57.868697 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:57.868674 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa17f395_1ee9_4474_b12f_c79309f369e8.slice/crio-a3aced9922c3e1511721a6f41b205bfca8eb3e516a5c5e8536f6f68556652f77 WatchSource:0}: Error finding container a3aced9922c3e1511721a6f41b205bfca8eb3e516a5c5e8536f6f68556652f77: Status 404 returned error can't find the container with id a3aced9922c3e1511721a6f41b205bfca8eb3e516a5c5e8536f6f68556652f77 Jun 03 19:20:57.870502 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:57.870355 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5effdf9_fff6_46b8_932a_df3c0e8a1dd3.slice/crio-915eee38155760c683d61d4a5cf054be78169edc647d04ad2839082c405ef7c3 WatchSource:0}: Error finding container 915eee38155760c683d61d4a5cf054be78169edc647d04ad2839082c405ef7c3: Status 404 returned error can't find the container with id 915eee38155760c683d61d4a5cf054be78169edc647d04ad2839082c405ef7c3 Jun 03 19:20:57.875856 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:57.875835 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c01f875_c8ce_40f5_93b4_24b85c92f915.slice/crio-47df565d82d6f58afca22c1d1396d50a47c3863264e71d6ac933d9ff5716c0e6 WatchSource:0}: Error finding container 47df565d82d6f58afca22c1d1396d50a47c3863264e71d6ac933d9ff5716c0e6: Status 404 returned error can't find the container with id 47df565d82d6f58afca22c1d1396d50a47c3863264e71d6ac933d9ff5716c0e6 Jun 03 19:20:57.876201 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:57.876151 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7362bdb_bb9f_45ef_886c_6681b6477b0a.slice/crio-66be785c66a66fd853e4219e028d9bc798275756b0b0b11d41cef3fc2a6a8412 WatchSource:0}: Error finding container 66be785c66a66fd853e4219e028d9bc798275756b0b0b11d41cef3fc2a6a8412: Status 404 returned error can't find the container with id 66be785c66a66fd853e4219e028d9bc798275756b0b0b11d41cef3fc2a6a8412 Jun 03 19:20:57.877461 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:57.877426 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf23483_48d6_4496_a6ae_5a656a1289e6.slice/crio-d6b765e6366ecf1348a05466de0e7dd47e0363fcf6629af49c6440dcafe0c076 WatchSource:0}: Error finding container d6b765e6366ecf1348a05466de0e7dd47e0363fcf6629af49c6440dcafe0c076: Status 404 returned error can't find the container with id d6b765e6366ecf1348a05466de0e7dd47e0363fcf6629af49c6440dcafe0c076 Jun 03 19:20:57.878279 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:57.877977 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b80904c_705a_43ea_a92e_aec87054d9a9.slice/crio-2fdfcf56485727f76a0ff53dff7fd4bd86f1723263d08f3ee6d6991fe88e055f WatchSource:0}: Error finding container 2fdfcf56485727f76a0ff53dff7fd4bd86f1723263d08f3ee6d6991fe88e055f: Status 404 returned error can't find the container with id 2fdfcf56485727f76a0ff53dff7fd4bd86f1723263d08f3ee6d6991fe88e055f Jun 03 19:20:57.880779 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:57.879137 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9468a394_94c2_4c0b_9360_37fe6976b942.slice/crio-c2ed265bdc7bf2de8d5f4751cc1c16fd8313aaa51b635d72a3f39bcc43b7cebc WatchSource:0}: Error finding container c2ed265bdc7bf2de8d5f4751cc1c16fd8313aaa51b635d72a3f39bcc43b7cebc: Status 404 returned error can't find the container with id c2ed265bdc7bf2de8d5f4751cc1c16fd8313aaa51b635d72a3f39bcc43b7cebc Jun 03 19:20:57.881013 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:20:57.880941 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f61ce5_2bce_478c_96a4_4082d38e04aa.slice/crio-3c6599aba7f7c95fef69c587b562fa7ccd0844f351c6f37d97bc4466b6965eaa WatchSource:0}: Error finding container 3c6599aba7f7c95fef69c587b562fa7ccd0844f351c6f37d97bc4466b6965eaa: Status 404 returned error can't find the container with id 3c6599aba7f7c95fef69c587b562fa7ccd0844f351c6f37d97bc4466b6965eaa Jun 03 19:20:57.927081 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.927046 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h5q5\" (UniqueName: \"kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5\") pod \"network-check-target-p9vvq\" (UID: \"15ad0998-4dc6-4890-9184-5e504eb46b77\") " pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:20:57.927196 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:57.927126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:20:57.927257 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.927224 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:20:57.927257 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.927246 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:20:57.927257 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.927247 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:57.927388 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.927258 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4h5q5 for pod openshift-network-diagnostics/network-check-target-p9vvq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:57.927388 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.927309 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5 podName:15ad0998-4dc6-4890-9184-5e504eb46b77 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:58.927290335 +0000 UTC m=+4.081090316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4h5q5" (UniqueName: "kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5") pod "network-check-target-p9vvq" (UID: "15ad0998-4dc6-4890-9184-5e504eb46b77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:57.927388 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:57.927325 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs podName:995cd1f6-5df5-45c1-80cf-1921f567c92f nodeName:}" failed. No retries permitted until 2026-06-03 19:20:58.927316982 +0000 UTC m=+4.081116940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs") pod "network-metrics-daemon-s7c4p" (UID: "995cd1f6-5df5-45c1-80cf-1921f567c92f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:58.252489 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.252428 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:15:57 +0000 UTC" deadline="2027-11-01 07:12:23.056414142 +0000 UTC" Jun 03 19:20:58.252489 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.252487 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12371h51m24.803931119s" Jun 03 19:20:58.285462 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.285422 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-13.ec2.internal" event={"ID":"7eb3c1cfcb49aa68904ca072c5dfae8e","Type":"ContainerStarted","Data":"f78f44c58c8811eec4042cffac190800afd01d593a9a4b0fbe8aaf815df1299a"} Jun 03 19:20:58.287886 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.287839 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" event={"ID":"9468a394-94c2-4c0b-9360-37fe6976b942","Type":"ContainerStarted","Data":"c2ed265bdc7bf2de8d5f4751cc1c16fd8313aaa51b635d72a3f39bcc43b7cebc"} Jun 03 19:20:58.292920 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.292891 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nlc45" event={"ID":"adf23483-48d6-4496-a6ae-5a656a1289e6","Type":"ContainerStarted","Data":"d6b765e6366ecf1348a05466de0e7dd47e0363fcf6629af49c6440dcafe0c076"} Jun 03 19:20:58.298300 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.296816 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" event={"ID":"5b80904c-705a-43ea-a92e-aec87054d9a9","Type":"ContainerStarted","Data":"2fdfcf56485727f76a0ff53dff7fd4bd86f1723263d08f3ee6d6991fe88e055f"} Jun 03 19:20:58.298433 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.298309 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mb5qw" event={"ID":"3c01f875-c8ce-40f5-93b4-24b85c92f915","Type":"ContainerStarted","Data":"47df565d82d6f58afca22c1d1396d50a47c3863264e71d6ac933d9ff5716c0e6"} Jun 03 19:20:58.302643 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.302590 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-13.ec2.internal" podStartSLOduration=2.302561663 podStartE2EDuration="2.302561663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:20:58.301967365 +0000 UTC m=+3.455767346" watchObservedRunningTime="2026-06-03 19:20:58.302561663 +0000 UTC m=+3.456361642" Jun 03 19:20:58.303408 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.303382 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" event={"ID":"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3","Type":"ContainerStarted","Data":"915eee38155760c683d61d4a5cf054be78169edc647d04ad2839082c405ef7c3"} Jun 03 19:20:58.307513 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.307487 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9v8s" event={"ID":"fa17f395-1ee9-4474-b12f-c79309f369e8","Type":"ContainerStarted","Data":"a3aced9922c3e1511721a6f41b205bfca8eb3e516a5c5e8536f6f68556652f77"} Jun 03 19:20:58.314268 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.314205 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zqdtg" event={"ID":"7347a83b-e12c-4675-abe4-87c8bf2b2a44","Type":"ContainerStarted","Data":"258d92e575012c7260f7fd1dabb5cf1f7c7c55207d74bf2db0e39888ff618fc0"} Jun 03 19:20:58.320821 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.320274 2577 generic.go:356] "Generic (PLEG): container finished" podID="aba584d3128a6123134dfb0f7b4799f8" containerID="a1ebf14ecb393581409e1e2d71f5d7e57a2eba4c993edde595ef3a39c2fdf773" exitCode=0 Jun 03 19:20:58.320821 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.320432 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal" event={"ID":"aba584d3128a6123134dfb0f7b4799f8","Type":"ContainerDied","Data":"a1ebf14ecb393581409e1e2d71f5d7e57a2eba4c993edde595ef3a39c2fdf773"} Jun 03 19:20:58.325563 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.324748 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sn9xs" event={"ID":"85f61ce5-2bce-478c-96a4-4082d38e04aa","Type":"ContainerStarted","Data":"3c6599aba7f7c95fef69c587b562fa7ccd0844f351c6f37d97bc4466b6965eaa"} Jun 03 19:20:58.327585 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.327128 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n7g4g" event={"ID":"f7362bdb-bb9f-45ef-886c-6681b6477b0a","Type":"ContainerStarted","Data":"66be785c66a66fd853e4219e028d9bc798275756b0b0b11d41cef3fc2a6a8412"} Jun 03 19:20:58.834524 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.834310 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:20:58.834691 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:58.834618 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:58.834691 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:58.834686 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret podName:6f5da0f5-156c-4957-9bda-9ca3ee8424d5 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:00.834666515 +0000 UTC m=+5.988466487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret") pod "global-pull-secret-syncer-mqnqr" (UID: "6f5da0f5-156c-4957-9bda-9ca3ee8424d5") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:58.935191 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.935148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:20:58.935372 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:58.935227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h5q5\" (UniqueName: \"kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5\") pod \"network-check-target-p9vvq\" (UID: \"15ad0998-4dc6-4890-9184-5e504eb46b77\") " pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:20:58.935433 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:58.935393 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:20:58.935433 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:58.935432 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:20:58.935538 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:58.935445 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4h5q5 for pod openshift-network-diagnostics/network-check-target-p9vvq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:58.935538 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:58.935503 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5 podName:15ad0998-4dc6-4890-9184-5e504eb46b77 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:00.935484858 +0000 UTC m=+6.089284818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4h5q5" (UniqueName: "kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5") pod "network-check-target-p9vvq" (UID: "15ad0998-4dc6-4890-9184-5e504eb46b77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:58.936157 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:58.935952 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:58.936157 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:58.936003 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs podName:995cd1f6-5df5-45c1-80cf-1921f567c92f nodeName:}" failed. No retries permitted until 2026-06-03 19:21:00.935988961 +0000 UTC m=+6.089788921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs") pod "network-metrics-daemon-s7c4p" (UID: "995cd1f6-5df5-45c1-80cf-1921f567c92f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:59.253325 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:59.253209 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:15:57 +0000 UTC" deadline="2028-01-30 18:04:36.404382616 +0000 UTC" Jun 03 19:20:59.253325 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:59.253273 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14542h43m37.151113357s" Jun 03 19:20:59.275082 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:59.275003 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:20:59.275082 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:59.275020 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:20:59.275348 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:59.275166 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:20:59.275348 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:59.275216 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:20:59.275348 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:59.275335 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:20:59.275520 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:20:59.275412 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:20:59.345260 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:20:59.345228 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal" event={"ID":"aba584d3128a6123134dfb0f7b4799f8","Type":"ContainerStarted","Data":"78668eca126115a6e4bc1100383894443c51b165cc87f7422f393ed27a3f46c8"} Jun 03 19:21:00.850896 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:00.850790 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:00.851387 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:00.851001 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:00.851387 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:00.851094 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret podName:6f5da0f5-156c-4957-9bda-9ca3ee8424d5 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:04.851073438 +0000 UTC m=+10.004873411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret") pod "global-pull-secret-syncer-mqnqr" (UID: "6f5da0f5-156c-4957-9bda-9ca3ee8424d5") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:00.951837 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:00.951796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h5q5\" (UniqueName: \"kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5\") pod \"network-check-target-p9vvq\" (UID: \"15ad0998-4dc6-4890-9184-5e504eb46b77\") " pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:00.951998 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:00.951879 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:00.952056 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:00.952009 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:00.952132 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:00.952085 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs podName:995cd1f6-5df5-45c1-80cf-1921f567c92f nodeName:}" failed. No retries permitted until 2026-06-03 19:21:04.952051004 +0000 UTC m=+10.105850966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs") pod "network-metrics-daemon-s7c4p" (UID: "995cd1f6-5df5-45c1-80cf-1921f567c92f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:00.952563 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:00.952456 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:21:00.952563 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:00.952488 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:21:00.952563 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:00.952502 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4h5q5 for pod openshift-network-diagnostics/network-check-target-p9vvq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:00.952563 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:00.952571 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5 podName:15ad0998-4dc6-4890-9184-5e504eb46b77 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:04.952554603 +0000 UTC m=+10.106354579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4h5q5" (UniqueName: "kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5") pod "network-check-target-p9vvq" (UID: "15ad0998-4dc6-4890-9184-5e504eb46b77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:01.273859 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:01.273781 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:01.274011 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:01.273793 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:01.274011 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:01.273925 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:21:01.274011 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:01.273997 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:21:01.274291 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:01.273797 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:01.274291 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:01.274095 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:21:03.273602 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:03.273566 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:03.274040 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:03.273694 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:21:03.274040 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:03.273566 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:03.274040 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:03.273791 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:21:03.274040 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:03.273866 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:03.274040 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:03.273952 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:21:04.887880 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:04.887843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:04.888335 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:04.888007 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:04.888335 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:04.888091 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret podName:6f5da0f5-156c-4957-9bda-9ca3ee8424d5 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:12.88805678 +0000 UTC m=+18.041856741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret") pod "global-pull-secret-syncer-mqnqr" (UID: "6f5da0f5-156c-4957-9bda-9ca3ee8424d5") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:04.988893 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:04.988856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h5q5\" (UniqueName: \"kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5\") pod \"network-check-target-p9vvq\" (UID: \"15ad0998-4dc6-4890-9184-5e504eb46b77\") " pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:04.989098 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:04.988936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:04.989098 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:04.989043 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:04.989098 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:04.989050 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:21:04.989098 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:04.989087 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:21:04.989098 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:04.989102 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4h5q5 for pod openshift-network-diagnostics/network-check-target-p9vvq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:04.989310 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:04.989121 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs podName:995cd1f6-5df5-45c1-80cf-1921f567c92f nodeName:}" failed. No retries permitted until 2026-06-03 19:21:12.989100918 +0000 UTC m=+18.142900879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs") pod "network-metrics-daemon-s7c4p" (UID: "995cd1f6-5df5-45c1-80cf-1921f567c92f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:04.989310 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:04.989153 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5 podName:15ad0998-4dc6-4890-9184-5e504eb46b77 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:12.989135757 +0000 UTC m=+18.142935717 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4h5q5" (UniqueName: "kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5") pod "network-check-target-p9vvq" (UID: "15ad0998-4dc6-4890-9184-5e504eb46b77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:05.274286 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:05.274210 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:05.274457 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:05.274319 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:21:05.274674 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:05.274651 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:05.274772 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:05.274753 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:21:05.274826 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:05.274806 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:05.274915 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:05.274888 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:21:07.273509 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:07.273470 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:07.273509 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:07.273491 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:07.273981 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:07.273470 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:07.273981 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:07.273576 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:21:07.273981 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:07.273700 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:21:07.273981 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:07.273785 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:21:09.273838 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:09.273806 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:09.273838 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:09.273826 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:09.274352 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:09.273806 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:09.274352 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:09.273928 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:21:09.274352 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:09.274007 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:21:09.274352 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:09.274098 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:21:11.273246 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:11.273123 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:11.273246 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:11.273133 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:11.273739 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:11.273257 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:21:11.273739 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:11.273348 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:21:11.273739 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:11.273133 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:11.273739 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:11.273446 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:21:12.949101 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:12.949049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:12.949509 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:12.949203 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:12.949509 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:12.949282 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret podName:6f5da0f5-156c-4957-9bda-9ca3ee8424d5 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:28.949262095 +0000 UTC m=+34.103062067 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret") pod "global-pull-secret-syncer-mqnqr" (UID: "6f5da0f5-156c-4957-9bda-9ca3ee8424d5") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:13.049926 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:13.049891 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h5q5\" (UniqueName: \"kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5\") pod \"network-check-target-p9vvq\" (UID: \"15ad0998-4dc6-4890-9184-5e504eb46b77\") " pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:13.050105 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:13.049956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:13.050105 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:13.050087 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:13.050230 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:13.050103 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:21:13.050230 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:13.050127 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:21:13.050230 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:13.050140 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4h5q5 for pod openshift-network-diagnostics/network-check-target-p9vvq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:13.050230 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:13.050152 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs podName:995cd1f6-5df5-45c1-80cf-1921f567c92f nodeName:}" failed. No retries permitted until 2026-06-03 19:21:29.050134321 +0000 UTC m=+34.203934281 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs") pod "network-metrics-daemon-s7c4p" (UID: "995cd1f6-5df5-45c1-80cf-1921f567c92f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:13.050230 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:13.050190 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5 podName:15ad0998-4dc6-4890-9184-5e504eb46b77 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:29.050174153 +0000 UTC m=+34.203974123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4h5q5" (UniqueName: "kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5") pod "network-check-target-p9vvq" (UID: "15ad0998-4dc6-4890-9184-5e504eb46b77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:13.272964 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:13.272882 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:13.273152 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:13.272881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:13.273152 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:13.273016 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:21:13.273152 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:13.273115 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:21:13.273152 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:13.272889 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:13.273337 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:13.273202 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:21:15.274021 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:15.273989 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:15.274341 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:15.274076 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:21:15.274341 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:15.274168 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:15.274341 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:15.274283 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:21:15.274341 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:15.274317 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:15.274469 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:15.274409 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:21:16.396190 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.395967 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:21:16.396920 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.396413 2577 generic.go:356] "Generic (PLEG): container finished" podID="5b80904c-705a-43ea-a92e-aec87054d9a9" containerID="da9d1d7f419f12e54ba90df08fa559509815b55cce09a3404638059f6215de0c" exitCode=1 Jun 03 19:21:16.396920 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.396471 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" event={"ID":"5b80904c-705a-43ea-a92e-aec87054d9a9","Type":"ContainerStarted","Data":"b4594beb888ae2714a8a34bc5046fef92ef143e53c46da3576390f9e1829b139"} Jun 03 19:21:16.396920 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.396559 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" event={"ID":"5b80904c-705a-43ea-a92e-aec87054d9a9","Type":"ContainerStarted","Data":"a861929e2fd0fc2a6cbc03c5f26eaad96b1c0043d523c6fcdd1e308c8af816cc"} Jun 03 19:21:16.396920 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.396590 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" event={"ID":"5b80904c-705a-43ea-a92e-aec87054d9a9","Type":"ContainerStarted","Data":"d97695687cdb870c6d44d765d56f357efcd9bb674d6411d89ea1e9b2c65bc8a5"} Jun 03 19:21:16.396920 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.396616 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" event={"ID":"5b80904c-705a-43ea-a92e-aec87054d9a9","Type":"ContainerStarted","Data":"7488fd374054f33d3796e4308e993d8eca6a06b4ec7f56eac00926ce12cb0378"} Jun 03 19:21:16.396920 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.396642 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" event={"ID":"5b80904c-705a-43ea-a92e-aec87054d9a9","Type":"ContainerDied","Data":"da9d1d7f419f12e54ba90df08fa559509815b55cce09a3404638059f6215de0c"} Jun 03 19:21:16.396920 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.396670 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" event={"ID":"5b80904c-705a-43ea-a92e-aec87054d9a9","Type":"ContainerStarted","Data":"0131b05e869ce3fce9eec78a119f80ea789e37181aaf0f86e3faf9ce0377f10e"} Jun 03 19:21:16.397802 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.397783 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mb5qw" event={"ID":"3c01f875-c8ce-40f5-93b4-24b85c92f915","Type":"ContainerStarted","Data":"887347623a30648a874d2516d5d773e31581aeaebecf5e1516a5dee77cb44869"} Jun 03 19:21:16.399109 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.399084 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" event={"ID":"b5effdf9-fff6-46b8-932a-df3c0e8a1dd3","Type":"ContainerStarted","Data":"6961685e2899b62ba7e2aee7cd1d95219fd0a12c2353d2a2ce174edae648e6a0"} Jun 03 19:21:16.400291 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.400270 2577 generic.go:356] "Generic (PLEG): container finished" podID="fa17f395-1ee9-4474-b12f-c79309f369e8" containerID="7cc103bcc8cb84ba120ce0817d60290f56b0d9310f4273b4ac0ff10e5991f248" exitCode=0 Jun 03 19:21:16.400378 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.400298 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9v8s" event={"ID":"fa17f395-1ee9-4474-b12f-c79309f369e8","Type":"ContainerDied","Data":"7cc103bcc8cb84ba120ce0817d60290f56b0d9310f4273b4ac0ff10e5991f248"} Jun 03 19:21:16.401634 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.401615 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zqdtg" event={"ID":"7347a83b-e12c-4675-abe4-87c8bf2b2a44","Type":"ContainerStarted","Data":"06396501f7993bf1cf86ca47a7a9d0c38049ae17387717e9d9a4302b8f4a0656"} Jun 03 19:21:16.403023 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.402995 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sn9xs" event={"ID":"85f61ce5-2bce-478c-96a4-4082d38e04aa","Type":"ContainerStarted","Data":"529e1a970ea5790f883ecc89b15550334eb2f53ce5298501de7e0552de7298a2"} Jun 03 19:21:16.404338 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.404295 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n7g4g" event={"ID":"f7362bdb-bb9f-45ef-886c-6681b6477b0a","Type":"ContainerStarted","Data":"a71a1895d4e441e0cb955c61fe12fdb0a89b0757ef319d8405be28f67aeb3db0"} Jun 03 19:21:16.405558 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.405541 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" event={"ID":"9468a394-94c2-4c0b-9360-37fe6976b942","Type":"ContainerStarted","Data":"563a3bab1b6eea12d4a6589151478699bb6f426455f63289140540f30ccdb113"} Jun 03 19:21:16.416477 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.416439 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-13.ec2.internal" podStartSLOduration=20.416428629 podStartE2EDuration="20.416428629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:20:59.365305302 +0000 UTC m=+4.519105282" watchObservedRunningTime="2026-06-03 19:21:16.416428629 +0000 UTC m=+21.570228607" Jun 03 19:21:16.416839 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.416814 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mb5qw" podStartSLOduration=8.407958595 podStartE2EDuration="21.416806467s" totalImagesPullingTime="13.008847872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:16.416368967 +0000 UTC m=+21.570168947" watchObservedRunningTime="2026-06-03 19:21:16.416806467 +0000 UTC m=+21.570606457" Jun 03 19:21:16.436315 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.436279 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z7lk2" podStartSLOduration=3.923408716 podStartE2EDuration="21.43626892s" totalImagesPullingTime="17.512860204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:16.43589435 +0000 UTC m=+21.589694330" watchObservedRunningTime="2026-06-03 19:21:16.43626892 +0000 UTC m=+21.590068899" Jun 03 19:21:16.455196 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.454642 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n7g4g" podStartSLOduration=3.931623298 podStartE2EDuration="21.454627623s" totalImagesPullingTime="17.523004325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:16.454203058 +0000 UTC m=+21.608003049" watchObservedRunningTime="2026-06-03 19:21:16.454627623 +0000 UTC m=+21.608427605" Jun 03 19:21:16.496618 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.496583 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sn9xs" podStartSLOduration=11.980093396000001 podStartE2EDuration="21.496569901s" totalImagesPullingTime="9.516476505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:16.496200543 +0000 UTC m=+21.650000522" watchObservedRunningTime="2026-06-03 19:21:16.496569901 +0000 UTC m=+21.650369881" Jun 03 19:21:16.513883 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.513847 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zqdtg" podStartSLOduration=3.999201026 podStartE2EDuration="21.513834685s" totalImagesPullingTime="17.514633659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:16.513475084 +0000 UTC m=+21.667275064" watchObservedRunningTime="2026-06-03 19:21:16.513834685 +0000 UTC m=+21.667634664" Jun 03 19:21:16.549213 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:16.549090 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 19:21:17.273877 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:17.273767 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:17.273877 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:17.273767 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:17.274215 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:17.273894 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:21:17.274215 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:17.273910 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:17.274215 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:17.274003 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:21:17.274215 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:17.274119 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:21:17.275927 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:17.275829 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T19:21:16.549210117Z","UUID":"30038ff0-de4e-46d9-a211-ae90412b6981","Handler":null,"Name":"","Endpoint":""} Jun 03 19:21:17.277551 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:17.277527 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 19:21:17.277659 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:17.277572 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 19:21:17.409436 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:17.409404 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" event={"ID":"9468a394-94c2-4c0b-9360-37fe6976b942","Type":"ContainerStarted","Data":"dd83c9790f8cd3aa5f5405dca0de642a02b4a73b7cc030bc6048de7663b8e4da"} Jun 03 19:21:17.411135 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:17.411098 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nlc45" event={"ID":"adf23483-48d6-4496-a6ae-5a656a1289e6","Type":"ContainerStarted","Data":"ea4df43454cbd7a7a89dec2113ac5eb549137bf4e4e1e32cc4bf169a2eafdcf1"} Jun 03 19:21:17.427750 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:17.427707 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nlc45" podStartSLOduration=4.921930047 podStartE2EDuration="22.427689365s" totalImagesPullingTime="17.505759318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:17.427553526 +0000 UTC m=+22.581353507" watchObservedRunningTime="2026-06-03 19:21:17.427689365 +0000 UTC m=+22.581489347" Jun 03 19:21:18.417304 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:18.417267 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:21:18.417809 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:18.417712 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" event={"ID":"5b80904c-705a-43ea-a92e-aec87054d9a9","Type":"ContainerStarted","Data":"51d04f9c12849dd49d7c048dbca4c0769d45d9552458c639e99bf98f9b905e33"} Jun 03 19:21:18.420172 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:18.420102 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" event={"ID":"9468a394-94c2-4c0b-9360-37fe6976b942","Type":"ContainerStarted","Data":"184af21b873fb4b23aa065267ffd2280bc50eab624115f6745c184736c4f013d"} Jun 03 19:21:18.442044 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:18.441981 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gwk5" podStartSLOduration=4.10929089 podStartE2EDuration="23.441961012s" totalImagesPullingTime="19.332670122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:18.441513495 +0000 UTC m=+23.595313477" watchObservedRunningTime="2026-06-03 19:21:18.441961012 +0000 UTC m=+23.595760993" Jun 03 19:21:18.999389 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:18.999348 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mb5qw" Jun 03 19:21:19.000098 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:19.000076 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mb5qw" Jun 03 19:21:19.273123 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:19.273035 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:19.273123 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:19.273054 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:19.273123 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:19.273035 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:19.273389 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:19.273192 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:21:19.273389 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:19.273233 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:21:19.273389 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:19.273314 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:21:19.421968 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:19.421922 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mb5qw" Jun 03 19:21:19.422562 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:19.422542 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mb5qw" Jun 03 19:21:21.273551 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:21.273345 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:21.274150 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:21.273362 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:21.274150 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:21.273630 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:21:21.274150 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:21.273383 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:21.274150 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:21.273700 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:21:21.274150 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:21.273816 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:21:21.428217 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:21.428187 2577 generic.go:356] "Generic (PLEG): container finished" podID="fa17f395-1ee9-4474-b12f-c79309f369e8" containerID="f7d4b475b7547dd5eacc55024f1ff435282ed7ed23a2cf86050389094ae550d4" exitCode=0 Jun 03 19:21:21.428368 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:21.428277 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9v8s" event={"ID":"fa17f395-1ee9-4474-b12f-c79309f369e8","Type":"ContainerDied","Data":"f7d4b475b7547dd5eacc55024f1ff435282ed7ed23a2cf86050389094ae550d4"} Jun 03 19:21:21.431835 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:21.431820 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:21:21.432264 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:21.432247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" event={"ID":"5b80904c-705a-43ea-a92e-aec87054d9a9","Type":"ContainerStarted","Data":"8a06478ad96c69c6a1c2886a108619a13e0343d9c5c54fd7a9e0b60089af5048"} Jun 03 19:21:21.432483 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:21.432466 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:21:21.432551 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:21.432536 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:21:21.432600 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:21.432587 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:21:21.432645 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:21.432603 2577 scope.go:117] "RemoveContainer" containerID="da9d1d7f419f12e54ba90df08fa559509815b55cce09a3404638059f6215de0c" Jun 03 19:21:21.448815 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:21.448784 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:21:21.449035 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:21.449018 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:21:22.437037 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:22.436827 2577 generic.go:356] "Generic (PLEG): container finished" podID="fa17f395-1ee9-4474-b12f-c79309f369e8" containerID="05bc210efcf8254cb5bf60a302cbbcbd0db6d446c5bfd790ce62754a9c40bed6" exitCode=0 Jun 03 19:21:22.437584 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:22.436872 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9v8s" event={"ID":"fa17f395-1ee9-4474-b12f-c79309f369e8","Type":"ContainerDied","Data":"05bc210efcf8254cb5bf60a302cbbcbd0db6d446c5bfd790ce62754a9c40bed6"} Jun 03 19:21:22.440761 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:22.440745 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:21:22.441145 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:22.441122 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" event={"ID":"5b80904c-705a-43ea-a92e-aec87054d9a9","Type":"ContainerStarted","Data":"9cf2810241bb9de9e2406a32356e39353dd9cc9d5e5d106c5f28fa2a8d5f8740"} Jun 03 19:21:22.484976 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:22.484946 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s7c4p"] Jun 03 19:21:22.485135 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:22.485075 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:22.485213 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:22.485195 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:21:22.488868 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:22.488843 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p9vvq"] Jun 03 19:21:22.488986 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:22.488935 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:22.489046 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:22.489029 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:21:22.489484 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:22.489468 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mqnqr"] Jun 03 19:21:22.489555 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:22.489544 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:22.489644 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:22.489627 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:21:22.492932 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:22.492881 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" podStartSLOduration=9.942923650000001 podStartE2EDuration="27.49286447s" totalImagesPullingTime="17.54994082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:22.492289479 +0000 UTC m=+27.646089574" watchObservedRunningTime="2026-06-03 19:21:22.49286447 +0000 UTC m=+27.646664448" Jun 03 19:21:23.445380 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:23.445289 2577 generic.go:356] "Generic (PLEG): container finished" podID="fa17f395-1ee9-4474-b12f-c79309f369e8" containerID="67f662c354d4daecbf13f3228101e07431b038fb46c159fae7e841dbef05469f" exitCode=0 Jun 03 19:21:23.445804 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:23.445376 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9v8s" event={"ID":"fa17f395-1ee9-4474-b12f-c79309f369e8","Type":"ContainerDied","Data":"67f662c354d4daecbf13f3228101e07431b038fb46c159fae7e841dbef05469f"} Jun 03 19:21:24.273591 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:24.273556 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:24.273748 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:24.273595 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:24.273748 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:24.273595 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:24.273748 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:24.273667 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:21:24.273910 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:24.273755 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:21:24.273910 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:24.273824 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:21:26.273781 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:26.273746 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:26.274430 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:26.273790 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:26.274430 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:26.273795 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:26.274430 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:26.273876 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mqnqr" podUID="6f5da0f5-156c-4957-9bda-9ca3ee8424d5" Jun 03 19:21:26.274430 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:26.273964 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9vvq" podUID="15ad0998-4dc6-4890-9184-5e504eb46b77" Jun 03 19:21:26.274430 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:26.274107 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:21:28.126795 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.126598 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-13.ec2.internal" event="NodeReady" Jun 03 19:21:28.127244 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.126902 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 19:21:28.183472 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.183439 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vps9j"] Jun 03 19:21:28.200619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.200481 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5srf2"] Jun 03 19:21:28.200784 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.200643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:28.203709 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.203683 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 19:21:28.203709 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.203705 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 19:21:28.203886 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.203753 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tfxzd\"" Jun 03 19:21:28.218836 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.218767 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:28.219256 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.218984 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5srf2"] Jun 03 19:21:28.219256 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.219018 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vps9j"] Jun 03 19:21:28.219256 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.219135 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5srf2" Jun 03 19:21:28.222365 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.222344 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 19:21:28.222365 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.222362 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 19:21:28.222540 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.222408 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 19:21:28.222773 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.222757 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gzqw4\"" Jun 03 19:21:28.273777 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.273745 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:28.273954 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.273875 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:28.273954 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.273932 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:28.277845 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.277693 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 19:21:28.277972 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.277889 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:21:28.278177 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.278155 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 19:21:28.280879 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.278402 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2pf7v\"" Jun 03 19:21:28.280879 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.278516 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:21:28.280879 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.278257 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-grwp9\"" Jun 03 19:21:28.318950 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.318920 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:28.359541 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.359509 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgpkt\" (UniqueName: \"kubernetes.io/projected/bf4a425b-e55d-427d-891c-fb976b02efcc-kube-api-access-zgpkt\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:28.359638 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.359586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf4a425b-e55d-427d-891c-fb976b02efcc-config-volume\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:28.359638 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.359605 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:28.359638 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.359619 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf4a425b-e55d-427d-891c-fb976b02efcc-tmp-dir\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:28.359727 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.359642 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjxw4\" (UniqueName: \"kubernetes.io/projected/e6ce57d8-c75c-44b6-a785-20e4d2bf09f2-kube-api-access-mjxw4\") pod \"ingress-canary-5srf2\" (UID: \"e6ce57d8-c75c-44b6-a785-20e4d2bf09f2\") " pod="openshift-ingress-canary/ingress-canary-5srf2" Jun 03 19:21:28.359727 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.359666 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6ce57d8-c75c-44b6-a785-20e4d2bf09f2-cert\") pod \"ingress-canary-5srf2\" (UID: \"e6ce57d8-c75c-44b6-a785-20e4d2bf09f2\") " pod="openshift-ingress-canary/ingress-canary-5srf2" Jun 03 19:21:28.458930 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.458896 2577 generic.go:356] "Generic (PLEG): container finished" podID="fa17f395-1ee9-4474-b12f-c79309f369e8" containerID="aa1a940e27d8e9e760edeb0e746612926c2f9fdbb59ecb37aacb6f65295cb0ef" exitCode=0 Jun 03 19:21:28.459090 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.458947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9v8s" event={"ID":"fa17f395-1ee9-4474-b12f-c79309f369e8","Type":"ContainerDied","Data":"aa1a940e27d8e9e760edeb0e746612926c2f9fdbb59ecb37aacb6f65295cb0ef"} Jun 03 19:21:28.460867 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.460844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf4a425b-e55d-427d-891c-fb976b02efcc-config-volume\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:28.460922 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.460878 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:28.460922 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.460904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf4a425b-e55d-427d-891c-fb976b02efcc-tmp-dir\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:28.461010 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.460941 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxw4\" (UniqueName: \"kubernetes.io/projected/e6ce57d8-c75c-44b6-a785-20e4d2bf09f2-kube-api-access-mjxw4\") pod \"ingress-canary-5srf2\" (UID: \"e6ce57d8-c75c-44b6-a785-20e4d2bf09f2\") " pod="openshift-ingress-canary/ingress-canary-5srf2" Jun 03 19:21:28.461010 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.460967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6ce57d8-c75c-44b6-a785-20e4d2bf09f2-cert\") pod \"ingress-canary-5srf2\" (UID: \"e6ce57d8-c75c-44b6-a785-20e4d2bf09f2\") " pod="openshift-ingress-canary/ingress-canary-5srf2" Jun 03 19:21:28.461010 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:28.461001 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:28.461156 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.461008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgpkt\" (UniqueName: \"kubernetes.io/projected/bf4a425b-e55d-427d-891c-fb976b02efcc-kube-api-access-zgpkt\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:28.461156 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:28.461081 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls podName:bf4a425b-e55d-427d-891c-fb976b02efcc nodeName:}" failed. No retries permitted until 2026-06-03 19:21:28.961049319 +0000 UTC m=+34.114849283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls") pod "dns-default-vps9j" (UID: "bf4a425b-e55d-427d-891c-fb976b02efcc") : secret "dns-default-metrics-tls" not found Jun 03 19:21:28.461321 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.461298 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf4a425b-e55d-427d-891c-fb976b02efcc-tmp-dir\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:28.461466 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.461447 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf4a425b-e55d-427d-891c-fb976b02efcc-config-volume\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:28.465194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.465173 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6ce57d8-c75c-44b6-a785-20e4d2bf09f2-cert\") pod \"ingress-canary-5srf2\" (UID: \"e6ce57d8-c75c-44b6-a785-20e4d2bf09f2\") " pod="openshift-ingress-canary/ingress-canary-5srf2" Jun 03 19:21:28.469761 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.469738 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjxw4\" (UniqueName: \"kubernetes.io/projected/e6ce57d8-c75c-44b6-a785-20e4d2bf09f2-kube-api-access-mjxw4\") pod \"ingress-canary-5srf2\" (UID: \"e6ce57d8-c75c-44b6-a785-20e4d2bf09f2\") " pod="openshift-ingress-canary/ingress-canary-5srf2" Jun 03 19:21:28.471042 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.471019 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgpkt\" (UniqueName: \"kubernetes.io/projected/bf4a425b-e55d-427d-891c-fb976b02efcc-kube-api-access-zgpkt\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:28.528158 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.528126 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5srf2" Jun 03 19:21:28.531748 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.531712 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:28.588764 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.588735 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:28.697955 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.697933 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5srf2"] Jun 03 19:21:28.703973 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:21:28.703947 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ce57d8_c75c_44b6_a785_20e4d2bf09f2.slice/crio-1b28cad8897539853e6efe0610a76e6a71b48702999eb59258058a0a520fb996 WatchSource:0}: Error finding container 1b28cad8897539853e6efe0610a76e6a71b48702999eb59258058a0a520fb996: Status 404 returned error can't find the container with id 1b28cad8897539853e6efe0610a76e6a71b48702999eb59258058a0a520fb996 Jun 03 19:21:28.964322 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.964287 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:28.964536 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.964335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:28.964536 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:28.964443 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:28.964536 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:28.964508 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls podName:bf4a425b-e55d-427d-891c-fb976b02efcc nodeName:}" failed. No retries permitted until 2026-06-03 19:21:29.964493584 +0000 UTC m=+35.118293543 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls") pod "dns-default-vps9j" (UID: "bf4a425b-e55d-427d-891c-fb976b02efcc") : secret "dns-default-metrics-tls" not found Jun 03 19:21:28.967494 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:28.967467 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f5da0f5-156c-4957-9bda-9ca3ee8424d5-original-pull-secret\") pod \"global-pull-secret-syncer-mqnqr\" (UID: \"6f5da0f5-156c-4957-9bda-9ca3ee8424d5\") " pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:29.065100 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:29.065054 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h5q5\" (UniqueName: \"kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5\") pod \"network-check-target-p9vvq\" (UID: \"15ad0998-4dc6-4890-9184-5e504eb46b77\") " pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:29.065256 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:29.065219 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:21:29.065349 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:29.065336 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:21:29.065404 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:29.065394 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs podName:995cd1f6-5df5-45c1-80cf-1921f567c92f nodeName:}" failed. No retries permitted until 2026-06-03 19:22:01.065377545 +0000 UTC m=+66.219177503 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs") pod "network-metrics-daemon-s7c4p" (UID: "995cd1f6-5df5-45c1-80cf-1921f567c92f") : secret "metrics-daemon-secret" not found Jun 03 19:21:29.067728 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:29.067707 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h5q5\" (UniqueName: \"kubernetes.io/projected/15ad0998-4dc6-4890-9184-5e504eb46b77-kube-api-access-4h5q5\") pod \"network-check-target-p9vvq\" (UID: \"15ad0998-4dc6-4890-9184-5e504eb46b77\") " pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:29.184613 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:29.184583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:29.189708 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:29.189676 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mqnqr" Jun 03 19:21:29.339494 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:29.339250 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p9vvq"] Jun 03 19:21:29.342674 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:21:29.342647 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ad0998_4dc6_4890_9184_5e504eb46b77.slice/crio-bea3d567b202bff2c50fc3df0b675d0f48acd307cd5782d7eae4a5fc06a988f2 WatchSource:0}: Error finding container bea3d567b202bff2c50fc3df0b675d0f48acd307cd5782d7eae4a5fc06a988f2: Status 404 returned error can't find the container with id bea3d567b202bff2c50fc3df0b675d0f48acd307cd5782d7eae4a5fc06a988f2 Jun 03 19:21:29.359763 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:29.359736 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mqnqr"] Jun 03 19:21:29.361913 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:21:29.361888 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5da0f5_156c_4957_9bda_9ca3ee8424d5.slice/crio-b23e3547dff182bc8f9879e19237ac3be5d4fa667cbdffa56ff92e970f3dc27e WatchSource:0}: Error finding container b23e3547dff182bc8f9879e19237ac3be5d4fa667cbdffa56ff92e970f3dc27e: Status 404 returned error can't find the container with id b23e3547dff182bc8f9879e19237ac3be5d4fa667cbdffa56ff92e970f3dc27e Jun 03 19:21:29.463090 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:29.463039 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mqnqr" event={"ID":"6f5da0f5-156c-4957-9bda-9ca3ee8424d5","Type":"ContainerStarted","Data":"b23e3547dff182bc8f9879e19237ac3be5d4fa667cbdffa56ff92e970f3dc27e"} Jun 03 19:21:29.464480 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:29.464453 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p9vvq" event={"ID":"15ad0998-4dc6-4890-9184-5e504eb46b77","Type":"ContainerStarted","Data":"bea3d567b202bff2c50fc3df0b675d0f48acd307cd5782d7eae4a5fc06a988f2"} Jun 03 19:21:29.465654 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:29.465630 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5srf2" event={"ID":"e6ce57d8-c75c-44b6-a785-20e4d2bf09f2","Type":"ContainerStarted","Data":"1b28cad8897539853e6efe0610a76e6a71b48702999eb59258058a0a520fb996"} Jun 03 19:21:29.469196 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:29.469049 2577 generic.go:356] "Generic (PLEG): container finished" podID="fa17f395-1ee9-4474-b12f-c79309f369e8" containerID="54e76aee8c7366fed6429739dbae1f6e95e790e49ddca60a8f6accbeb3086ccd" exitCode=0 Jun 03 19:21:29.469196 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:29.469097 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9v8s" event={"ID":"fa17f395-1ee9-4474-b12f-c79309f369e8","Type":"ContainerDied","Data":"54e76aee8c7366fed6429739dbae1f6e95e790e49ddca60a8f6accbeb3086ccd"} Jun 03 19:21:29.971004 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:29.970863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:29.971260 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:29.971028 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:29.971260 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:29.971111 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls podName:bf4a425b-e55d-427d-891c-fb976b02efcc nodeName:}" failed. No retries permitted until 2026-06-03 19:21:31.97109273 +0000 UTC m=+37.124892692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls") pod "dns-default-vps9j" (UID: "bf4a425b-e55d-427d-891c-fb976b02efcc") : secret "dns-default-metrics-tls" not found Jun 03 19:21:30.476706 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:30.476671 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9v8s" event={"ID":"fa17f395-1ee9-4474-b12f-c79309f369e8","Type":"ContainerStarted","Data":"9e9c92f9fcc8aba05a4f287a1057ee024aeccbf7b0980475c138d40ff6a021e8"} Jun 03 19:21:30.509015 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:30.508957 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b9v8s" podStartSLOduration=8.704913922 podStartE2EDuration="35.508943563s" totalImagesPullingTime="26.804029641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:30.507135089 +0000 UTC m=+35.660935069" watchObservedRunningTime="2026-06-03 19:21:30.508943563 +0000 UTC m=+35.662743542" Jun 03 19:21:30.631455 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:30.631420 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:30.732075 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:30.731972 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:30.885412 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:30.885331 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:31.480954 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:31.480917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5srf2" event={"ID":"e6ce57d8-c75c-44b6-a785-20e4d2bf09f2","Type":"ContainerStarted","Data":"1832cf155fd9763587bda5296fd048473c37e94f244eb81dd8541f93d20881b7"} Jun 03 19:21:31.504438 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:31.504293 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5srf2" podStartSLOduration=1.157624484 podStartE2EDuration="3.504272592s" totalImagesPullingTime="2.346648108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:31.504235638 +0000 UTC m=+36.658035620" watchObservedRunningTime="2026-06-03 19:21:31.504272592 +0000 UTC m=+36.658072575" Jun 03 19:21:31.984891 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:31.984856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:31.985057 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:31.985032 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:31.985138 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:31.985126 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls podName:bf4a425b-e55d-427d-891c-fb976b02efcc nodeName:}" failed. No retries permitted until 2026-06-03 19:21:35.985102593 +0000 UTC m=+41.138902570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls") pod "dns-default-vps9j" (UID: "bf4a425b-e55d-427d-891c-fb976b02efcc") : secret "dns-default-metrics-tls" not found Jun 03 19:21:31.998080 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:31.998042 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:32.097559 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:32.097524 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:32.217558 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:32.217519 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:33.769684 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:33.769652 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:33.824261 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:33.824221 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:34.223292 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.223270 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk"] Jun 03 19:21:34.234294 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.234271 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" Jun 03 19:21:34.235539 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.235513 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk"] Jun 03 19:21:34.239471 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.239445 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bqpv5\"" Jun 03 19:21:34.239570 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.239494 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 19:21:34.239570 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.239494 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 19:21:34.239570 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.239496 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 19:21:34.239681 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.239494 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 19:21:34.282560 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.280699 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:34.302837 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.302807 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk\" (UID: \"cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" Jun 03 19:21:34.302973 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.302875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmr24\" (UniqueName: \"kubernetes.io/projected/cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53-kube-api-access-zmr24\") pod \"managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk\" (UID: \"cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" Jun 03 19:21:34.341986 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.341952 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:34.404206 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.404164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk\" (UID: \"cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" Jun 03 19:21:34.404384 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.404248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmr24\" (UniqueName: \"kubernetes.io/projected/cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53-kube-api-access-zmr24\") pod \"managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk\" (UID: \"cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" Jun 03 19:21:34.407679 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.407654 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk\" (UID: \"cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" Jun 03 19:21:34.413741 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.413714 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmr24\" (UniqueName: \"kubernetes.io/projected/cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53-kube-api-access-zmr24\") pod \"managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk\" (UID: \"cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" Jun 03 19:21:34.488744 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.488708 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mqnqr" event={"ID":"6f5da0f5-156c-4957-9bda-9ca3ee8424d5","Type":"ContainerStarted","Data":"e2f2cfe6bcbc1e787c3e821a3e928a4473e21f2d7d38fd6f0d5531ca9becf8c4"} Jun 03 19:21:34.490229 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.490201 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p9vvq" event={"ID":"15ad0998-4dc6-4890-9184-5e504eb46b77","Type":"ContainerStarted","Data":"f91929267f0d8911f1005355cb58b3f84911bce3901e91d65688fde3fab9e3a8"} Jun 03 19:21:34.490339 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.490255 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:21:34.506120 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.506074 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mqnqr" podStartSLOduration=34.716756604 podStartE2EDuration="39.506046275s" totalImagesPullingTime="4.789289671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:34.505756034 +0000 UTC m=+39.659556038" watchObservedRunningTime="2026-06-03 19:21:34.506046275 +0000 UTC m=+39.659846294" Jun 03 19:21:34.524376 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.524324 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p9vvq" podStartSLOduration=34.72722617 podStartE2EDuration="39.524311263s" totalImagesPullingTime="4.797085093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:34.523910501 +0000 UTC m=+39.677710480" watchObservedRunningTime="2026-06-03 19:21:34.524311263 +0000 UTC m=+39.678111222" Jun 03 19:21:34.570200 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.570172 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" Jun 03 19:21:34.691791 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:34.691721 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk"] Jun 03 19:21:34.694856 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:21:34.694828 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc3b5d65_0af3_4a9d_bcc8_def9ccf43a53.slice/crio-3e885d07d1632caf47a6eed05ea33471fe636b9474733be0ce955fc24263d3b0 WatchSource:0}: Error finding container 3e885d07d1632caf47a6eed05ea33471fe636b9474733be0ce955fc24263d3b0: Status 404 returned error can't find the container with id 3e885d07d1632caf47a6eed05ea33471fe636b9474733be0ce955fc24263d3b0 Jun 03 19:21:35.494914 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:35.494830 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" event={"ID":"cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53","Type":"ContainerStarted","Data":"3e885d07d1632caf47a6eed05ea33471fe636b9474733be0ce955fc24263d3b0"} Jun 03 19:21:36.015165 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:36.015127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:36.015363 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:36.015287 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:36.015363 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:36.015346 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls podName:bf4a425b-e55d-427d-891c-fb976b02efcc nodeName:}" failed. No retries permitted until 2026-06-03 19:21:44.015331518 +0000 UTC m=+49.169131481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls") pod "dns-default-vps9j" (UID: "bf4a425b-e55d-427d-891c-fb976b02efcc") : secret "dns-default-metrics-tls" not found Jun 03 19:21:36.148371 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:36.148340 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:36.240210 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:36.240182 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:38.506659 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:38.506622 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" event={"ID":"cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53","Type":"ContainerStarted","Data":"57f8ec9d62246d7b8ea31f62790c09016b3c7ae9e614367f2b3ae621f9fd7891"} Jun 03 19:21:44.070322 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:44.070279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:21:44.070706 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:44.070433 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:44.070706 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:21:44.070500 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls podName:bf4a425b-e55d-427d-891c-fb976b02efcc nodeName:}" failed. No retries permitted until 2026-06-03 19:22:00.070484072 +0000 UTC m=+65.224284034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls") pod "dns-default-vps9j" (UID: "bf4a425b-e55d-427d-891c-fb976b02efcc") : secret "dns-default-metrics-tls" not found Jun 03 19:21:50.199438 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:50.199404 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:50.259196 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:50.259165 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:53.456272 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:53.456243 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jzxkd" Jun 03 19:21:53.489857 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:53.489807 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" podStartSLOduration=16.487158467 podStartE2EDuration="19.48979292s" totalImagesPullingTime="3.002634453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:38.524277017 +0000 UTC m=+43.678077009" watchObservedRunningTime="2026-06-03 19:21:53.48979292 +0000 UTC m=+58.643592899" Jun 03 19:21:53.625228 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:53.625195 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:53.724955 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:53.724870 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:53.783746 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:53.783714 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:53.962593 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:53.962563 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:21:54.024494 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:21:54.024425 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:22:00.087368 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:22:00.087327 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:22:00.087859 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:22:00.087491 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:22:00.087859 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:22:00.087586 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls podName:bf4a425b-e55d-427d-891c-fb976b02efcc nodeName:}" failed. No retries permitted until 2026-06-03 19:22:32.087563816 +0000 UTC m=+97.241363778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls") pod "dns-default-vps9j" (UID: "bf4a425b-e55d-427d-891c-fb976b02efcc") : secret "dns-default-metrics-tls" not found Jun 03 19:22:01.094632 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:22:01.094593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:22:01.095018 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:22:01.094713 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:22:01.095018 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:22:01.094764 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs podName:995cd1f6-5df5-45c1-80cf-1921f567c92f nodeName:}" failed. No retries permitted until 2026-06-03 19:23:05.094750953 +0000 UTC m=+130.248550911 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs") pod "network-metrics-daemon-s7c4p" (UID: "995cd1f6-5df5-45c1-80cf-1921f567c92f") : secret "metrics-daemon-secret" not found Jun 03 19:22:05.384820 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:22:05.384786 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:22:05.449406 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:22:05.449372 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:22:05.497682 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:22:05.497653 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p9vvq" Jun 03 19:22:29.185006 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:22:29.184971 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:22:32.188505 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:22:32.188474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:22:32.188834 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:22:32.188612 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:22:32.188834 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:22:32.188682 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls podName:bf4a425b-e55d-427d-891c-fb976b02efcc nodeName:}" failed. No retries permitted until 2026-06-03 19:23:36.188664098 +0000 UTC m=+161.342464075 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls") pod "dns-default-vps9j" (UID: "bf4a425b-e55d-427d-891c-fb976b02efcc") : secret "dns-default-metrics-tls" not found Jun 03 19:23:05.110939 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:23:05.110885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:23:05.111458 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:23:05.111021 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:23:05.111458 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:23:05.111107 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs podName:995cd1f6-5df5-45c1-80cf-1921f567c92f nodeName:}" failed. No retries permitted until 2026-06-03 19:25:07.111091177 +0000 UTC m=+252.264891136 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs") pod "network-metrics-daemon-s7c4p" (UID: "995cd1f6-5df5-45c1-80cf-1921f567c92f") : secret "metrics-daemon-secret" not found Jun 03 19:23:31.209525 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:23:31.209466 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vps9j" podUID="bf4a425b-e55d-427d-891c-fb976b02efcc" Jun 03 19:23:31.293908 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:23:31.293849 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:23:31.769971 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:23:31.769944 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vps9j" Jun 03 19:23:36.218520 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:23:36.218483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:23:36.218926 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:23:36.218604 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:23:36.218926 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:23:36.218667 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls podName:bf4a425b-e55d-427d-891c-fb976b02efcc nodeName:}" failed. No retries permitted until 2026-06-03 19:25:38.218653009 +0000 UTC m=+283.372452967 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls") pod "dns-default-vps9j" (UID: "bf4a425b-e55d-427d-891c-fb976b02efcc") : secret "dns-default-metrics-tls" not found Jun 03 19:23:38.787502 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:23:38.787469 2577 generic.go:356] "Generic (PLEG): container finished" podID="cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53" containerID="57f8ec9d62246d7b8ea31f62790c09016b3c7ae9e614367f2b3ae621f9fd7891" exitCode=255 Jun 03 19:23:38.787893 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:23:38.787512 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" event={"ID":"cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53","Type":"ContainerDied","Data":"57f8ec9d62246d7b8ea31f62790c09016b3c7ae9e614367f2b3ae621f9fd7891"} Jun 03 19:23:38.792703 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:23:38.792687 2577 scope.go:117] "RemoveContainer" containerID="57f8ec9d62246d7b8ea31f62790c09016b3c7ae9e614367f2b3ae621f9fd7891" Jun 03 19:23:39.791916 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:23:39.791880 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" event={"ID":"cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53","Type":"ContainerStarted","Data":"a0112511ca86f08d35a3e82b6231009860b86f00768fb620552e785442440f3c"} Jun 03 19:23:46.272880 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:23:46.272782 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:24:27.304358 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:24:27.304328 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:07.145627 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:07.145587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:25:07.146115 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:07.145699 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:25:07.146115 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:07.145754 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs podName:995cd1f6-5df5-45c1-80cf-1921f567c92f nodeName:}" failed. No retries permitted until 2026-06-03 19:27:09.145737113 +0000 UTC m=+374.299537073 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs") pod "network-metrics-daemon-s7c4p" (UID: "995cd1f6-5df5-45c1-80cf-1921f567c92f") : secret "metrics-daemon-secret" not found Jun 03 19:25:12.452361 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.452329 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54c9bb4859-mjcg4"] Jun 03 19:25:12.456027 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.456008 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z"] Jun 03 19:25:12.456166 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.456152 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:12.458609 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.458591 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn"] Jun 03 19:25:12.458724 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.458708 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:12.460326 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.460306 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 19:25:12.460460 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.460333 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 19:25:12.460602 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.460586 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 19:25:12.460663 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.460632 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 19:25:12.460663 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.460640 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 19:25:12.460870 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.460855 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 19:25:12.461339 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.461319 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rgbzw\"" Jun 03 19:25:12.461916 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.461895 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7n6p9\"" Jun 03 19:25:12.462001 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.461925 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" Jun 03 19:25:12.463662 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.463642 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 19:25:12.463662 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.463655 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 19:25:12.463802 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.463690 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 19:25:12.463802 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.463712 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 19:25:12.468457 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.468427 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m2p5c\"" Jun 03 19:25:12.468547 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.468458 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 19:25:12.468547 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.468429 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 19:25:12.468727 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.468712 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:25:12.478589 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.478561 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z"] Jun 03 19:25:12.479337 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.479319 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54c9bb4859-mjcg4"] Jun 03 19:25:12.482704 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.482684 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn"] Jun 03 19:25:12.537623 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.537595 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fw75d"] Jun 03 19:25:12.540420 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.540404 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fw75d" Jun 03 19:25:12.544347 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.544330 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-v66z7\"" Jun 03 19:25:12.544660 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.544647 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:25:12.544719 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.544652 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 19:25:12.546985 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.546961 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj"] Jun 03 19:25:12.549678 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.549661 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-69684796bc-djmrc"] Jun 03 19:25:12.549791 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.549780 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" Jun 03 19:25:12.552228 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.552212 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-957c5866-54nh7"] Jun 03 19:25:12.552326 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.552316 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.554742 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.554725 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fw75d"] Jun 03 19:25:12.554825 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.554725 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 19:25:12.554825 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.554725 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wvblk\"" Jun 03 19:25:12.554825 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.554785 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.555243 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.555224 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:25:12.555497 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.555355 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 19:25:12.555601 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.555559 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 19:25:12.555828 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.555812 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 19:25:12.556930 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.556850 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 19:25:12.557170 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.557133 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ks5fk\"" Jun 03 19:25:12.557660 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.557640 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 19:25:12.562290 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.562267 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 19:25:12.562409 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.562384 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 19:25:12.562549 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.562530 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 19:25:12.562617 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.562556 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wcxmw\"" Jun 03 19:25:12.563084 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.563046 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 19:25:12.570366 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.570318 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj"] Jun 03 19:25:12.571302 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.571279 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-djmrc"] Jun 03 19:25:12.573215 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.573196 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 19:25:12.573544 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.573525 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 19:25:12.584400 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.584382 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-957c5866-54nh7"] Jun 03 19:25:12.585767 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.585748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kqn8\" (UniqueName: \"kubernetes.io/projected/45d61802-f1e6-4f1e-8686-953b64e982e1-kube-api-access-2kqn8\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:12.585853 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.585775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-default-certificate\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:12.585853 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.585791 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-stats-auth\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:12.585853 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.585814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3716079f-b675-4a70-8cb8-a096320abdfd-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:12.585975 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.585869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:12.585975 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.585913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ppsm\" (UniqueName: \"kubernetes.io/projected/3716079f-b675-4a70-8cb8-a096320abdfd-kube-api-access-2ppsm\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:12.585975 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.585955 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plkvd\" (UniqueName: \"kubernetes.io/projected/d3ea12e8-ba9d-4021-ad31-2d269677f404-kube-api-access-plkvd\") pod \"cluster-samples-operator-9f6f677f5-jl8zn\" (UID: \"d3ea12e8-ba9d-4021-ad31-2d269677f404\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" Jun 03 19:25:12.586105 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.585992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:12.586105 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.586009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:12.586105 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.586054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jl8zn\" (UID: \"d3ea12e8-ba9d-4021-ad31-2d269677f404\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" Jun 03 19:25:12.634043 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.634019 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-qx6q2"] Jun 03 19:25:12.636924 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.636910 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" Jun 03 19:25:12.640152 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.640133 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 19:25:12.640238 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.640153 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-p8n9w\"" Jun 03 19:25:12.640648 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.640633 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 19:25:12.649680 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.649662 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-qx6q2"] Jun 03 19:25:12.686736 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.686685 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/31598752-4c6d-47a4-9e99-36f86d580ccd-snapshots\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.686736 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.686718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31598752-4c6d-47a4-9e99-36f86d580ccd-service-ca-bundle\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.686883 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.686737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31598752-4c6d-47a4-9e99-36f86d580ccd-trusted-ca-bundle\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.686883 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.686797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kqn8\" (UniqueName: \"kubernetes.io/projected/45d61802-f1e6-4f1e-8686-953b64e982e1-kube-api-access-2kqn8\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:12.686883 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.686819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-default-certificate\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:12.686883 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.686835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-stats-auth\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:12.686883 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.686852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bcvm\" (UniqueName: \"kubernetes.io/projected/1e7a8bd0-5535-428b-8505-777710a3dd19-kube-api-access-8bcvm\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj\" (UID: \"1e7a8bd0-5535-428b-8505-777710a3dd19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" Jun 03 19:25:12.686883 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.686870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62lbr\" (UniqueName: \"kubernetes.io/projected/31598752-4c6d-47a4-9e99-36f86d580ccd-kube-api-access-62lbr\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.687189 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.686889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:12.687189 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.686903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31598752-4c6d-47a4-9e99-36f86d580ccd-serving-cert\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.687189 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.686931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ppsm\" (UniqueName: \"kubernetes.io/projected/3716079f-b675-4a70-8cb8-a096320abdfd-kube-api-access-2ppsm\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:12.687189 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.686949 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plkvd\" (UniqueName: \"kubernetes.io/projected/d3ea12e8-ba9d-4021-ad31-2d269677f404-kube-api-access-plkvd\") pod \"cluster-samples-operator-9f6f677f5-jl8zn\" (UID: \"d3ea12e8-ba9d-4021-ad31-2d269677f404\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" Jun 03 19:25:12.687189 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:12.687019 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle podName:45d61802-f1e6-4f1e-8686-953b64e982e1 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:13.187000143 +0000 UTC m=+258.340800118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle") pod "router-default-54c9bb4859-mjcg4" (UID: "45d61802-f1e6-4f1e-8686-953b64e982e1") : configmap references non-existent config key: service-ca.crt Jun 03 19:25:12.687189 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g578q\" (UniqueName: \"kubernetes.io/projected/c3351a51-09d5-4424-8601-10bafbe6293e-kube-api-access-g578q\") pod \"volume-data-source-validator-78dd696465-fw75d\" (UID: \"c3351a51-09d5-4424-8601-10bafbe6293e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fw75d" Jun 03 19:25:12.687189 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687132 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:12.687189 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:12.687189 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687190 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e7a8bd0-5535-428b-8505-777710a3dd19-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj\" (UID: \"1e7a8bd0-5535-428b-8505-777710a3dd19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" Jun 03 19:25:12.687575 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:12.687226 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:25:12.687575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fedfba09-9e99-4fa9-b297-e8ab9836e602-image-registry-private-configuration\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.687575 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:12.687262 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:25:12.687575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687270 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3716079f-b675-4a70-8cb8-a096320abdfd-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:12.687575 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:12.687289 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs podName:45d61802-f1e6-4f1e-8686-953b64e982e1 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:13.187272473 +0000 UTC m=+258.341072443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs") pod "router-default-54c9bb4859-mjcg4" (UID: "45d61802-f1e6-4f1e-8686-953b64e982e1") : secret "router-metrics-certs-default" not found Jun 03 19:25:12.687575 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:12.687322 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls podName:3716079f-b675-4a70-8cb8-a096320abdfd nodeName:}" failed. No retries permitted until 2026-06-03 19:25:13.187311814 +0000 UTC m=+258.341111785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-qhn5z" (UID: "3716079f-b675-4a70-8cb8-a096320abdfd") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:25:12.687575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-certificates\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.687575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxsbs\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-kube-api-access-lxsbs\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.687575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687417 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31598752-4c6d-47a4-9e99-36f86d580ccd-tmp\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.687575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jl8zn\" (UID: \"d3ea12e8-ba9d-4021-ad31-2d269677f404\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" Jun 03 19:25:12.687575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.687575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687508 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fedfba09-9e99-4fa9-b297-e8ab9836e602-trusted-ca\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.687575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687537 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e7a8bd0-5535-428b-8505-777710a3dd19-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj\" (UID: \"1e7a8bd0-5535-428b-8505-777710a3dd19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" Jun 03 19:25:12.687575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fedfba09-9e99-4fa9-b297-e8ab9836e602-ca-trust-extracted\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.688051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687607 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fedfba09-9e99-4fa9-b297-e8ab9836e602-installation-pull-secrets\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.688051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687639 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-bound-sa-token\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.688051 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:12.687756 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:25:12.688051 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:12.687841 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls podName:d3ea12e8-ba9d-4021-ad31-2d269677f404 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:13.18780285 +0000 UTC m=+258.341602808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-jl8zn" (UID: "d3ea12e8-ba9d-4021-ad31-2d269677f404") : secret "samples-operator-tls" not found Jun 03 19:25:12.688051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.687948 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3716079f-b675-4a70-8cb8-a096320abdfd-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:12.690192 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.690168 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-default-certificate\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:12.690274 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.690223 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-stats-auth\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:12.696972 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.696953 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ppsm\" (UniqueName: \"kubernetes.io/projected/3716079f-b675-4a70-8cb8-a096320abdfd-kube-api-access-2ppsm\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:12.697076 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.697049 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kqn8\" (UniqueName: \"kubernetes.io/projected/45d61802-f1e6-4f1e-8686-953b64e982e1-kube-api-access-2kqn8\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:12.697520 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.697497 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plkvd\" (UniqueName: \"kubernetes.io/projected/d3ea12e8-ba9d-4021-ad31-2d269677f404-kube-api-access-plkvd\") pod \"cluster-samples-operator-9f6f677f5-jl8zn\" (UID: \"d3ea12e8-ba9d-4021-ad31-2d269677f404\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" Jun 03 19:25:12.775508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.775430 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:12.788630 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.788595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.788630 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.788635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fedfba09-9e99-4fa9-b297-e8ab9836e602-trusted-ca\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.788795 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.788654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-nginx-conf\") pod \"networking-console-plugin-68d6b54856-qx6q2\" (UID: \"c7c39a4e-167c-48f2-a0cb-b751f918e9d0\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" Jun 03 19:25:12.788795 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.788673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e7a8bd0-5535-428b-8505-777710a3dd19-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj\" (UID: \"1e7a8bd0-5535-428b-8505-777710a3dd19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" Jun 03 19:25:12.788795 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.788690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fedfba09-9e99-4fa9-b297-e8ab9836e602-ca-trust-extracted\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.788795 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:12.788760 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:25:12.788795 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.788775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fedfba09-9e99-4fa9-b297-e8ab9836e602-installation-pull-secrets\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.789018 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.788799 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-bound-sa-token\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.789018 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.788818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/31598752-4c6d-47a4-9e99-36f86d580ccd-snapshots\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.789018 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.788846 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31598752-4c6d-47a4-9e99-36f86d580ccd-service-ca-bundle\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.789018 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.788870 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31598752-4c6d-47a4-9e99-36f86d580ccd-trusted-ca-bundle\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.789018 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.788908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-qx6q2\" (UID: \"c7c39a4e-167c-48f2-a0cb-b751f918e9d0\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" Jun 03 19:25:12.789018 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.788946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bcvm\" (UniqueName: \"kubernetes.io/projected/1e7a8bd0-5535-428b-8505-777710a3dd19-kube-api-access-8bcvm\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj\" (UID: \"1e7a8bd0-5535-428b-8505-777710a3dd19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" Jun 03 19:25:12.789018 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.788972 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62lbr\" (UniqueName: \"kubernetes.io/projected/31598752-4c6d-47a4-9e99-36f86d580ccd-kube-api-access-62lbr\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.789018 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.789006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31598752-4c6d-47a4-9e99-36f86d580ccd-serving-cert\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.789420 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.789084 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fedfba09-9e99-4fa9-b297-e8ab9836e602-ca-trust-extracted\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.789420 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:12.788780 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-957c5866-54nh7: secret "image-registry-tls" not found Jun 03 19:25:12.789420 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.789080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g578q\" (UniqueName: \"kubernetes.io/projected/c3351a51-09d5-4424-8601-10bafbe6293e-kube-api-access-g578q\") pod \"volume-data-source-validator-78dd696465-fw75d\" (UID: \"c3351a51-09d5-4424-8601-10bafbe6293e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fw75d" Jun 03 19:25:12.789420 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.789160 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e7a8bd0-5535-428b-8505-777710a3dd19-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj\" (UID: \"1e7a8bd0-5535-428b-8505-777710a3dd19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" Jun 03 19:25:12.789420 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.789187 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fedfba09-9e99-4fa9-b297-e8ab9836e602-image-registry-private-configuration\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.789420 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.789219 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-certificates\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.789420 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.789245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxsbs\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-kube-api-access-lxsbs\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.789420 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.789273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31598752-4c6d-47a4-9e99-36f86d580ccd-tmp\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.789794 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.789555 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31598752-4c6d-47a4-9e99-36f86d580ccd-tmp\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.789853 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.789824 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fedfba09-9e99-4fa9-b297-e8ab9836e602-trusted-ca\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.789907 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:12.789870 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls podName:fedfba09-9e99-4fa9-b297-e8ab9836e602 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:13.289852084 +0000 UTC m=+258.443652043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls") pod "image-registry-957c5866-54nh7" (UID: "fedfba09-9e99-4fa9-b297-e8ab9836e602") : secret "image-registry-tls" not found Jun 03 19:25:12.790054 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.790027 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-certificates\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.790153 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.790109 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/31598752-4c6d-47a4-9e99-36f86d580ccd-snapshots\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.790400 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.790379 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e7a8bd0-5535-428b-8505-777710a3dd19-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj\" (UID: \"1e7a8bd0-5535-428b-8505-777710a3dd19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" Jun 03 19:25:12.790560 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.790539 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31598752-4c6d-47a4-9e99-36f86d580ccd-service-ca-bundle\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.790794 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.790776 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31598752-4c6d-47a4-9e99-36f86d580ccd-trusted-ca-bundle\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.791419 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.791397 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fedfba09-9e99-4fa9-b297-e8ab9836e602-installation-pull-secrets\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.791532 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.791466 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e7a8bd0-5535-428b-8505-777710a3dd19-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj\" (UID: \"1e7a8bd0-5535-428b-8505-777710a3dd19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" Jun 03 19:25:12.791663 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.791646 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fedfba09-9e99-4fa9-b297-e8ab9836e602-image-registry-private-configuration\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.791947 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.791934 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31598752-4c6d-47a4-9e99-36f86d580ccd-serving-cert\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.803531 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.803508 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-bound-sa-token\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.804048 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.804027 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g578q\" (UniqueName: \"kubernetes.io/projected/c3351a51-09d5-4424-8601-10bafbe6293e-kube-api-access-g578q\") pod \"volume-data-source-validator-78dd696465-fw75d\" (UID: \"c3351a51-09d5-4424-8601-10bafbe6293e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fw75d" Jun 03 19:25:12.805642 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.805620 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bcvm\" (UniqueName: \"kubernetes.io/projected/1e7a8bd0-5535-428b-8505-777710a3dd19-kube-api-access-8bcvm\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj\" (UID: \"1e7a8bd0-5535-428b-8505-777710a3dd19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" Jun 03 19:25:12.805813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.805794 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62lbr\" (UniqueName: \"kubernetes.io/projected/31598752-4c6d-47a4-9e99-36f86d580ccd-kube-api-access-62lbr\") pod \"insights-operator-69684796bc-djmrc\" (UID: \"31598752-4c6d-47a4-9e99-36f86d580ccd\") " pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.806295 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.806264 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxsbs\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-kube-api-access-lxsbs\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:12.849238 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.849214 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fw75d" Jun 03 19:25:12.860359 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.860341 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" Jun 03 19:25:12.868226 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.868206 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-djmrc" Jun 03 19:25:12.873360 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.873324 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:12.890503 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.890113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-qx6q2\" (UID: \"c7c39a4e-167c-48f2-a0cb-b751f918e9d0\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" Jun 03 19:25:12.890503 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.890261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-nginx-conf\") pod \"networking-console-plugin-68d6b54856-qx6q2\" (UID: \"c7c39a4e-167c-48f2-a0cb-b751f918e9d0\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" Jun 03 19:25:12.890705 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:12.890582 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:25:12.890705 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:12.890675 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert podName:c7c39a4e-167c-48f2-a0cb-b751f918e9d0 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:13.390654469 +0000 UTC m=+258.544454427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-qx6q2" (UID: "c7c39a4e-167c-48f2-a0cb-b751f918e9d0") : secret "networking-console-plugin-cert" not found Jun 03 19:25:12.891098 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.891074 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-nginx-conf\") pod \"networking-console-plugin-68d6b54856-qx6q2\" (UID: \"c7c39a4e-167c-48f2-a0cb-b751f918e9d0\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" Jun 03 19:25:12.989896 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:12.989864 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fw75d"] Jun 03 19:25:12.993353 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:25:12.993331 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3351a51_09d5_4424_8601_10bafbe6293e.slice/crio-0ff50e1c65a607873c55c0e99ff3543d53fe0b602b0d828b432e690811da91f0 WatchSource:0}: Error finding container 0ff50e1c65a607873c55c0e99ff3543d53fe0b602b0d828b432e690811da91f0: Status 404 returned error can't find the container with id 0ff50e1c65a607873c55c0e99ff3543d53fe0b602b0d828b432e690811da91f0 Jun 03 19:25:13.004605 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:13.004561 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj"] Jun 03 19:25:13.006955 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:25:13.006920 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e7a8bd0_5535_428b_8505_777710a3dd19.slice/crio-5c3fe736038a771bf8cd45157a3cfc6eff2680667e620534b1c4e51103697db9 WatchSource:0}: Error finding container 5c3fe736038a771bf8cd45157a3cfc6eff2680667e620534b1c4e51103697db9: Status 404 returned error can't find the container with id 5c3fe736038a771bf8cd45157a3cfc6eff2680667e620534b1c4e51103697db9 Jun 03 19:25:13.021854 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:13.021828 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-djmrc"] Jun 03 19:25:13.024212 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:25:13.024188 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31598752_4c6d_47a4_9e99_36f86d580ccd.slice/crio-e4daf9eaa6f8fd13725a176f2c364911fa53953343874357f34a6e22a21c5e09 WatchSource:0}: Error finding container e4daf9eaa6f8fd13725a176f2c364911fa53953343874357f34a6e22a21c5e09: Status 404 returned error can't find the container with id e4daf9eaa6f8fd13725a176f2c364911fa53953343874357f34a6e22a21c5e09 Jun 03 19:25:13.039088 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:13.039045 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" event={"ID":"1e7a8bd0-5535-428b-8505-777710a3dd19","Type":"ContainerStarted","Data":"5c3fe736038a771bf8cd45157a3cfc6eff2680667e620534b1c4e51103697db9"} Jun 03 19:25:13.040073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:13.040037 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fw75d" event={"ID":"c3351a51-09d5-4424-8601-10bafbe6293e","Type":"ContainerStarted","Data":"0ff50e1c65a607873c55c0e99ff3543d53fe0b602b0d828b432e690811da91f0"} Jun 03 19:25:13.040909 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:13.040890 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-djmrc" event={"ID":"31598752-4c6d-47a4-9e99-36f86d580ccd","Type":"ContainerStarted","Data":"e4daf9eaa6f8fd13725a176f2c364911fa53953343874357f34a6e22a21c5e09"} Jun 03 19:25:13.193514 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:13.193477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jl8zn\" (UID: \"d3ea12e8-ba9d-4021-ad31-2d269677f404\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" Jun 03 19:25:13.193666 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:13.193619 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:25:13.193710 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:13.193667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:13.193710 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:13.193681 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls podName:d3ea12e8-ba9d-4021-ad31-2d269677f404 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:14.193665815 +0000 UTC m=+259.347465777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-jl8zn" (UID: "d3ea12e8-ba9d-4021-ad31-2d269677f404") : secret "samples-operator-tls" not found Jun 03 19:25:13.193788 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:13.193717 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:13.193788 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:13.193738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:13.193788 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:13.193747 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle podName:45d61802-f1e6-4f1e-8686-953b64e982e1 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:14.193735928 +0000 UTC m=+259.347535887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle") pod "router-default-54c9bb4859-mjcg4" (UID: "45d61802-f1e6-4f1e-8686-953b64e982e1") : configmap references non-existent config key: service-ca.crt Jun 03 19:25:13.193877 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:13.193792 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:25:13.193877 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:13.193821 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls podName:3716079f-b675-4a70-8cb8-a096320abdfd nodeName:}" failed. No retries permitted until 2026-06-03 19:25:14.193814486 +0000 UTC m=+259.347614444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-qhn5z" (UID: "3716079f-b675-4a70-8cb8-a096320abdfd") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:25:13.193877 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:13.193818 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:25:13.193877 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:13.193843 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs podName:45d61802-f1e6-4f1e-8686-953b64e982e1 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:14.193838088 +0000 UTC m=+259.347638046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs") pod "router-default-54c9bb4859-mjcg4" (UID: "45d61802-f1e6-4f1e-8686-953b64e982e1") : secret "router-metrics-certs-default" not found Jun 03 19:25:13.294884 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:13.294802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:13.295030 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:13.294946 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:25:13.295030 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:13.294962 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-957c5866-54nh7: secret "image-registry-tls" not found Jun 03 19:25:13.295030 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:13.295010 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls podName:fedfba09-9e99-4fa9-b297-e8ab9836e602 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:14.294993932 +0000 UTC m=+259.448793893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls") pod "image-registry-957c5866-54nh7" (UID: "fedfba09-9e99-4fa9-b297-e8ab9836e602") : secret "image-registry-tls" not found Jun 03 19:25:13.395271 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:13.395238 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-qx6q2\" (UID: \"c7c39a4e-167c-48f2-a0cb-b751f918e9d0\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" Jun 03 19:25:13.395431 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:13.395372 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:25:13.395431 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:13.395429 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert podName:c7c39a4e-167c-48f2-a0cb-b751f918e9d0 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:14.395412253 +0000 UTC m=+259.549212233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-qx6q2" (UID: "c7c39a4e-167c-48f2-a0cb-b751f918e9d0") : secret "networking-console-plugin-cert" not found Jun 03 19:25:14.203247 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:14.203210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:14.203715 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:14.203273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:14.203715 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:14.203299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:14.203715 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:14.203342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jl8zn\" (UID: \"d3ea12e8-ba9d-4021-ad31-2d269677f404\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" Jun 03 19:25:14.203715 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:14.203388 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle podName:45d61802-f1e6-4f1e-8686-953b64e982e1 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:16.203368738 +0000 UTC m=+261.357168700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle") pod "router-default-54c9bb4859-mjcg4" (UID: "45d61802-f1e6-4f1e-8686-953b64e982e1") : configmap references non-existent config key: service-ca.crt Jun 03 19:25:14.203715 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:14.203396 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:25:14.203715 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:14.203449 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs podName:45d61802-f1e6-4f1e-8686-953b64e982e1 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:16.203432313 +0000 UTC m=+261.357232276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs") pod "router-default-54c9bb4859-mjcg4" (UID: "45d61802-f1e6-4f1e-8686-953b64e982e1") : secret "router-metrics-certs-default" not found Jun 03 19:25:14.203715 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:14.203503 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:25:14.203715 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:14.203552 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls podName:3716079f-b675-4a70-8cb8-a096320abdfd nodeName:}" failed. No retries permitted until 2026-06-03 19:25:16.203539756 +0000 UTC m=+261.357339717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-qhn5z" (UID: "3716079f-b675-4a70-8cb8-a096320abdfd") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:25:14.203715 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:14.203504 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:25:14.203715 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:14.203592 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls podName:d3ea12e8-ba9d-4021-ad31-2d269677f404 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:16.203582514 +0000 UTC m=+261.357382487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-jl8zn" (UID: "d3ea12e8-ba9d-4021-ad31-2d269677f404") : secret "samples-operator-tls" not found Jun 03 19:25:14.304559 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:14.304525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:14.304691 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:14.304637 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:25:14.304691 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:14.304649 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-957c5866-54nh7: secret "image-registry-tls" not found Jun 03 19:25:14.304770 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:14.304694 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls podName:fedfba09-9e99-4fa9-b297-e8ab9836e602 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:16.304680874 +0000 UTC m=+261.458480833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls") pod "image-registry-957c5866-54nh7" (UID: "fedfba09-9e99-4fa9-b297-e8ab9836e602") : secret "image-registry-tls" not found Jun 03 19:25:14.405800 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:14.405764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-qx6q2\" (UID: \"c7c39a4e-167c-48f2-a0cb-b751f918e9d0\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" Jun 03 19:25:14.405961 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:14.405855 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:25:14.405961 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:14.405911 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert podName:c7c39a4e-167c-48f2-a0cb-b751f918e9d0 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:16.405896249 +0000 UTC m=+261.559696208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-qx6q2" (UID: "c7c39a4e-167c-48f2-a0cb-b751f918e9d0") : secret "networking-console-plugin-cert" not found Jun 03 19:25:15.050499 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:15.050450 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fw75d" event={"ID":"c3351a51-09d5-4424-8601-10bafbe6293e","Type":"ContainerStarted","Data":"b70113ace18a9d72574c9a7a54cd27d819d2efe5b582f03d25dc749c5709fd08"} Jun 03 19:25:15.068502 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:15.068458 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fw75d" podStartSLOduration=1.753608687 podStartE2EDuration="3.06844479s" totalImagesPullingTime="1.314836103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:15.067593713 +0000 UTC m=+260.221393696" watchObservedRunningTime="2026-06-03 19:25:15.06844479 +0000 UTC m=+260.222244784" Jun 03 19:25:15.149831 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:15.149775 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:15.207279 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:15.207235 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:16.220457 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:16.220431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:16.220813 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:16.220551 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle podName:45d61802-f1e6-4f1e-8686-953b64e982e1 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:20.220531164 +0000 UTC m=+265.374331142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle") pod "router-default-54c9bb4859-mjcg4" (UID: "45d61802-f1e6-4f1e-8686-953b64e982e1") : configmap references non-existent config key: service-ca.crt Jun 03 19:25:16.220813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:16.220592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:16.220813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:16.220616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:16.220813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:16.220657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jl8zn\" (UID: \"d3ea12e8-ba9d-4021-ad31-2d269677f404\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" Jun 03 19:25:16.220813 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:16.220686 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:25:16.220813 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:16.220736 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs podName:45d61802-f1e6-4f1e-8686-953b64e982e1 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:20.220720986 +0000 UTC m=+265.374520956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs") pod "router-default-54c9bb4859-mjcg4" (UID: "45d61802-f1e6-4f1e-8686-953b64e982e1") : secret "router-metrics-certs-default" not found Jun 03 19:25:16.220813 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:16.220816 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:25:16.221256 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:16.220820 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:25:16.221256 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:16.220849 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls podName:d3ea12e8-ba9d-4021-ad31-2d269677f404 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:20.220839574 +0000 UTC m=+265.374639533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-jl8zn" (UID: "d3ea12e8-ba9d-4021-ad31-2d269677f404") : secret "samples-operator-tls" not found Jun 03 19:25:16.221256 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:16.220877 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls podName:3716079f-b675-4a70-8cb8-a096320abdfd nodeName:}" failed. No retries permitted until 2026-06-03 19:25:20.22086115 +0000 UTC m=+265.374661110 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-qhn5z" (UID: "3716079f-b675-4a70-8cb8-a096320abdfd") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:25:16.321742 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:16.321694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:16.321939 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:16.321848 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:25:16.321939 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:16.321863 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-957c5866-54nh7: secret "image-registry-tls" not found Jun 03 19:25:16.321939 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:16.321924 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls podName:fedfba09-9e99-4fa9-b297-e8ab9836e602 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:20.321907165 +0000 UTC m=+265.475707147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls") pod "image-registry-957c5866-54nh7" (UID: "fedfba09-9e99-4fa9-b297-e8ab9836e602") : secret "image-registry-tls" not found Jun 03 19:25:16.422495 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:16.422409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-qx6q2\" (UID: \"c7c39a4e-167c-48f2-a0cb-b751f918e9d0\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" Jun 03 19:25:16.422648 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:16.422532 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:25:16.422648 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:16.422593 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert podName:c7c39a4e-167c-48f2-a0cb-b751f918e9d0 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:20.422577025 +0000 UTC m=+265.576377005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-qx6q2" (UID: "c7c39a4e-167c-48f2-a0cb-b751f918e9d0") : secret "networking-console-plugin-cert" not found Jun 03 19:25:16.730361 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:16.730272 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:16.844005 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:16.843971 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:17.058160 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:17.058050 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-djmrc" event={"ID":"31598752-4c6d-47a4-9e99-36f86d580ccd","Type":"ContainerStarted","Data":"aa8eca5754c9a824396dc383adc3656659b06a66fd34ef4767f7070e481f722f"} Jun 03 19:25:17.059423 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:17.059393 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" event={"ID":"1e7a8bd0-5535-428b-8505-777710a3dd19","Type":"ContainerStarted","Data":"6c5e075f85a2fa840ff7f7a8fc8b02eadd517dd4ec27bc39e6d7415615ed3f09"} Jun 03 19:25:17.108473 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:17.108402 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" podStartSLOduration=1.967066346 podStartE2EDuration="5.108381859s" totalImagesPullingTime="3.141315513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:17.106954108 +0000 UTC m=+262.260754085" watchObservedRunningTime="2026-06-03 19:25:17.108381859 +0000 UTC m=+262.262181840" Jun 03 19:25:17.108644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:17.108522 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-69684796bc-djmrc" podStartSLOduration=1.9854286399999999 podStartE2EDuration="5.108512326s" totalImagesPullingTime="3.123083686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:17.082189189 +0000 UTC m=+262.235989181" watchObservedRunningTime="2026-06-03 19:25:17.108512326 +0000 UTC m=+262.262312307" Jun 03 19:25:17.255584 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:17.255544 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:17.357663 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:17.357582 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:17.457572 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:17.457542 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:17.635584 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:17.635556 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:17.726074 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:17.726033 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:18.665628 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:18.665595 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:18.725653 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:18.725623 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:19.045269 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:19.045190 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:19.099416 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:19.099390 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:19.179006 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:19.178980 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sn9xs_85f61ce5-2bce-478c-96a4-4082d38e04aa/dns-node-resolver/0.log" Jun 03 19:25:20.080952 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:20.080919 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:20.254643 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:20.254606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jl8zn\" (UID: \"d3ea12e8-ba9d-4021-ad31-2d269677f404\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" Jun 03 19:25:20.254831 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:20.254723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:20.254831 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:20.254751 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:25:20.254831 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:20.254765 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:20.254831 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:20.254791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:20.254831 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:20.254817 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls podName:d3ea12e8-ba9d-4021-ad31-2d269677f404 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:28.254801233 +0000 UTC m=+273.408601191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-jl8zn" (UID: "d3ea12e8-ba9d-4021-ad31-2d269677f404") : secret "samples-operator-tls" not found Jun 03 19:25:20.255039 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:20.254858 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:25:20.255039 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:20.254874 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle podName:45d61802-f1e6-4f1e-8686-953b64e982e1 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:28.254857659 +0000 UTC m=+273.408657617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle") pod "router-default-54c9bb4859-mjcg4" (UID: "45d61802-f1e6-4f1e-8686-953b64e982e1") : configmap references non-existent config key: service-ca.crt Jun 03 19:25:20.255039 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:20.254906 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs podName:45d61802-f1e6-4f1e-8686-953b64e982e1 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:28.254895339 +0000 UTC m=+273.408695300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs") pod "router-default-54c9bb4859-mjcg4" (UID: "45d61802-f1e6-4f1e-8686-953b64e982e1") : secret "router-metrics-certs-default" not found Jun 03 19:25:20.255039 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:20.254861 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:25:20.255039 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:20.254943 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls podName:3716079f-b675-4a70-8cb8-a096320abdfd nodeName:}" failed. No retries permitted until 2026-06-03 19:25:28.254936395 +0000 UTC m=+273.408736353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-qhn5z" (UID: "3716079f-b675-4a70-8cb8-a096320abdfd") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:25:20.355499 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:20.355415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:20.355649 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:20.355563 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:25:20.355649 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:20.355580 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-957c5866-54nh7: secret "image-registry-tls" not found Jun 03 19:25:20.355649 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:20.355632 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls podName:fedfba09-9e99-4fa9-b297-e8ab9836e602 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:28.355617335 +0000 UTC m=+273.509417293 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls") pod "image-registry-957c5866-54nh7" (UID: "fedfba09-9e99-4fa9-b297-e8ab9836e602") : secret "image-registry-tls" not found Jun 03 19:25:20.382955 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:20.382922 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zqdtg_7347a83b-e12c-4675-abe4-87c8bf2b2a44/node-ca/0.log" Jun 03 19:25:20.456722 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:20.456686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-qx6q2\" (UID: \"c7c39a4e-167c-48f2-a0cb-b751f918e9d0\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" Jun 03 19:25:20.456874 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:20.456804 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:25:20.456874 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:20.456861 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert podName:c7c39a4e-167c-48f2-a0cb-b751f918e9d0 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:28.456846943 +0000 UTC m=+273.610646901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-qx6q2" (UID: "c7c39a4e-167c-48f2-a0cb-b751f918e9d0") : secret "networking-console-plugin-cert" not found Jun 03 19:25:20.779840 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:20.779812 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5srf2_e6ce57d8-c75c-44b6-a785-20e4d2bf09f2/serve-healthcheck-canary/0.log" Jun 03 19:25:21.701431 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:21.701397 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:21.857909 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:21.857862 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:21.955756 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:21.955676 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:22.056284 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:22.056246 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:22.156133 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:22.156100 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:22.257719 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:22.257640 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:22.407273 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:22.407240 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:23.412535 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:23.412499 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:23.786977 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:23.786890 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:23.990314 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:23.990282 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:24.202164 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:24.202132 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:24.353127 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:24.353096 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:24.429553 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:24.429519 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:25.394176 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:25.394144 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:25.490810 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:25.490779 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:25.591482 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:25.591455 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:25.782128 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:25.782028 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:25.985749 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:25.985710 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:26.187030 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:26.186999 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:26.385768 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:26.385735 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:27.582451 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:27.582423 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:27.784267 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:27.784230 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:27.985056 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:27.985023 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:28.212311 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.212281 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:28.314680 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.314602 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:28.322794 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.322772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:28.322852 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.322814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:28.322852 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.322839 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:28.322919 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.322879 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jl8zn\" (UID: \"d3ea12e8-ba9d-4021-ad31-2d269677f404\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" Jun 03 19:25:28.323021 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:28.323004 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:25:28.323099 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:28.323085 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls podName:3716079f-b675-4a70-8cb8-a096320abdfd nodeName:}" failed. No retries permitted until 2026-06-03 19:25:44.323051485 +0000 UTC m=+289.476851443 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-qhn5z" (UID: "3716079f-b675-4a70-8cb8-a096320abdfd") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:25:28.323510 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.323493 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d61802-f1e6-4f1e-8686-953b64e982e1-service-ca-bundle\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:28.325278 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.325255 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3ea12e8-ba9d-4021-ad31-2d269677f404-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jl8zn\" (UID: \"d3ea12e8-ba9d-4021-ad31-2d269677f404\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" Jun 03 19:25:28.325368 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.325286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d61802-f1e6-4f1e-8686-953b64e982e1-metrics-certs\") pod \"router-default-54c9bb4859-mjcg4\" (UID: \"45d61802-f1e6-4f1e-8686-953b64e982e1\") " pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:28.365889 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.365869 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:28.376075 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.375983 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" Jun 03 19:25:28.411289 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.411252 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:28.425756 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.425578 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:28.433704 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.433641 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls\") pod \"image-registry-957c5866-54nh7\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:28.475585 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.475554 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:28.498647 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.498568 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54c9bb4859-mjcg4"] Jun 03 19:25:28.501257 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:25:28.501227 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d61802_f1e6_4f1e_8686_953b64e982e1.slice/crio-cbd5dc3c8294eb09b88de8b48092b5e39af68115df78b26d2bbe0fd64b94e907 WatchSource:0}: Error finding container cbd5dc3c8294eb09b88de8b48092b5e39af68115df78b26d2bbe0fd64b94e907: Status 404 returned error can't find the container with id cbd5dc3c8294eb09b88de8b48092b5e39af68115df78b26d2bbe0fd64b94e907 Jun 03 19:25:28.512285 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.512266 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn"] Jun 03 19:25:28.526353 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.526203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-qx6q2\" (UID: \"c7c39a4e-167c-48f2-a0cb-b751f918e9d0\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" Jun 03 19:25:28.526510 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:28.526370 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:25:28.526510 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:28.526443 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert podName:c7c39a4e-167c-48f2-a0cb-b751f918e9d0 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:44.52641507 +0000 UTC m=+289.680215053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-qx6q2" (UID: "c7c39a4e-167c-48f2-a0cb-b751f918e9d0") : secret "networking-console-plugin-cert" not found Jun 03 19:25:28.612790 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:28.612766 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-957c5866-54nh7"] Jun 03 19:25:28.615175 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:25:28.615145 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfedfba09_9e99_4fa9_b297_e8ab9836e602.slice/crio-d6a2f8b5801c89724e7d67382ee30aa803c30ad461c6e937bd496406794c6eb8 WatchSource:0}: Error finding container d6a2f8b5801c89724e7d67382ee30aa803c30ad461c6e937bd496406794c6eb8: Status 404 returned error can't find the container with id d6a2f8b5801c89724e7d67382ee30aa803c30ad461c6e937bd496406794c6eb8 Jun 03 19:25:29.097232 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:29.097196 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-957c5866-54nh7" event={"ID":"fedfba09-9e99-4fa9-b297-e8ab9836e602","Type":"ContainerStarted","Data":"5dbb2222a81437128db979df8e640b8eec588b3eb492c684ff95acb26bc9f22e"} Jun 03 19:25:29.097399 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:29.097289 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-957c5866-54nh7" event={"ID":"fedfba09-9e99-4fa9-b297-e8ab9836e602","Type":"ContainerStarted","Data":"d6a2f8b5801c89724e7d67382ee30aa803c30ad461c6e937bd496406794c6eb8"} Jun 03 19:25:29.097399 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:29.097355 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:29.098945 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:29.098904 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54c9bb4859-mjcg4" event={"ID":"45d61802-f1e6-4f1e-8686-953b64e982e1","Type":"ContainerStarted","Data":"a6cc359da684374842325700b4ecea5d2b3f21fb4295be17fa790b8902ff70a6"} Jun 03 19:25:29.099125 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:29.098962 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54c9bb4859-mjcg4" event={"ID":"45d61802-f1e6-4f1e-8686-953b64e982e1","Type":"ContainerStarted","Data":"cbd5dc3c8294eb09b88de8b48092b5e39af68115df78b26d2bbe0fd64b94e907"} Jun 03 19:25:29.100308 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:29.100285 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" event={"ID":"d3ea12e8-ba9d-4021-ad31-2d269677f404","Type":"ContainerStarted","Data":"486737721f5178e48cd57a3027691298967f43055611f7315dc51082eba71a22"} Jun 03 19:25:29.119828 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:29.119786 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-957c5866-54nh7" podStartSLOduration=17.119770093 podStartE2EDuration="17.119770093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:29.11904697 +0000 UTC m=+274.272846950" watchObservedRunningTime="2026-06-03 19:25:29.119770093 +0000 UTC m=+274.273570070" Jun 03 19:25:29.138928 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:29.138885 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-54c9bb4859-mjcg4" podStartSLOduration=17.138868809 podStartE2EDuration="17.138868809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:29.137691022 +0000 UTC m=+274.291491003" watchObservedRunningTime="2026-06-03 19:25:29.138868809 +0000 UTC m=+274.292668792" Jun 03 19:25:29.366797 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:29.366720 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:29.369483 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:29.369462 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:29.424915 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:29.424864 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:29.780223 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:29.780186 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:29.880677 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:29.880625 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:29.989427 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:29.989386 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:30.104406 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:30.104328 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:30.105655 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:30.105633 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54c9bb4859-mjcg4" Jun 03 19:25:30.187577 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:30.187537 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:30.612556 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:30.612527 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:30.990296 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:30.990265 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:31.107959 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:31.107924 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" event={"ID":"d3ea12e8-ba9d-4021-ad31-2d269677f404","Type":"ContainerStarted","Data":"5379d65afb1498ac2cb14da86baca2855e8ca87c895c3a6530bbac9f47e5740b"} Jun 03 19:25:31.108128 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:31.107983 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" event={"ID":"d3ea12e8-ba9d-4021-ad31-2d269677f404","Type":"ContainerStarted","Data":"688cd18bcc7d042d87b4c2f221e2df79875147e602cd0e2d6062e293248844eb"} Jun 03 19:25:31.126716 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:31.126672 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jl8zn" podStartSLOduration=17.346286307 podStartE2EDuration="19.126656482s" totalImagesPullingTime="1.780370175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:31.126031548 +0000 UTC m=+276.279831526" watchObservedRunningTime="2026-06-03 19:25:31.126656482 +0000 UTC m=+276.280456460" Jun 03 19:25:31.501734 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:31.501699 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:31.602859 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:31.602830 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:32.019019 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:32.018989 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:32.192039 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:32.191998 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:32.389349 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:32.389321 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:34.261424 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:34.261395 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:34.317666 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:34.317637 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:34.770848 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:34.770804 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vps9j" podUID="bf4a425b-e55d-427d-891c-fb976b02efcc" Jun 03 19:25:35.120104 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:35.120012 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vps9j" Jun 03 19:25:38.296597 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:38.296543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:25:38.298744 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:38.298712 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf4a425b-e55d-427d-891c-fb976b02efcc-metrics-tls\") pod \"dns-default-vps9j\" (UID: \"bf4a425b-e55d-427d-891c-fb976b02efcc\") " pod="openshift-dns/dns-default-vps9j" Jun 03 19:25:38.424118 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:38.424087 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tfxzd\"" Jun 03 19:25:38.430773 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:38.430757 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vps9j" Jun 03 19:25:38.551442 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:38.551375 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vps9j"] Jun 03 19:25:38.554288 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:25:38.554264 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf4a425b_e55d_427d_891c_fb976b02efcc.slice/crio-e55676a771e82cfdced668bb0986d26176af2d21d8a857e04f74100a41c416e8 WatchSource:0}: Error finding container e55676a771e82cfdced668bb0986d26176af2d21d8a857e04f74100a41c416e8: Status 404 returned error can't find the container with id e55676a771e82cfdced668bb0986d26176af2d21d8a857e04f74100a41c416e8 Jun 03 19:25:39.133624 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:39.133577 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vps9j" event={"ID":"bf4a425b-e55d-427d-891c-fb976b02efcc","Type":"ContainerStarted","Data":"e55676a771e82cfdced668bb0986d26176af2d21d8a857e04f74100a41c416e8"} Jun 03 19:25:39.135680 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:39.135651 2577 generic.go:356] "Generic (PLEG): container finished" podID="cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53" containerID="a0112511ca86f08d35a3e82b6231009860b86f00768fb620552e785442440f3c" exitCode=255 Jun 03 19:25:39.135821 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:39.135714 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" event={"ID":"cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53","Type":"ContainerDied","Data":"a0112511ca86f08d35a3e82b6231009860b86f00768fb620552e785442440f3c"} Jun 03 19:25:39.135821 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:39.135767 2577 scope.go:117] "RemoveContainer" containerID="57f8ec9d62246d7b8ea31f62790c09016b3c7ae9e614367f2b3ae621f9fd7891" Jun 03 19:25:39.143358 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:39.143337 2577 scope.go:117] "RemoveContainer" containerID="a0112511ca86f08d35a3e82b6231009860b86f00768fb620552e785442440f3c" Jun 03 19:25:39.143555 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:39.143527 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk_open-cluster-management-agent-addon(cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" podUID="cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53" Jun 03 19:25:40.141008 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:40.140983 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vps9j" event={"ID":"bf4a425b-e55d-427d-891c-fb976b02efcc","Type":"ContainerStarted","Data":"0eae3c797b82cd041ada946cc9d096375f3a43757e842be6e0773963b79e5860"} Jun 03 19:25:41.128628 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.128601 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mdshr"] Jun 03 19:25:41.131730 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.131711 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.140713 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.140694 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pgttb\"" Jun 03 19:25:41.141236 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.141216 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 19:25:41.141531 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.141255 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 19:25:41.145327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.145301 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vps9j" event={"ID":"bf4a425b-e55d-427d-891c-fb976b02efcc","Type":"ContainerStarted","Data":"8af9bbed0e73d4aee0cbd3615a05a349c4e543e82b456e5f8c97ab13f794ff5b"} Jun 03 19:25:41.145487 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.145474 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vps9j" Jun 03 19:25:41.156392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.156364 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mdshr"] Jun 03 19:25:41.219970 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.219941 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-crio-socket\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.220132 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.219976 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jjqs\" (UniqueName: \"kubernetes.io/projected/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-kube-api-access-9jjqs\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.220132 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.219999 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-data-volume\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.220132 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.220051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.220132 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.220120 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.222716 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.222697 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-957c5866-54nh7"] Jun 03 19:25:41.250854 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.250813 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vps9j" podStartSLOduration=251.820978146 podStartE2EDuration="4m13.250796947s" totalImagesPullingTime="1.429818801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:41.24944181 +0000 UTC m=+286.403241802" watchObservedRunningTime="2026-06-03 19:25:41.250796947 +0000 UTC m=+286.404596925" Jun 03 19:25:41.297743 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.297722 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:41.321037 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.321010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.321172 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.321047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.321172 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.321143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-crio-socket\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.321285 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.321177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jjqs\" (UniqueName: \"kubernetes.io/projected/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-kube-api-access-9jjqs\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.321285 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.321213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-data-volume\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.321285 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.321211 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-crio-socket\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.321536 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.321518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.321574 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.321525 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-data-volume\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.323296 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.323280 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.343486 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.343462 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jjqs\" (UniqueName: \"kubernetes.io/projected/f0bb6dc3-78fd-4143-88bb-22df87d5ee58-kube-api-access-9jjqs\") pod \"insights-runtime-extractor-mdshr\" (UID: \"f0bb6dc3-78fd-4143-88bb-22df87d5ee58\") " pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.391645 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.391623 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:41.449183 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.449162 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mdshr" Jun 03 19:25:41.578645 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:41.578616 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mdshr"] Jun 03 19:25:41.581621 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:25:41.581596 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bb6dc3_78fd_4143_88bb_22df87d5ee58.slice/crio-2ebd598d8032ce6aab6b3742dc37d343712273c849e4c786424bb741064bb7f5 WatchSource:0}: Error finding container 2ebd598d8032ce6aab6b3742dc37d343712273c849e4c786424bb741064bb7f5: Status 404 returned error can't find the container with id 2ebd598d8032ce6aab6b3742dc37d343712273c849e4c786424bb741064bb7f5 Jun 03 19:25:42.150012 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:42.149983 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mdshr" event={"ID":"f0bb6dc3-78fd-4143-88bb-22df87d5ee58","Type":"ContainerStarted","Data":"fc4174f871ea2bc351d31071cfe6307f662631e822f4a65731dff6cd4aadfa17"} Jun 03 19:25:42.150385 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:42.150035 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mdshr" event={"ID":"f0bb6dc3-78fd-4143-88bb-22df87d5ee58","Type":"ContainerStarted","Data":"2ebd598d8032ce6aab6b3742dc37d343712273c849e4c786424bb741064bb7f5"} Jun 03 19:25:43.155976 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:43.155941 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mdshr" event={"ID":"f0bb6dc3-78fd-4143-88bb-22df87d5ee58","Type":"ContainerStarted","Data":"e84022f2a5f0b8f0cddf6400f8f14728b72b396f4a80ba59633aeabc1189e547"} Jun 03 19:25:44.345211 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:44.345121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:44.347510 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:44.347482 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3716079f-b675-4a70-8cb8-a096320abdfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qhn5z\" (UID: \"3716079f-b675-4a70-8cb8-a096320abdfd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:44.546394 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:44.546356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-qx6q2\" (UID: \"c7c39a4e-167c-48f2-a0cb-b751f918e9d0\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" Jun 03 19:25:44.548616 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:44.548595 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7c39a4e-167c-48f2-a0cb-b751f918e9d0-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-qx6q2\" (UID: \"c7c39a4e-167c-48f2-a0cb-b751f918e9d0\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" Jun 03 19:25:44.570497 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:44.570472 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" Jun 03 19:25:44.571427 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:44.571407 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" Jun 03 19:25:44.576280 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:44.576263 2577 scope.go:117] "RemoveContainer" containerID="a0112511ca86f08d35a3e82b6231009860b86f00768fb620552e785442440f3c" Jun 03 19:25:44.576412 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:44.576396 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk_open-cluster-management-agent-addon(cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" podUID="cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53" Jun 03 19:25:44.716193 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:44.716163 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z"] Jun 03 19:25:44.718964 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:25:44.718930 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3716079f_b675_4a70_8cb8_a096320abdfd.slice/crio-4230af54eda8acb22a0cf5e64d8cdec9927ec05dcc43ec04d20809ea624f1225 WatchSource:0}: Error finding container 4230af54eda8acb22a0cf5e64d8cdec9927ec05dcc43ec04d20809ea624f1225: Status 404 returned error can't find the container with id 4230af54eda8acb22a0cf5e64d8cdec9927ec05dcc43ec04d20809ea624f1225 Jun 03 19:25:44.744870 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:44.744843 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" Jun 03 19:25:44.878361 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:44.878296 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-qx6q2"] Jun 03 19:25:44.880862 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:25:44.880827 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c39a4e_167c_48f2_a0cb_b751f918e9d0.slice/crio-694cca6a5f06fe4e94195387396f879d1ffaa9aa11466220c0b3bbdd84f53c73 WatchSource:0}: Error finding container 694cca6a5f06fe4e94195387396f879d1ffaa9aa11466220c0b3bbdd84f53c73: Status 404 returned error can't find the container with id 694cca6a5f06fe4e94195387396f879d1ffaa9aa11466220c0b3bbdd84f53c73 Jun 03 19:25:45.164439 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:45.164402 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" event={"ID":"c7c39a4e-167c-48f2-a0cb-b751f918e9d0","Type":"ContainerStarted","Data":"694cca6a5f06fe4e94195387396f879d1ffaa9aa11466220c0b3bbdd84f53c73"} Jun 03 19:25:45.165774 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:45.165741 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" event={"ID":"3716079f-b675-4a70-8cb8-a096320abdfd","Type":"ContainerStarted","Data":"4230af54eda8acb22a0cf5e64d8cdec9927ec05dcc43ec04d20809ea624f1225"} Jun 03 19:25:45.167939 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:45.167915 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mdshr" event={"ID":"f0bb6dc3-78fd-4143-88bb-22df87d5ee58","Type":"ContainerStarted","Data":"8ae85e1d2bb29f0a499a92c2a8f9a81d0ef5ea6c394b1e97b1dc4365e0c23d79"} Jun 03 19:25:45.190323 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:45.190279 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mdshr" podStartSLOduration=1.816697247 podStartE2EDuration="4.190264108s" totalImagesPullingTime="2.373566861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:25:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:45.188603209 +0000 UTC m=+290.342403191" watchObservedRunningTime="2026-06-03 19:25:45.190264108 +0000 UTC m=+290.344064066" Jun 03 19:25:46.172701 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:46.172668 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" event={"ID":"c7c39a4e-167c-48f2-a0cb-b751f918e9d0","Type":"ContainerStarted","Data":"2e24306e439d57208100a3b16a9c93b1d04cc459da9d48932edcc3ce13cc63d2"} Jun 03 19:25:46.193948 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:46.193902 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-68d6b54856-qx6q2" podStartSLOduration=33.075104327 podStartE2EDuration="34.19388787s" totalImagesPullingTime="1.118783543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:46.19304963 +0000 UTC m=+291.346849611" watchObservedRunningTime="2026-06-03 19:25:46.19388787 +0000 UTC m=+291.347687828" Jun 03 19:25:46.307704 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:46.307632 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:46.409112 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:46.409038 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:47.155149 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:47.155106 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:47.177071 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:47.177024 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" event={"ID":"3716079f-b675-4a70-8cb8-a096320abdfd","Type":"ContainerStarted","Data":"a1b09e1bc1ddf188e710490b267bdb1a1651de23b0f5538ba8f3b5dfba1015b7"} Jun 03 19:25:47.202261 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:47.200303 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qhn5z" podStartSLOduration=33.119511909 podStartE2EDuration="35.200285367s" totalImagesPullingTime="2.080773458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:47.196633539 +0000 UTC m=+292.350433519" watchObservedRunningTime="2026-06-03 19:25:47.200285367 +0000 UTC m=+292.354085340" Jun 03 19:25:47.256143 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:47.256089 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:47.342530 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:47.342499 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:47.618514 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:47.618432 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:49.273781 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:49.273742 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-s7c4p" podUID="995cd1f6-5df5-45c1-80cf-1921f567c92f" Jun 03 19:25:49.833722 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:49.833690 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:49.934621 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:49.934585 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:49.994598 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:49.994565 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:50.360536 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.360503 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:50.404877 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.404852 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6"] Jun 03 19:25:50.408208 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.408193 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:50.412801 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.412775 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 19:25:50.412922 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.412808 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 19:25:50.412922 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.412817 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-l94lc\"" Jun 03 19:25:50.412922 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.412810 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 19:25:50.419713 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.419689 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6"] Jun 03 19:25:50.434363 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.434338 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:50.493654 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.493624 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57198e72-4919-484a-87e6-dbe74f218b85-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-fsqw6\" (UID: \"57198e72-4919-484a-87e6-dbe74f218b85\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:50.493777 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.493670 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/57198e72-4919-484a-87e6-dbe74f218b85-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-fsqw6\" (UID: \"57198e72-4919-484a-87e6-dbe74f218b85\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:50.493777 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.493700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57198e72-4919-484a-87e6-dbe74f218b85-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-fsqw6\" (UID: \"57198e72-4919-484a-87e6-dbe74f218b85\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:50.493777 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.493717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9kds\" (UniqueName: \"kubernetes.io/projected/57198e72-4919-484a-87e6-dbe74f218b85-kube-api-access-d9kds\") pod \"prometheus-operator-7f7d445d84-fsqw6\" (UID: \"57198e72-4919-484a-87e6-dbe74f218b85\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:50.595010 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.594971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57198e72-4919-484a-87e6-dbe74f218b85-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-fsqw6\" (UID: \"57198e72-4919-484a-87e6-dbe74f218b85\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:50.595197 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.595025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/57198e72-4919-484a-87e6-dbe74f218b85-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-fsqw6\" (UID: \"57198e72-4919-484a-87e6-dbe74f218b85\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:50.595197 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.595083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57198e72-4919-484a-87e6-dbe74f218b85-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-fsqw6\" (UID: \"57198e72-4919-484a-87e6-dbe74f218b85\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:50.595197 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.595105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kds\" (UniqueName: \"kubernetes.io/projected/57198e72-4919-484a-87e6-dbe74f218b85-kube-api-access-d9kds\") pod \"prometheus-operator-7f7d445d84-fsqw6\" (UID: \"57198e72-4919-484a-87e6-dbe74f218b85\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:50.595197 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:50.595191 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 03 19:25:50.595327 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:50.595257 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57198e72-4919-484a-87e6-dbe74f218b85-prometheus-operator-tls podName:57198e72-4919-484a-87e6-dbe74f218b85 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:51.095237459 +0000 UTC m=+296.249037431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/57198e72-4919-484a-87e6-dbe74f218b85-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-fsqw6" (UID: "57198e72-4919-484a-87e6-dbe74f218b85") : secret "prometheus-operator-tls" not found Jun 03 19:25:50.595615 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.595595 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57198e72-4919-484a-87e6-dbe74f218b85-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-fsqw6\" (UID: \"57198e72-4919-484a-87e6-dbe74f218b85\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:50.597331 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.597312 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57198e72-4919-484a-87e6-dbe74f218b85-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-fsqw6\" (UID: \"57198e72-4919-484a-87e6-dbe74f218b85\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:50.604594 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.604572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9kds\" (UniqueName: \"kubernetes.io/projected/57198e72-4919-484a-87e6-dbe74f218b85-kube-api-access-d9kds\") pod \"prometheus-operator-7f7d445d84-fsqw6\" (UID: \"57198e72-4919-484a-87e6-dbe74f218b85\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:50.860621 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:50.860583 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:51.099295 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:51.099262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/57198e72-4919-484a-87e6-dbe74f218b85-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-fsqw6\" (UID: \"57198e72-4919-484a-87e6-dbe74f218b85\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:51.101551 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:51.101520 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/57198e72-4919-484a-87e6-dbe74f218b85-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-fsqw6\" (UID: \"57198e72-4919-484a-87e6-dbe74f218b85\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:51.152242 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:51.152214 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vps9j" Jun 03 19:25:51.229025 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:51.229000 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:25:51.330010 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:51.329980 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" Jun 03 19:25:51.452548 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:51.452509 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6"] Jun 03 19:25:51.456613 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:25:51.456588 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57198e72_4919_484a_87e6_dbe74f218b85.slice/crio-63f0e15f6a7141b3d4190bb296f6f4b4e846163071b59d8b71e964b72855ed36 WatchSource:0}: Error finding container 63f0e15f6a7141b3d4190bb296f6f4b4e846163071b59d8b71e964b72855ed36: Status 404 returned error can't find the container with id 63f0e15f6a7141b3d4190bb296f6f4b4e846163071b59d8b71e964b72855ed36 Jun 03 19:25:52.195250 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:52.195217 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" event={"ID":"57198e72-4919-484a-87e6-dbe74f218b85","Type":"ContainerStarted","Data":"63f0e15f6a7141b3d4190bb296f6f4b4e846163071b59d8b71e964b72855ed36"} Jun 03 19:25:53.043902 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:53.043806 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:53.199773 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:53.199736 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" event={"ID":"57198e72-4919-484a-87e6-dbe74f218b85","Type":"ContainerStarted","Data":"216d5f3c31e0b33ae6bd99e35e9cbd7725b243086656d5523a4337b84b569c86"} Jun 03 19:25:53.199927 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:53.199816 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" event={"ID":"57198e72-4919-484a-87e6-dbe74f218b85","Type":"ContainerStarted","Data":"8efcf894f9eb966e5db711f88cf4b922b284287dc3d57b5517853e676cd761e9"} Jun 03 19:25:53.223273 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:53.223228 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-fsqw6" podStartSLOduration=1.902659017 podStartE2EDuration="3.22321622s" totalImagesPullingTime="1.320557203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:53.221289182 +0000 UTC m=+298.375089173" watchObservedRunningTime="2026-06-03 19:25:53.22321622 +0000 UTC m=+298.377016213" Jun 03 19:25:54.123483 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.123445 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:54.522097 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.522039 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:54.760344 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.760308 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:54.835454 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.835380 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-67rbb"] Jun 03 19:25:54.837482 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.837468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:54.840770 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.840742 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 19:25:54.840888 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.840783 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 19:25:54.842332 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.842311 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fmdrk\"" Jun 03 19:25:54.842447 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.842358 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 19:25:54.885811 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.885779 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:54.928398 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.928366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/595873e0-90c0-43cd-a8ab-218af0d80478-sys\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:54.928540 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.928416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-wtmp\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:54.928540 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.928492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:54.928540 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.928521 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/595873e0-90c0-43cd-a8ab-218af0d80478-root\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:54.928640 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.928545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/595873e0-90c0-43cd-a8ab-218af0d80478-metrics-client-ca\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:54.928640 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.928562 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-tls\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:54.928640 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.928602 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-textfile\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:54.928730 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.928640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-accelerators-collector-config\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:54.928730 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.928681 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qrkc\" (UniqueName: \"kubernetes.io/projected/595873e0-90c0-43cd-a8ab-218af0d80478-kube-api-access-4qrkc\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:54.998737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:54.998700 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:55.029802 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.029776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-wtmp\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.029908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.029816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.029908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.029834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/595873e0-90c0-43cd-a8ab-218af0d80478-root\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.030002 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.029940 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/595873e0-90c0-43cd-a8ab-218af0d80478-metrics-client-ca\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.030002 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.029958 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-wtmp\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.030002 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.029978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-tls\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.030002 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.029981 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/595873e0-90c0-43cd-a8ab-218af0d80478-root\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.030224 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.030024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-textfile\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.030224 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:55.030085 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 19:25:55.030224 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.030116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-accelerators-collector-config\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.030224 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:55.030141 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-tls podName:595873e0-90c0-43cd-a8ab-218af0d80478 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:55.530120776 +0000 UTC m=+300.683920742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-tls") pod "node-exporter-67rbb" (UID: "595873e0-90c0-43cd-a8ab-218af0d80478") : secret "node-exporter-tls" not found Jun 03 19:25:55.030224 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.030178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qrkc\" (UniqueName: \"kubernetes.io/projected/595873e0-90c0-43cd-a8ab-218af0d80478-kube-api-access-4qrkc\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.030224 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.030216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/595873e0-90c0-43cd-a8ab-218af0d80478-sys\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.030517 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.030314 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/595873e0-90c0-43cd-a8ab-218af0d80478-sys\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.030517 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.030337 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-textfile\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.030517 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.030499 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/595873e0-90c0-43cd-a8ab-218af0d80478-metrics-client-ca\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.030680 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.030658 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-accelerators-collector-config\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.032125 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.032104 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.040375 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.040349 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qrkc\" (UniqueName: \"kubernetes.io/projected/595873e0-90c0-43cd-a8ab-218af0d80478-kube-api-access-4qrkc\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.099140 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.099075 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:55.199509 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.199478 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:55.228077 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.228040 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:25:55.228311 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.228291 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:25:55.233814 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.233796 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 19:25:55.534645 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.534607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-tls\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.536838 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.536817 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/595873e0-90c0-43cd-a8ab-218af0d80478-node-exporter-tls\") pod \"node-exporter-67rbb\" (UID: \"595873e0-90c0-43cd-a8ab-218af0d80478\") " pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.749135 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.749110 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fmdrk\"" Jun 03 19:25:55.756780 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.756758 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-67rbb" Jun 03 19:25:55.766320 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.766292 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:55.767409 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:25:55.767384 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595873e0_90c0_43cd_a8ab_218af0d80478.slice/crio-3365240dd2b57db176a1010431c826c978b86c20f3aa4caffd94927ece414084 WatchSource:0}: Error finding container 3365240dd2b57db176a1010431c826c978b86c20f3aa4caffd94927ece414084: Status 404 returned error can't find the container with id 3365240dd2b57db176a1010431c826c978b86c20f3aa4caffd94927ece414084 Jun 03 19:25:55.851808 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.851716 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:55.852776 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.852756 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:25:55.857524 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.857507 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:55.860673 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.860647 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 19:25:55.860795 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.860677 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 19:25:55.860795 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.860677 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8h77w\"" Jun 03 19:25:55.860914 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.860818 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 19:25:55.860914 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.860689 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 19:25:55.860914 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.860879 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 19:25:55.861101 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.861083 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 19:25:55.861178 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.861127 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 19:25:55.861178 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.861148 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 19:25:55.861178 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.861080 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 19:25:55.873731 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.873706 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:25:55.938371 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.938331 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:55.938531 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.938375 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt6dq\" (UniqueName: \"kubernetes.io/projected/816fc284-4107-4d79-aa0e-54eee1f5cda8-kube-api-access-tt6dq\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:55.938531 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.938404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/816fc284-4107-4d79-aa0e-54eee1f5cda8-config-out\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:55.938531 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.938447 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:55.938531 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.938473 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:55.938531 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.938500 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:55.938531 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.938524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/816fc284-4107-4d79-aa0e-54eee1f5cda8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:55.938733 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.938576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:55.938733 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.938629 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:55.938733 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.938648 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-web-config\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:55.938733 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.938675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-config-volume\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:55.938733 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.938690 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:55.938733 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.938720 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:55.965550 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:55.965516 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:56.040082 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.040037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-config-volume\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.040264 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.040090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.040264 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.040120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.040264 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.040178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.040264 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.040200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt6dq\" (UniqueName: \"kubernetes.io/projected/816fc284-4107-4d79-aa0e-54eee1f5cda8-kube-api-access-tt6dq\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.040264 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.040239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/816fc284-4107-4d79-aa0e-54eee1f5cda8-config-out\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.040509 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.040279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.040509 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.040305 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.040509 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.040332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.040509 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.040359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/816fc284-4107-4d79-aa0e-54eee1f5cda8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.040509 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.040386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.040509 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.040427 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.040509 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.040449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-web-config\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.040901 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.040622 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.040901 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:25:56.040739 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-trusted-ca-bundle podName:816fc284-4107-4d79-aa0e-54eee1f5cda8 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:56.540719105 +0000 UTC m=+301.694519067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "816fc284-4107-4d79-aa0e-54eee1f5cda8") : configmap references non-existent config key: ca-bundle.crt Jun 03 19:25:56.041525 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.041503 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.043282 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.043235 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-config-volume\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.044035 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.043622 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/816fc284-4107-4d79-aa0e-54eee1f5cda8-config-out\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.044035 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.043782 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.044035 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.043998 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.044258 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.044080 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.044258 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.044101 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.045380 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.045356 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.045508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.045491 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-web-config\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.046119 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.046098 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/816fc284-4107-4d79-aa0e-54eee1f5cda8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.051841 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.051820 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt6dq\" (UniqueName: \"kubernetes.io/projected/816fc284-4107-4d79-aa0e-54eee1f5cda8-kube-api-access-tt6dq\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.069418 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.069391 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:56.212367 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.212327 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67rbb" event={"ID":"595873e0-90c0-43cd-a8ab-218af0d80478","Type":"ContainerStarted","Data":"3365240dd2b57db176a1010431c826c978b86c20f3aa4caffd94927ece414084"} Jun 03 19:25:56.281141 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.281115 2577 scope.go:117] "RemoveContainer" containerID="a0112511ca86f08d35a3e82b6231009860b86f00768fb620552e785442440f3c" Jun 03 19:25:56.545309 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.545015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.546308 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.546276 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.769917 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.769889 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:25:56.867750 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.867720 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:56.912235 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.912205 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:25:56.914822 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:25:56.914796 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816fc284_4107_4d79_aa0e_54eee1f5cda8.slice/crio-e1222249f5583d44f85204428588c9e2479a622e563badcc816022fc13977d9a WatchSource:0}: Error finding container e1222249f5583d44f85204428588c9e2479a622e563badcc816022fc13977d9a: Status 404 returned error can't find the container with id e1222249f5583d44f85204428588c9e2479a622e563badcc816022fc13977d9a Jun 03 19:25:56.916628 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.916615 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:25:56.965298 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:56.965269 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:57.217208 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:57.217180 2577 generic.go:356] "Generic (PLEG): container finished" podID="595873e0-90c0-43cd-a8ab-218af0d80478" containerID="a973d8c15322de4f7adebad3525f6373572f555bd03a544467b86736d356fa80" exitCode=0 Jun 03 19:25:57.217629 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:57.217254 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67rbb" event={"ID":"595873e0-90c0-43cd-a8ab-218af0d80478","Type":"ContainerDied","Data":"a973d8c15322de4f7adebad3525f6373572f555bd03a544467b86736d356fa80"} Jun 03 19:25:57.218633 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:57.218609 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerStarted","Data":"e1222249f5583d44f85204428588c9e2479a622e563badcc816022fc13977d9a"} Jun 03 19:25:57.220460 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:57.220438 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d995fd9b6-qxxgk" event={"ID":"cc3b5d65-0af3-4a9d-bcc8-def9ccf43a53","Type":"ContainerStarted","Data":"9f4954f6d8db529042b0ab5bb59f533a9536a8fbcebc08f7a28abf4917bc48f2"} Jun 03 19:25:57.843575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:57.843532 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:57.920460 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:57.920435 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:58.022575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:58.022543 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:58.225626 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:58.225593 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67rbb" event={"ID":"595873e0-90c0-43cd-a8ab-218af0d80478","Type":"ContainerStarted","Data":"b0135e7fed95c08a8cbf0032f580e8fea21d50966688749956c076084bd6f587"} Jun 03 19:25:58.226081 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:58.225640 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67rbb" event={"ID":"595873e0-90c0-43cd-a8ab-218af0d80478","Type":"ContainerStarted","Data":"24bec1625cb8cabd7957398845a02ba3939577b532b0892477ad508b52649716"} Jun 03 19:25:58.231973 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:58.231935 2577 generic.go:356] "Generic (PLEG): container finished" podID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerID="f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c" exitCode=0 Jun 03 19:25:58.232136 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:58.232027 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerDied","Data":"f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c"} Jun 03 19:25:58.250038 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:58.249994 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-67rbb" podStartSLOduration=3.326741247 podStartE2EDuration="4.249978702s" totalImagesPullingTime="856.80186ms" totalInitContainerRuntime="66.435595ms" isStatefulPod=true podCreationTimestamp="2026-06-03 19:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:58.248310307 +0000 UTC m=+303.402110288" watchObservedRunningTime="2026-06-03 19:25:58.249978702 +0000 UTC m=+303.403778682" Jun 03 19:25:58.604961 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:58.604884 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:59.541743 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:59.541699 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:25:59.742137 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:25:59.742101 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:00.197420 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:00.197389 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:00.242486 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:00.242457 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerStarted","Data":"2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c"} Jun 03 19:26:00.242598 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:00.242516 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerStarted","Data":"9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29"} Jun 03 19:26:00.242598 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:00.242540 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerStarted","Data":"a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6"} Jun 03 19:26:00.242598 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:00.242564 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerStarted","Data":"71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b"} Jun 03 19:26:00.242598 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:00.242585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerStarted","Data":"55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97"} Jun 03 19:26:00.287973 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:00.287948 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:01.120290 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:01.120203 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:01.250111 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:01.250080 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerStarted","Data":"e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac"} Jun 03 19:26:02.861796 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:02.861764 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:02.962688 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:02.962655 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:03.796154 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:03.796116 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:03.859282 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:03.859248 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:03.961637 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:03.961603 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:04.061350 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:04.061246 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:04.266874 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:04.266836 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:04.273772 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:04.273746 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:26:04.332898 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:04.332813 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:05.534215 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.534161 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.189685066 podStartE2EDuration="10.5341437s" totalImagesPullingTime="3.327477151s" totalInitContainerRuntime="16.981483ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:26:01.29825236 +0000 UTC m=+306.452052341" watchObservedRunningTime="2026-06-03 19:26:05.5341437 +0000 UTC m=+310.687943750" Jun 03 19:26:05.535020 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.534999 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-56b467f5ff-t6v8k"] Jun 03 19:26:05.539249 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.539230 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-t6v8k" Jun 03 19:26:05.543529 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.543511 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4wmhx\"" Jun 03 19:26:05.543638 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.543574 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 19:26:05.544234 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.544218 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 19:26:05.555687 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.555668 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-t6v8k"] Jun 03 19:26:05.571322 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.571299 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:05.629057 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.629026 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjrlw\" (UniqueName: \"kubernetes.io/projected/76a07518-27b3-4d26-b03d-dc1b07b74b9c-kube-api-access-kjrlw\") pod \"downloads-56b467f5ff-t6v8k\" (UID: \"76a07518-27b3-4d26-b03d-dc1b07b74b9c\") " pod="openshift-console/downloads-56b467f5ff-t6v8k" Jun 03 19:26:05.663511 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.663481 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:05.730625 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.730586 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjrlw\" (UniqueName: \"kubernetes.io/projected/76a07518-27b3-4d26-b03d-dc1b07b74b9c-kube-api-access-kjrlw\") pod \"downloads-56b467f5ff-t6v8k\" (UID: \"76a07518-27b3-4d26-b03d-dc1b07b74b9c\") " pod="openshift-console/downloads-56b467f5ff-t6v8k" Jun 03 19:26:05.736984 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.736959 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:05.752019 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.751997 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjrlw\" (UniqueName: \"kubernetes.io/projected/76a07518-27b3-4d26-b03d-dc1b07b74b9c-kube-api-access-kjrlw\") pod \"downloads-56b467f5ff-t6v8k\" (UID: \"76a07518-27b3-4d26-b03d-dc1b07b74b9c\") " pod="openshift-console/downloads-56b467f5ff-t6v8k" Jun 03 19:26:05.840563 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.840434 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:05.847990 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.847960 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-t6v8k" Jun 03 19:26:05.984265 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:05.984239 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-t6v8k"] Jun 03 19:26:05.986953 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:26:05.986927 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a07518_27b3_4d26_b03d_dc1b07b74b9c.slice/crio-4b2f41315fe33e93abbd87be4b60a7dc224e2cde880e0a998e040ba25d5f7d9f WatchSource:0}: Error finding container 4b2f41315fe33e93abbd87be4b60a7dc224e2cde880e0a998e040ba25d5f7d9f: Status 404 returned error can't find the container with id 4b2f41315fe33e93abbd87be4b60a7dc224e2cde880e0a998e040ba25d5f7d9f Jun 03 19:26:06.242527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.242456 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-957c5866-54nh7" podUID="fedfba09-9e99-4fa9-b297-e8ab9836e602" containerName="registry" containerID="cri-o://5dbb2222a81437128db979df8e640b8eec588b3eb492c684ff95acb26bc9f22e" gracePeriod=30 Jun 03 19:26:06.250635 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.250607 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:06.270694 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.270666 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-t6v8k" event={"ID":"76a07518-27b3-4d26-b03d-dc1b07b74b9c","Type":"ContainerStarted","Data":"4b2f41315fe33e93abbd87be4b60a7dc224e2cde880e0a998e040ba25d5f7d9f"} Jun 03 19:26:06.313800 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.313774 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:06.476632 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.476611 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:26:06.623848 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.623765 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:06.638799 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.638762 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fedfba09-9e99-4fa9-b297-e8ab9836e602-image-registry-private-configuration\") pod \"fedfba09-9e99-4fa9-b297-e8ab9836e602\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " Jun 03 19:26:06.638799 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.638807 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-bound-sa-token\") pod \"fedfba09-9e99-4fa9-b297-e8ab9836e602\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " Jun 03 19:26:06.638979 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.638845 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-certificates\") pod \"fedfba09-9e99-4fa9-b297-e8ab9836e602\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " Jun 03 19:26:06.638979 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.638961 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fedfba09-9e99-4fa9-b297-e8ab9836e602-ca-trust-extracted\") pod \"fedfba09-9e99-4fa9-b297-e8ab9836e602\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " Jun 03 19:26:06.639104 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.639040 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fedfba09-9e99-4fa9-b297-e8ab9836e602-trusted-ca\") pod \"fedfba09-9e99-4fa9-b297-e8ab9836e602\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " Jun 03 19:26:06.639104 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.639086 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fedfba09-9e99-4fa9-b297-e8ab9836e602-installation-pull-secrets\") pod \"fedfba09-9e99-4fa9-b297-e8ab9836e602\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " Jun 03 19:26:06.639200 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.639115 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls\") pod \"fedfba09-9e99-4fa9-b297-e8ab9836e602\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " Jun 03 19:26:06.639250 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.639213 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxsbs\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-kube-api-access-lxsbs\") pod \"fedfba09-9e99-4fa9-b297-e8ab9836e602\" (UID: \"fedfba09-9e99-4fa9-b297-e8ab9836e602\") " Jun 03 19:26:06.639309 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.639264 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fedfba09-9e99-4fa9-b297-e8ab9836e602" (UID: "fedfba09-9e99-4fa9-b297-e8ab9836e602"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:26:06.639616 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.639478 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-certificates\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:26:06.639616 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.639568 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fedfba09-9e99-4fa9-b297-e8ab9836e602-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fedfba09-9e99-4fa9-b297-e8ab9836e602" (UID: "fedfba09-9e99-4fa9-b297-e8ab9836e602"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:26:06.641414 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.641383 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-kube-api-access-lxsbs" (OuterVolumeSpecName: "kube-api-access-lxsbs") pod "fedfba09-9e99-4fa9-b297-e8ab9836e602" (UID: "fedfba09-9e99-4fa9-b297-e8ab9836e602"). InnerVolumeSpecName "kube-api-access-lxsbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:26:06.641522 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.641415 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fedfba09-9e99-4fa9-b297-e8ab9836e602" (UID: "fedfba09-9e99-4fa9-b297-e8ab9836e602"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:26:06.641522 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.641414 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fedfba09-9e99-4fa9-b297-e8ab9836e602-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fedfba09-9e99-4fa9-b297-e8ab9836e602" (UID: "fedfba09-9e99-4fa9-b297-e8ab9836e602"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:26:06.641604 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.641530 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fedfba09-9e99-4fa9-b297-e8ab9836e602-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fedfba09-9e99-4fa9-b297-e8ab9836e602" (UID: "fedfba09-9e99-4fa9-b297-e8ab9836e602"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:26:06.641788 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.641767 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fedfba09-9e99-4fa9-b297-e8ab9836e602" (UID: "fedfba09-9e99-4fa9-b297-e8ab9836e602"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:26:06.647072 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.647043 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fedfba09-9e99-4fa9-b297-e8ab9836e602-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fedfba09-9e99-4fa9-b297-e8ab9836e602" (UID: "fedfba09-9e99-4fa9-b297-e8ab9836e602"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:26:06.726357 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.726303 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:06.740027 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.739999 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fedfba09-9e99-4fa9-b297-e8ab9836e602-image-registry-private-configuration\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:26:06.740027 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.740024 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-bound-sa-token\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:26:06.740027 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.740034 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fedfba09-9e99-4fa9-b297-e8ab9836e602-ca-trust-extracted\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:26:06.740266 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.740042 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fedfba09-9e99-4fa9-b297-e8ab9836e602-trusted-ca\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:26:06.740266 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.740050 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fedfba09-9e99-4fa9-b297-e8ab9836e602-installation-pull-secrets\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:26:06.740266 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.740072 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-registry-tls\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:26:06.740266 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.740086 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxsbs\" (UniqueName: \"kubernetes.io/projected/fedfba09-9e99-4fa9-b297-e8ab9836e602-kube-api-access-lxsbs\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:26:06.929359 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:06.929306 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:07.030909 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:07.030877 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:07.090362 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:07.090329 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:07.234825 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:07.234742 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:07.275978 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:07.275939 2577 generic.go:356] "Generic (PLEG): container finished" podID="fedfba09-9e99-4fa9-b297-e8ab9836e602" containerID="5dbb2222a81437128db979df8e640b8eec588b3eb492c684ff95acb26bc9f22e" exitCode=0 Jun 03 19:26:07.276181 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:07.276018 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-957c5866-54nh7" Jun 03 19:26:07.279107 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:07.279054 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-957c5866-54nh7" event={"ID":"fedfba09-9e99-4fa9-b297-e8ab9836e602","Type":"ContainerDied","Data":"5dbb2222a81437128db979df8e640b8eec588b3eb492c684ff95acb26bc9f22e"} Jun 03 19:26:07.279107 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:07.279111 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-957c5866-54nh7" event={"ID":"fedfba09-9e99-4fa9-b297-e8ab9836e602","Type":"ContainerDied","Data":"d6a2f8b5801c89724e7d67382ee30aa803c30ad461c6e937bd496406794c6eb8"} Jun 03 19:26:07.279272 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:07.279136 2577 scope.go:117] "RemoveContainer" containerID="5dbb2222a81437128db979df8e640b8eec588b3eb492c684ff95acb26bc9f22e" Jun 03 19:26:07.289493 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:07.289477 2577 scope.go:117] "RemoveContainer" containerID="5dbb2222a81437128db979df8e640b8eec588b3eb492c684ff95acb26bc9f22e" Jun 03 19:26:07.289791 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:26:07.289760 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dbb2222a81437128db979df8e640b8eec588b3eb492c684ff95acb26bc9f22e\": container with ID starting with 5dbb2222a81437128db979df8e640b8eec588b3eb492c684ff95acb26bc9f22e not found: ID does not exist" containerID="5dbb2222a81437128db979df8e640b8eec588b3eb492c684ff95acb26bc9f22e" Jun 03 19:26:07.289880 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:07.289800 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dbb2222a81437128db979df8e640b8eec588b3eb492c684ff95acb26bc9f22e"} err="failed to get container status \"5dbb2222a81437128db979df8e640b8eec588b3eb492c684ff95acb26bc9f22e\": rpc error: code = NotFound desc = could not find container \"5dbb2222a81437128db979df8e640b8eec588b3eb492c684ff95acb26bc9f22e\": container with ID starting with 5dbb2222a81437128db979df8e640b8eec588b3eb492c684ff95acb26bc9f22e not found: ID does not exist" Jun 03 19:26:07.316544 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:07.316521 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-957c5866-54nh7"] Jun 03 19:26:07.328875 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:07.328849 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-957c5866-54nh7"] Jun 03 19:26:07.441603 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:07.441573 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:07.628809 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:07.628731 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:08.925254 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:08.925218 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:09.030559 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:09.030528 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:09.279017 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:09.278938 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fedfba09-9e99-4fa9-b297-e8ab9836e602" path="/var/lib/kubelet/pods/fedfba09-9e99-4fa9-b297-e8ab9836e602/volumes" Jun 03 19:26:16.059510 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:16.059473 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:16.159449 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:16.159412 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:18.446268 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:18.446233 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:18.502643 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:18.502607 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:19.262425 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:19.262390 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:19.324195 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:19.324161 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:21.660228 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:21.660179 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:21.725079 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:21.725034 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:22.340984 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:22.340894 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-t6v8k" event={"ID":"76a07518-27b3-4d26-b03d-dc1b07b74b9c","Type":"ContainerStarted","Data":"9c1abcc15f13ec2af65f1c7273371a4b4938fb372cee183e7b895c65f82b2c9a"} Jun 03 19:26:22.341169 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:22.340998 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-56b467f5ff-t6v8k" Jun 03 19:26:22.342644 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:22.342614 2577 generic.go:356] "Generic (PLEG): container finished" podID="31598752-4c6d-47a4-9e99-36f86d580ccd" containerID="aa8eca5754c9a824396dc383adc3656659b06a66fd34ef4767f7070e481f722f" exitCode=0 Jun 03 19:26:22.342754 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:22.342691 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-djmrc" event={"ID":"31598752-4c6d-47a4-9e99-36f86d580ccd","Type":"ContainerDied","Data":"aa8eca5754c9a824396dc383adc3656659b06a66fd34ef4767f7070e481f722f"} Jun 03 19:26:22.342849 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:22.342824 2577 patch_prober.go:28] interesting pod/downloads-56b467f5ff-t6v8k container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.20:8080/\": dial tcp 10.134.0.20:8080: connect: connection refused" start-of-body= Jun 03 19:26:22.342908 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:22.342882 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-56b467f5ff-t6v8k" podUID="76a07518-27b3-4d26-b03d-dc1b07b74b9c" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.20:8080/\": dial tcp 10.134.0.20:8080: connect: connection refused" Jun 03 19:26:22.343090 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:22.343073 2577 scope.go:117] "RemoveContainer" containerID="aa8eca5754c9a824396dc383adc3656659b06a66fd34ef4767f7070e481f722f" Jun 03 19:26:22.363710 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:22.363668 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-56b467f5ff-t6v8k" podStartSLOduration=1.207369693 podStartE2EDuration="17.363653044s" totalImagesPullingTime="16.156283351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:26:22.361619402 +0000 UTC m=+327.515419382" watchObservedRunningTime="2026-06-03 19:26:22.363653044 +0000 UTC m=+327.517453024" Jun 03 19:26:23.349752 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:23.349713 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-djmrc" event={"ID":"31598752-4c6d-47a4-9e99-36f86d580ccd","Type":"ContainerStarted","Data":"b8a4be0802a35c17e8e2fe4959f4c8d6b1b920a7e6422f68cb3097bef4076067"} Jun 03 19:26:23.363655 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:23.363624 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-56b467f5ff-t6v8k" Jun 03 19:26:26.048983 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:26.048936 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:30.270247 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:30.270210 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:36.279950 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:36.279917 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:42.425740 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:42.425709 2577 generic.go:356] "Generic (PLEG): container finished" podID="1e7a8bd0-5535-428b-8505-777710a3dd19" containerID="6c5e075f85a2fa840ff7f7a8fc8b02eadd517dd4ec27bc39e6d7415615ed3f09" exitCode=0 Jun 03 19:26:42.426153 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:42.425785 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" event={"ID":"1e7a8bd0-5535-428b-8505-777710a3dd19","Type":"ContainerDied","Data":"6c5e075f85a2fa840ff7f7a8fc8b02eadd517dd4ec27bc39e6d7415615ed3f09"} Jun 03 19:26:42.426153 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:42.426113 2577 scope.go:117] "RemoveContainer" containerID="6c5e075f85a2fa840ff7f7a8fc8b02eadd517dd4ec27bc39e6d7415615ed3f09" Jun 03 19:26:43.431311 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:43.431279 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj" event={"ID":"1e7a8bd0-5535-428b-8505-777710a3dd19","Type":"ContainerStarted","Data":"7128491edc72ee59794e744b093125e940f9156e64611cced8b69c48be6768f4"} Jun 03 19:26:49.268454 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:49.268415 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:26:49.370434 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:26:49.370376 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:04.263279 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:04.263243 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:04.318052 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:04.318025 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:04.810455 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:04.810422 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:06.206688 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:06.206656 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:06.267822 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:06.267792 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:09.173496 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:09.173455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:27:09.175693 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:09.175666 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd1f6-5df5-45c1-80cf-1921f567c92f-metrics-certs\") pod \"network-metrics-daemon-s7c4p\" (UID: \"995cd1f6-5df5-45c1-80cf-1921f567c92f\") " pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:27:09.378263 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:09.378232 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-grwp9\"" Jun 03 19:27:09.385240 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:09.385216 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7c4p" Jun 03 19:27:09.506807 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:09.506779 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s7c4p"] Jun 03 19:27:09.508708 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:27:09.508680 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995cd1f6_5df5_45c1_80cf_1921f567c92f.slice/crio-91fced037f5f7a4046b9dce47b14dd6d473fedada7bc0d2cdd980fd4c7db0b7c WatchSource:0}: Error finding container 91fced037f5f7a4046b9dce47b14dd6d473fedada7bc0d2cdd980fd4c7db0b7c: Status 404 returned error can't find the container with id 91fced037f5f7a4046b9dce47b14dd6d473fedada7bc0d2cdd980fd4c7db0b7c Jun 03 19:27:09.523971 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:09.523944 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s7c4p" event={"ID":"995cd1f6-5df5-45c1-80cf-1921f567c92f","Type":"ContainerStarted","Data":"91fced037f5f7a4046b9dce47b14dd6d473fedada7bc0d2cdd980fd4c7db0b7c"} Jun 03 19:27:10.052942 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:10.052905 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:10.111635 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:10.111604 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:10.172125 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:10.172084 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:10.529238 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:10.529204 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s7c4p" event={"ID":"995cd1f6-5df5-45c1-80cf-1921f567c92f","Type":"ContainerStarted","Data":"4d1249ca3345f95548060bdb5cac607e90b3eb26071608c9c2ab48797934b8c1"} Jun 03 19:27:10.529564 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:10.529253 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s7c4p" event={"ID":"995cd1f6-5df5-45c1-80cf-1921f567c92f","Type":"ContainerStarted","Data":"067f43035ef252de084e8c6535fa40f56b69cda8143efb6e795a17edaad85ab5"} Jun 03 19:27:10.549458 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:10.549411 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s7c4p" podStartSLOduration=374.764208656 podStartE2EDuration="6m15.549397151s" totalImagesPullingTime="785.188495ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:27:10.547313641 +0000 UTC m=+375.701113634" watchObservedRunningTime="2026-06-03 19:27:10.549397151 +0000 UTC m=+375.703197129" Jun 03 19:27:10.645958 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:10.645932 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:10.708652 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:10.708624 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:14.129505 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:14.129413 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:14.814499 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:14.814459 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:15.194845 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.194808 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:27:15.195329 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.195179 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="alertmanager" containerID="cri-o://55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97" gracePeriod=120 Jun 03 19:27:15.195329 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.195235 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="kube-rbac-proxy-metric" containerID="cri-o://2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c" gracePeriod=120 Jun 03 19:27:15.195329 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.195250 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="kube-rbac-proxy-web" containerID="cri-o://a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6" gracePeriod=120 Jun 03 19:27:15.195329 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.195302 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="config-reloader" containerID="cri-o://71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b" gracePeriod=120 Jun 03 19:27:15.195329 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.195309 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="prom-label-proxy" containerID="cri-o://e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac" gracePeriod=120 Jun 03 19:27:15.195560 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.195289 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="kube-rbac-proxy" containerID="cri-o://9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29" gracePeriod=120 Jun 03 19:27:15.549889 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.549810 2577 generic.go:356] "Generic (PLEG): container finished" podID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerID="e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac" exitCode=0 Jun 03 19:27:15.549889 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.549835 2577 generic.go:356] "Generic (PLEG): container finished" podID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerID="9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29" exitCode=0 Jun 03 19:27:15.549889 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.549842 2577 generic.go:356] "Generic (PLEG): container finished" podID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerID="71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b" exitCode=0 Jun 03 19:27:15.549889 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.549847 2577 generic.go:356] "Generic (PLEG): container finished" podID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerID="55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97" exitCode=0 Jun 03 19:27:15.549889 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.549878 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerDied","Data":"e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac"} Jun 03 19:27:15.550173 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.549961 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerDied","Data":"9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29"} Jun 03 19:27:15.550173 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.549987 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerDied","Data":"71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b"} Jun 03 19:27:15.550173 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:15.550010 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerDied","Data":"55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97"} Jun 03 19:27:16.443252 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.443226 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.534253 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.534173 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-trusted-ca-bundle\") pod \"816fc284-4107-4d79-aa0e-54eee1f5cda8\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " Jun 03 19:27:16.534253 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.534206 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy-web\") pod \"816fc284-4107-4d79-aa0e-54eee1f5cda8\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " Jun 03 19:27:16.534253 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.534231 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt6dq\" (UniqueName: \"kubernetes.io/projected/816fc284-4107-4d79-aa0e-54eee1f5cda8-kube-api-access-tt6dq\") pod \"816fc284-4107-4d79-aa0e-54eee1f5cda8\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " Jun 03 19:27:16.534511 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.534257 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy\") pod \"816fc284-4107-4d79-aa0e-54eee1f5cda8\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " Jun 03 19:27:16.534511 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.534436 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-main-tls\") pod \"816fc284-4107-4d79-aa0e-54eee1f5cda8\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " Jun 03 19:27:16.534511 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.534500 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-cluster-tls-config\") pod \"816fc284-4107-4d79-aa0e-54eee1f5cda8\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " Jun 03 19:27:16.534676 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.534542 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-config-volume\") pod \"816fc284-4107-4d79-aa0e-54eee1f5cda8\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " Jun 03 19:27:16.534676 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.534581 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-web-config\") pod \"816fc284-4107-4d79-aa0e-54eee1f5cda8\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " Jun 03 19:27:16.534676 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.534620 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "816fc284-4107-4d79-aa0e-54eee1f5cda8" (UID: "816fc284-4107-4d79-aa0e-54eee1f5cda8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:16.534676 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.534630 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"816fc284-4107-4d79-aa0e-54eee1f5cda8\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " Jun 03 19:27:16.534860 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.534698 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-metrics-client-ca\") pod \"816fc284-4107-4d79-aa0e-54eee1f5cda8\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " Jun 03 19:27:16.534860 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.534740 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/816fc284-4107-4d79-aa0e-54eee1f5cda8-config-out\") pod \"816fc284-4107-4d79-aa0e-54eee1f5cda8\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " Jun 03 19:27:16.534860 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.534766 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/816fc284-4107-4d79-aa0e-54eee1f5cda8-tls-assets\") pod \"816fc284-4107-4d79-aa0e-54eee1f5cda8\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " Jun 03 19:27:16.534860 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.534788 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-main-db\") pod \"816fc284-4107-4d79-aa0e-54eee1f5cda8\" (UID: \"816fc284-4107-4d79-aa0e-54eee1f5cda8\") " Jun 03 19:27:16.535135 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.535030 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:27:16.535441 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.535393 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "816fc284-4107-4d79-aa0e-54eee1f5cda8" (UID: "816fc284-4107-4d79-aa0e-54eee1f5cda8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:27:16.535557 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.535509 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "816fc284-4107-4d79-aa0e-54eee1f5cda8" (UID: "816fc284-4107-4d79-aa0e-54eee1f5cda8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:16.536999 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.536971 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "816fc284-4107-4d79-aa0e-54eee1f5cda8" (UID: "816fc284-4107-4d79-aa0e-54eee1f5cda8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:16.537184 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.537041 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "816fc284-4107-4d79-aa0e-54eee1f5cda8" (UID: "816fc284-4107-4d79-aa0e-54eee1f5cda8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:16.537346 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.537321 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "816fc284-4107-4d79-aa0e-54eee1f5cda8" (UID: "816fc284-4107-4d79-aa0e-54eee1f5cda8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:16.537346 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.537334 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/816fc284-4107-4d79-aa0e-54eee1f5cda8-kube-api-access-tt6dq" (OuterVolumeSpecName: "kube-api-access-tt6dq") pod "816fc284-4107-4d79-aa0e-54eee1f5cda8" (UID: "816fc284-4107-4d79-aa0e-54eee1f5cda8"). InnerVolumeSpecName "kube-api-access-tt6dq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:27:16.537702 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.537674 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-config-volume" (OuterVolumeSpecName: "config-volume") pod "816fc284-4107-4d79-aa0e-54eee1f5cda8" (UID: "816fc284-4107-4d79-aa0e-54eee1f5cda8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:16.537795 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.537694 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "816fc284-4107-4d79-aa0e-54eee1f5cda8" (UID: "816fc284-4107-4d79-aa0e-54eee1f5cda8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:16.537988 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.537967 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/816fc284-4107-4d79-aa0e-54eee1f5cda8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "816fc284-4107-4d79-aa0e-54eee1f5cda8" (UID: "816fc284-4107-4d79-aa0e-54eee1f5cda8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:27:16.538758 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.538741 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816fc284-4107-4d79-aa0e-54eee1f5cda8-config-out" (OuterVolumeSpecName: "config-out") pod "816fc284-4107-4d79-aa0e-54eee1f5cda8" (UID: "816fc284-4107-4d79-aa0e-54eee1f5cda8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:27:16.542711 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.542679 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "816fc284-4107-4d79-aa0e-54eee1f5cda8" (UID: "816fc284-4107-4d79-aa0e-54eee1f5cda8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:16.548722 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.548704 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-web-config" (OuterVolumeSpecName: "web-config") pod "816fc284-4107-4d79-aa0e-54eee1f5cda8" (UID: "816fc284-4107-4d79-aa0e-54eee1f5cda8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:16.556742 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.556720 2577 generic.go:356] "Generic (PLEG): container finished" podID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerID="2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c" exitCode=0 Jun 03 19:27:16.556742 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.556743 2577 generic.go:356] "Generic (PLEG): container finished" podID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerID="a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6" exitCode=0 Jun 03 19:27:16.556857 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.556772 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerDied","Data":"2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c"} Jun 03 19:27:16.556857 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.556794 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.556857 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.556826 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerDied","Data":"a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6"} Jun 03 19:27:16.556857 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.556853 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816fc284-4107-4d79-aa0e-54eee1f5cda8","Type":"ContainerDied","Data":"e1222249f5583d44f85204428588c9e2479a622e563badcc816022fc13977d9a"} Jun 03 19:27:16.557015 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.556884 2577 scope.go:117] "RemoveContainer" containerID="e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac" Jun 03 19:27:16.564335 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.564309 2577 scope.go:117] "RemoveContainer" containerID="2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c" Jun 03 19:27:16.570990 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.570976 2577 scope.go:117] "RemoveContainer" containerID="9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29" Jun 03 19:27:16.577716 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.577700 2577 scope.go:117] "RemoveContainer" containerID="a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6" Jun 03 19:27:16.583585 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.583563 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:27:16.584825 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.584810 2577 scope.go:117] "RemoveContainer" containerID="71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b" Jun 03 19:27:16.591176 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.591152 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:27:16.591329 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.591316 2577 scope.go:117] "RemoveContainer" containerID="55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97" Jun 03 19:27:16.597698 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.597681 2577 scope.go:117] "RemoveContainer" containerID="f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c" Jun 03 19:27:16.603987 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.603971 2577 scope.go:117] "RemoveContainer" containerID="e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac" Jun 03 19:27:16.604238 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:27:16.604219 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac\": container with ID starting with e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac not found: ID does not exist" containerID="e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac" Jun 03 19:27:16.604289 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.604247 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac"} err="failed to get container status \"e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac\": rpc error: code = NotFound desc = could not find container \"e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac\": container with ID starting with e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac not found: ID does not exist" Jun 03 19:27:16.604289 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.604263 2577 scope.go:117] "RemoveContainer" containerID="2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c" Jun 03 19:27:16.604465 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:27:16.604448 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c\": container with ID starting with 2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c not found: ID does not exist" containerID="2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c" Jun 03 19:27:16.604503 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.604471 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c"} err="failed to get container status \"2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c\": rpc error: code = NotFound desc = could not find container \"2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c\": container with ID starting with 2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c not found: ID does not exist" Jun 03 19:27:16.604503 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.604487 2577 scope.go:117] "RemoveContainer" containerID="9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29" Jun 03 19:27:16.604666 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:27:16.604652 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29\": container with ID starting with 9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29 not found: ID does not exist" containerID="9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29" Jun 03 19:27:16.604702 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.604669 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29"} err="failed to get container status \"9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29\": rpc error: code = NotFound desc = could not find container \"9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29\": container with ID starting with 9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29 not found: ID does not exist" Jun 03 19:27:16.604702 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.604681 2577 scope.go:117] "RemoveContainer" containerID="a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6" Jun 03 19:27:16.604853 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:27:16.604839 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6\": container with ID starting with a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6 not found: ID does not exist" containerID="a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6" Jun 03 19:27:16.604897 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.604855 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6"} err="failed to get container status \"a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6\": rpc error: code = NotFound desc = could not find container \"a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6\": container with ID starting with a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6 not found: ID does not exist" Jun 03 19:27:16.604897 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.604866 2577 scope.go:117] "RemoveContainer" containerID="71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b" Jun 03 19:27:16.605105 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:27:16.605088 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b\": container with ID starting with 71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b not found: ID does not exist" containerID="71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b" Jun 03 19:27:16.605173 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.605115 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b"} err="failed to get container status \"71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b\": rpc error: code = NotFound desc = could not find container \"71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b\": container with ID starting with 71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b not found: ID does not exist" Jun 03 19:27:16.605173 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.605134 2577 scope.go:117] "RemoveContainer" containerID="55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97" Jun 03 19:27:16.605358 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:27:16.605340 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97\": container with ID starting with 55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97 not found: ID does not exist" containerID="55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97" Jun 03 19:27:16.605396 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.605363 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97"} err="failed to get container status \"55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97\": rpc error: code = NotFound desc = could not find container \"55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97\": container with ID starting with 55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97 not found: ID does not exist" Jun 03 19:27:16.605396 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.605380 2577 scope.go:117] "RemoveContainer" containerID="f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c" Jun 03 19:27:16.605598 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:27:16.605582 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c\": container with ID starting with f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c not found: ID does not exist" containerID="f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c" Jun 03 19:27:16.605635 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.605602 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c"} err="failed to get container status \"f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c\": rpc error: code = NotFound desc = could not find container \"f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c\": container with ID starting with f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c not found: ID does not exist" Jun 03 19:27:16.605635 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.605616 2577 scope.go:117] "RemoveContainer" containerID="e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac" Jun 03 19:27:16.605804 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.605789 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac"} err="failed to get container status \"e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac\": rpc error: code = NotFound desc = could not find container \"e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac\": container with ID starting with e3b6dfc0bab8cdcec613d89ee02a0fe1e04e4c00eb6e84fade7a9240b9de96ac not found: ID does not exist" Jun 03 19:27:16.605845 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.605804 2577 scope.go:117] "RemoveContainer" containerID="2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c" Jun 03 19:27:16.605990 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.605973 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c"} err="failed to get container status \"2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c\": rpc error: code = NotFound desc = could not find container \"2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c\": container with ID starting with 2e8b053409a94f61e82a47c601b80d51ed73ac1866c91bc114b78a9740a0a23c not found: ID does not exist" Jun 03 19:27:16.606056 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.605992 2577 scope.go:117] "RemoveContainer" containerID="9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29" Jun 03 19:27:16.606200 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.606186 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29"} err="failed to get container status \"9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29\": rpc error: code = NotFound desc = could not find container \"9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29\": container with ID starting with 9b32ac34a88b5432f0bc60cc35991da48c8f2e05318c2de6fbf25a7960e59c29 not found: ID does not exist" Jun 03 19:27:16.606243 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.606200 2577 scope.go:117] "RemoveContainer" containerID="a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6" Jun 03 19:27:16.606397 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.606378 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6"} err="failed to get container status \"a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6\": rpc error: code = NotFound desc = could not find container \"a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6\": container with ID starting with a0150cac2d3dacc5b04f6fed26a7879ce060a7af65a456dc2346780c75e804d6 not found: ID does not exist" Jun 03 19:27:16.606397 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.606396 2577 scope.go:117] "RemoveContainer" containerID="71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b" Jun 03 19:27:16.606618 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.606601 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b"} err="failed to get container status \"71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b\": rpc error: code = NotFound desc = could not find container \"71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b\": container with ID starting with 71a20db9bfb3ac6908e65ee388feb83d22aab8fe70409dc478e634dd21d0c92b not found: ID does not exist" Jun 03 19:27:16.606666 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.606618 2577 scope.go:117] "RemoveContainer" containerID="55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97" Jun 03 19:27:16.606806 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.606791 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97"} err="failed to get container status \"55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97\": rpc error: code = NotFound desc = could not find container \"55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97\": container with ID starting with 55050b4a3a2b633313e265c43b0eb608c943e8660f432016433de0b8779c8a97 not found: ID does not exist" Jun 03 19:27:16.606847 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.606805 2577 scope.go:117] "RemoveContainer" containerID="f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c" Jun 03 19:27:16.607003 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.606987 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c"} err="failed to get container status \"f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c\": rpc error: code = NotFound desc = could not find container \"f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c\": container with ID starting with f9f01a40bf34bae3a39613c31563523e608e8f9adbbcee857e3228109529363c not found: ID does not exist" Jun 03 19:27:16.622726 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.622705 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:27:16.622995 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.622982 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="alertmanager" Jun 03 19:27:16.623052 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.622996 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="alertmanager" Jun 03 19:27:16.623052 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623003 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="config-reloader" Jun 03 19:27:16.623052 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623008 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="config-reloader" Jun 03 19:27:16.623052 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623015 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="kube-rbac-proxy-web" Jun 03 19:27:16.623052 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623021 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="kube-rbac-proxy-web" Jun 03 19:27:16.623052 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623026 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="kube-rbac-proxy" Jun 03 19:27:16.623052 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623032 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="kube-rbac-proxy" Jun 03 19:27:16.623052 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623039 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="kube-rbac-proxy-metric" Jun 03 19:27:16.623052 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623044 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="kube-rbac-proxy-metric" Jun 03 19:27:16.623327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623056 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="prom-label-proxy" Jun 03 19:27:16.623327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623082 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="prom-label-proxy" Jun 03 19:27:16.623327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623091 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fedfba09-9e99-4fa9-b297-e8ab9836e602" containerName="registry" Jun 03 19:27:16.623327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623097 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fedfba09-9e99-4fa9-b297-e8ab9836e602" containerName="registry" Jun 03 19:27:16.623327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623102 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="init-config-reloader" Jun 03 19:27:16.623327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623107 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="init-config-reloader" Jun 03 19:27:16.623327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623149 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="prom-label-proxy" Jun 03 19:27:16.623327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623156 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="alertmanager" Jun 03 19:27:16.623327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623162 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="config-reloader" Jun 03 19:27:16.623327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623166 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fedfba09-9e99-4fa9-b297-e8ab9836e602" containerName="registry" Jun 03 19:27:16.623327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623172 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="kube-rbac-proxy-web" Jun 03 19:27:16.623327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623176 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="kube-rbac-proxy" Jun 03 19:27:16.623327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.623181 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" containerName="kube-rbac-proxy-metric" Jun 03 19:27:16.628722 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.628705 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.632095 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.632074 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 19:27:16.632184 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.632103 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 19:27:16.632184 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.632147 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 19:27:16.632308 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.632190 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 19:27:16.632308 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.632204 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 19:27:16.632473 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.632459 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 19:27:16.632529 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.632516 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 19:27:16.632830 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.632814 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 19:27:16.632894 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.632878 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8h77w\"" Jun 03 19:27:16.635464 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635438 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7528efa2-4cc0-44bd-88f7-2f724631d050-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.635552 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7528efa2-4cc0-44bd-88f7-2f724631d050-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.635552 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.635552 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635520 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-config-volume\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.635672 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.635672 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.635672 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7528efa2-4cc0-44bd-88f7-2f724631d050-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.635790 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635714 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4ntf\" (UniqueName: \"kubernetes.io/projected/7528efa2-4cc0-44bd-88f7-2f724631d050-kube-api-access-g4ntf\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.635790 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635743 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7528efa2-4cc0-44bd-88f7-2f724631d050-config-out\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.635790 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635766 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-web-config\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.635935 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635828 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.635935 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.635935 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7528efa2-4cc0-44bd-88f7-2f724631d050-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.636141 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635941 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:27:16.636141 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635957 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt6dq\" (UniqueName: \"kubernetes.io/projected/816fc284-4107-4d79-aa0e-54eee1f5cda8-kube-api-access-tt6dq\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:27:16.636141 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635972 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:27:16.636141 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635986 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-main-tls\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:27:16.636141 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.635999 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-cluster-tls-config\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:27:16.636141 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.636014 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-config-volume\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:27:16.636141 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.636027 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-web-config\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:27:16.636141 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.636039 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/816fc284-4107-4d79-aa0e-54eee1f5cda8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:27:16.636141 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.636053 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/816fc284-4107-4d79-aa0e-54eee1f5cda8-metrics-client-ca\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:27:16.636141 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.636087 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/816fc284-4107-4d79-aa0e-54eee1f5cda8-config-out\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:27:16.636141 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.636098 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/816fc284-4107-4d79-aa0e-54eee1f5cda8-tls-assets\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:27:16.636141 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.636110 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/816fc284-4107-4d79-aa0e-54eee1f5cda8-alertmanager-main-db\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:27:16.637674 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.637654 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 19:27:16.645459 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.645440 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:27:16.736769 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.736746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.736895 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.736780 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.736895 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.736803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7528efa2-4cc0-44bd-88f7-2f724631d050-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.736895 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.736828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7528efa2-4cc0-44bd-88f7-2f724631d050-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.736895 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.736858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7528efa2-4cc0-44bd-88f7-2f724631d050-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.736895 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.736880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.737175 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.736905 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-config-volume\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.737175 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.736931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.737175 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.736955 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.737175 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.736985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7528efa2-4cc0-44bd-88f7-2f724631d050-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.737175 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.737021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4ntf\" (UniqueName: \"kubernetes.io/projected/7528efa2-4cc0-44bd-88f7-2f724631d050-kube-api-access-g4ntf\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.737175 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.737045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7528efa2-4cc0-44bd-88f7-2f724631d050-config-out\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.737175 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.737090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-web-config\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.737496 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.737285 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7528efa2-4cc0-44bd-88f7-2f724631d050-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.737829 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.737806 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7528efa2-4cc0-44bd-88f7-2f724631d050-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.738013 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.737989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7528efa2-4cc0-44bd-88f7-2f724631d050-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.739855 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.739829 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.739941 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.739906 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.739941 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.739912 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-config-volume\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.739941 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.739829 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-web-config\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.740140 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.740104 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.740257 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.740239 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.740443 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.740421 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7528efa2-4cc0-44bd-88f7-2f724631d050-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.740665 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.740650 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7528efa2-4cc0-44bd-88f7-2f724631d050-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.741526 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.741511 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7528efa2-4cc0-44bd-88f7-2f724631d050-config-out\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.749473 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.749455 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4ntf\" (UniqueName: \"kubernetes.io/projected/7528efa2-4cc0-44bd-88f7-2f724631d050-kube-api-access-g4ntf\") pod \"alertmanager-main-0\" (UID: \"7528efa2-4cc0-44bd-88f7-2f724631d050\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:16.937878 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:16.937849 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:27:17.072077 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:17.072034 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:27:17.073914 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:27:17.073885 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7528efa2_4cc0_44bd_88f7_2f724631d050.slice/crio-928ab8d8de2e08d9c572170a60fa24fb00947232564e5feb46582bece989bd27 WatchSource:0}: Error finding container 928ab8d8de2e08d9c572170a60fa24fb00947232564e5feb46582bece989bd27: Status 404 returned error can't find the container with id 928ab8d8de2e08d9c572170a60fa24fb00947232564e5feb46582bece989bd27 Jun 03 19:27:17.278514 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:17.278444 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="816fc284-4107-4d79-aa0e-54eee1f5cda8" path="/var/lib/kubelet/pods/816fc284-4107-4d79-aa0e-54eee1f5cda8/volumes" Jun 03 19:27:17.562087 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:17.561978 2577 generic.go:356] "Generic (PLEG): container finished" podID="7528efa2-4cc0-44bd-88f7-2f724631d050" containerID="b69d97f725ba29805dd1115a59a8cb841b72656fee80a6f8f5e562afad954c8e" exitCode=0 Jun 03 19:27:17.562087 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:17.562055 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7528efa2-4cc0-44bd-88f7-2f724631d050","Type":"ContainerDied","Data":"b69d97f725ba29805dd1115a59a8cb841b72656fee80a6f8f5e562afad954c8e"} Jun 03 19:27:17.562578 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:17.562178 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7528efa2-4cc0-44bd-88f7-2f724631d050","Type":"ContainerStarted","Data":"928ab8d8de2e08d9c572170a60fa24fb00947232564e5feb46582bece989bd27"} Jun 03 19:27:18.569984 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:18.569951 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7528efa2-4cc0-44bd-88f7-2f724631d050","Type":"ContainerStarted","Data":"d0d3c6b145af800c2434beb4b28c4e5d4536429a9f1f86f5dfa839b01b498661"} Jun 03 19:27:18.570427 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:18.570012 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7528efa2-4cc0-44bd-88f7-2f724631d050","Type":"ContainerStarted","Data":"8372fd0b3a43af48d844b3fde3583fbf0e0f4144b778587ab3256ffc7d2777f4"} Jun 03 19:27:18.570427 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:18.570038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7528efa2-4cc0-44bd-88f7-2f724631d050","Type":"ContainerStarted","Data":"31c8df44236e6d8fa4f0a9f2092d5b56d1cf5fbf800d6e1f195a4eb74d9cac90"} Jun 03 19:27:18.570427 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:18.570082 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7528efa2-4cc0-44bd-88f7-2f724631d050","Type":"ContainerStarted","Data":"f10f05f9b8658f32f49c3c0270d0f1d8836c6128c7669f33ecb376b590381068"} Jun 03 19:27:18.570427 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:18.570110 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7528efa2-4cc0-44bd-88f7-2f724631d050","Type":"ContainerStarted","Data":"86fb93a5c72a078b5afd7ca54d9b4f878921ccc660f3373562204318c4070ad6"} Jun 03 19:27:18.570427 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:18.570132 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7528efa2-4cc0-44bd-88f7-2f724631d050","Type":"ContainerStarted","Data":"9fe739fc6be93f0b7876ee2b709f72f09ade707406cb7c8c74d5439d0bd4482b"} Jun 03 19:27:18.603531 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:18.603479 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.590036923 podStartE2EDuration="2.603462547s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.425624ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:27:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:27:18.602836801 +0000 UTC m=+383.756636802" watchObservedRunningTime="2026-06-03 19:27:18.603462547 +0000 UTC m=+383.757262527" Jun 03 19:27:19.243739 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.243699 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6ff645f84-cbnlr"] Jun 03 19:27:19.247286 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.247260 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.251989 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.251960 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 19:27:19.251989 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.251978 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 19:27:19.252204 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.251999 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 19:27:19.252204 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.251975 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 19:27:19.252204 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.251978 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 19:27:19.253459 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.253441 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rn267\"" Jun 03 19:27:19.254684 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.254655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aee757f-5f14-4da8-8628-198c36a3b941-serving-certs-ca-bundle\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.254814 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.254695 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aee757f-5f14-4da8-8628-198c36a3b941-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.254814 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.254737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5aee757f-5f14-4da8-8628-198c36a3b941-secret-telemeter-client\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.254814 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.254772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6dfs\" (UniqueName: \"kubernetes.io/projected/5aee757f-5f14-4da8-8628-198c36a3b941-kube-api-access-c6dfs\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.254814 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.254802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aee757f-5f14-4da8-8628-198c36a3b941-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.255293 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.254854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5aee757f-5f14-4da8-8628-198c36a3b941-telemeter-client-tls\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.255293 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.254877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5aee757f-5f14-4da8-8628-198c36a3b941-federate-client-tls\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.255293 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.254940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aee757f-5f14-4da8-8628-198c36a3b941-metrics-client-ca\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.256768 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.256750 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 19:27:19.261021 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.260999 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6ff645f84-cbnlr"] Jun 03 19:27:19.355727 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.355695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5aee757f-5f14-4da8-8628-198c36a3b941-telemeter-client-tls\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.355727 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.355726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5aee757f-5f14-4da8-8628-198c36a3b941-federate-client-tls\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.355994 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.355762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aee757f-5f14-4da8-8628-198c36a3b941-metrics-client-ca\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.355994 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.355818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aee757f-5f14-4da8-8628-198c36a3b941-serving-certs-ca-bundle\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.355994 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.355842 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aee757f-5f14-4da8-8628-198c36a3b941-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.355994 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.355874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5aee757f-5f14-4da8-8628-198c36a3b941-secret-telemeter-client\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.355994 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.355910 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6dfs\" (UniqueName: \"kubernetes.io/projected/5aee757f-5f14-4da8-8628-198c36a3b941-kube-api-access-c6dfs\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.355994 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.355937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aee757f-5f14-4da8-8628-198c36a3b941-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.356730 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.356597 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aee757f-5f14-4da8-8628-198c36a3b941-metrics-client-ca\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.356856 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.356799 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aee757f-5f14-4da8-8628-198c36a3b941-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.357226 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.357201 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aee757f-5f14-4da8-8628-198c36a3b941-serving-certs-ca-bundle\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.358402 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.358382 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5aee757f-5f14-4da8-8628-198c36a3b941-telemeter-client-tls\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.358703 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.358678 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aee757f-5f14-4da8-8628-198c36a3b941-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.359003 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.358972 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5aee757f-5f14-4da8-8628-198c36a3b941-federate-client-tls\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.359307 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.359263 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5aee757f-5f14-4da8-8628-198c36a3b941-secret-telemeter-client\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.367084 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.367030 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6dfs\" (UniqueName: \"kubernetes.io/projected/5aee757f-5f14-4da8-8628-198c36a3b941-kube-api-access-c6dfs\") pod \"telemeter-client-6ff645f84-cbnlr\" (UID: \"5aee757f-5f14-4da8-8628-198c36a3b941\") " pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.557910 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.557813 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" Jun 03 19:27:19.699453 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:19.699406 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6ff645f84-cbnlr"] Jun 03 19:27:19.702329 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:27:19.702301 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aee757f_5f14_4da8_8628_198c36a3b941.slice/crio-fb7232c059b4c994a27be778ceb74e9c7f2f5c63f65035d18475b6072c0a32ae WatchSource:0}: Error finding container fb7232c059b4c994a27be778ceb74e9c7f2f5c63f65035d18475b6072c0a32ae: Status 404 returned error can't find the container with id fb7232c059b4c994a27be778ceb74e9c7f2f5c63f65035d18475b6072c0a32ae Jun 03 19:27:20.583232 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:20.583178 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" event={"ID":"5aee757f-5f14-4da8-8628-198c36a3b941","Type":"ContainerStarted","Data":"fb7232c059b4c994a27be778ceb74e9c7f2f5c63f65035d18475b6072c0a32ae"} Jun 03 19:27:22.592937 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:22.592844 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" event={"ID":"5aee757f-5f14-4da8-8628-198c36a3b941","Type":"ContainerStarted","Data":"83eb31a710fe506963afa0abbaa07a17257ad48c9771f3379dc6ce95ae59d56e"} Jun 03 19:27:22.592937 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:22.592911 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" event={"ID":"5aee757f-5f14-4da8-8628-198c36a3b941","Type":"ContainerStarted","Data":"396fc4e129003dc85cf8de693b101b7b754f857947a667358db4f394cfddaeb9"} Jun 03 19:27:22.593338 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:22.592943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" event={"ID":"5aee757f-5f14-4da8-8628-198c36a3b941","Type":"ContainerStarted","Data":"b3bfdd8451f5fb5c877ed27194228bc3bc89ceff73786daa883136521b306637"} Jun 03 19:27:22.619268 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:22.619220 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6ff645f84-cbnlr" podStartSLOduration=1.102749252 podStartE2EDuration="3.619199718s" totalImagesPullingTime="2.516450466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:27:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:27:22.616299047 +0000 UTC m=+387.770099038" watchObservedRunningTime="2026-06-03 19:27:22.619199718 +0000 UTC m=+387.772999699" Jun 03 19:27:23.441952 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:23.441915 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:23.542613 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:23.542574 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:23.646696 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:23.646660 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:24.186783 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:24.186752 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:24.254672 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:24.254637 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:34.203580 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:34.203545 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:34.262207 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:34.262167 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:34.318705 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:34.318677 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:53.248700 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:53.248663 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:27:53.361536 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:27:53.361505 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:13.457127 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:13.457028 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:29.402139 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:29.402106 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:29.479273 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:29.479244 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:41.030304 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:41.030265 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:41.130608 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:41.130574 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:41.233235 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:41.233201 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:41.331854 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:41.331769 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:41.389980 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:41.389949 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:41.734628 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:41.734586 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:41.806034 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:41.806001 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:49.271743 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:49.271708 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:49.373640 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:49.373599 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:51.487201 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:51.487165 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:51.540687 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:51.540659 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:28:51.600681 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:28:51.600656 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:17.927379 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:17.927343 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:18.029346 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.029314 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:18.568623 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.568590 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr"] Jun 03 19:29:18.571906 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.571890 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" Jun 03 19:29:18.575339 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.575307 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:29:18.575339 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.575327 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:29:18.575525 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.575335 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bkt6w\"" Jun 03 19:29:18.579900 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.579874 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr"] Jun 03 19:29:18.629999 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.629971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9c3389-3d39-4730-ada9-50ef5e11268e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr\" (UID: \"7a9c3389-3d39-4730-ada9-50ef5e11268e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" Jun 03 19:29:18.630137 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.630005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-266pj\" (UniqueName: \"kubernetes.io/projected/7a9c3389-3d39-4730-ada9-50ef5e11268e-kube-api-access-266pj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr\" (UID: \"7a9c3389-3d39-4730-ada9-50ef5e11268e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" Jun 03 19:29:18.630137 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.630048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9c3389-3d39-4730-ada9-50ef5e11268e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr\" (UID: \"7a9c3389-3d39-4730-ada9-50ef5e11268e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" Jun 03 19:29:18.730450 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.730419 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9c3389-3d39-4730-ada9-50ef5e11268e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr\" (UID: \"7a9c3389-3d39-4730-ada9-50ef5e11268e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" Jun 03 19:29:18.730567 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.730459 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-266pj\" (UniqueName: \"kubernetes.io/projected/7a9c3389-3d39-4730-ada9-50ef5e11268e-kube-api-access-266pj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr\" (UID: \"7a9c3389-3d39-4730-ada9-50ef5e11268e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" Jun 03 19:29:18.730567 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.730524 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9c3389-3d39-4730-ada9-50ef5e11268e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr\" (UID: \"7a9c3389-3d39-4730-ada9-50ef5e11268e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" Jun 03 19:29:18.730863 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.730843 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9c3389-3d39-4730-ada9-50ef5e11268e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr\" (UID: \"7a9c3389-3d39-4730-ada9-50ef5e11268e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" Jun 03 19:29:18.730907 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.730854 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9c3389-3d39-4730-ada9-50ef5e11268e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr\" (UID: \"7a9c3389-3d39-4730-ada9-50ef5e11268e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" Jun 03 19:29:18.740073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.740046 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-266pj\" (UniqueName: \"kubernetes.io/projected/7a9c3389-3d39-4730-ada9-50ef5e11268e-kube-api-access-266pj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr\" (UID: \"7a9c3389-3d39-4730-ada9-50ef5e11268e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" Jun 03 19:29:18.881682 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:18.881609 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" Jun 03 19:29:19.005758 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:19.005734 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr"] Jun 03 19:29:19.007843 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:29:19.007818 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9c3389_3d39_4730_ada9_50ef5e11268e.slice/crio-0b9100355827ae4755342af2e330e15d1be3a8624f49949703cd7092021f96d9 WatchSource:0}: Error finding container 0b9100355827ae4755342af2e330e15d1be3a8624f49949703cd7092021f96d9: Status 404 returned error can't find the container with id 0b9100355827ae4755342af2e330e15d1be3a8624f49949703cd7092021f96d9 Jun 03 19:29:19.033486 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:19.033462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" event={"ID":"7a9c3389-3d39-4730-ada9-50ef5e11268e","Type":"ContainerStarted","Data":"0b9100355827ae4755342af2e330e15d1be3a8624f49949703cd7092021f96d9"} Jun 03 19:29:27.070390 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:27.070354 2577 generic.go:356] "Generic (PLEG): container finished" podID="7a9c3389-3d39-4730-ada9-50ef5e11268e" containerID="90db07b2fd6ea274892c8f330256c88d2d4f93e3b1b8c2b312cc0ab142c266e1" exitCode=0 Jun 03 19:29:27.070789 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:27.070433 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" event={"ID":"7a9c3389-3d39-4730-ada9-50ef5e11268e","Type":"ContainerDied","Data":"90db07b2fd6ea274892c8f330256c88d2d4f93e3b1b8c2b312cc0ab142c266e1"} Jun 03 19:29:28.075608 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:28.075521 2577 generic.go:356] "Generic (PLEG): container finished" podID="7a9c3389-3d39-4730-ada9-50ef5e11268e" containerID="b3babf89edb31ddc381f76c536c7477b22cbcaebd1293da6529e84a4b0ae3da2" exitCode=0 Jun 03 19:29:28.075608 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:28.075582 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" event={"ID":"7a9c3389-3d39-4730-ada9-50ef5e11268e","Type":"ContainerDied","Data":"b3babf89edb31ddc381f76c536c7477b22cbcaebd1293da6529e84a4b0ae3da2"} Jun 03 19:29:36.110589 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:36.110553 2577 generic.go:356] "Generic (PLEG): container finished" podID="7a9c3389-3d39-4730-ada9-50ef5e11268e" containerID="7945e6c33bcce2bf7e98ee3b9edf1a4e54ed60398737586c58782e913203154d" exitCode=0 Jun 03 19:29:36.110589 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:36.110592 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" event={"ID":"7a9c3389-3d39-4730-ada9-50ef5e11268e","Type":"ContainerDied","Data":"7945e6c33bcce2bf7e98ee3b9edf1a4e54ed60398737586c58782e913203154d"} Jun 03 19:29:37.237494 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:37.237463 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" Jun 03 19:29:37.395126 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:37.395095 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9c3389-3d39-4730-ada9-50ef5e11268e-bundle\") pod \"7a9c3389-3d39-4730-ada9-50ef5e11268e\" (UID: \"7a9c3389-3d39-4730-ada9-50ef5e11268e\") " Jun 03 19:29:37.395275 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:37.395141 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9c3389-3d39-4730-ada9-50ef5e11268e-util\") pod \"7a9c3389-3d39-4730-ada9-50ef5e11268e\" (UID: \"7a9c3389-3d39-4730-ada9-50ef5e11268e\") " Jun 03 19:29:37.395275 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:37.395196 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-266pj\" (UniqueName: \"kubernetes.io/projected/7a9c3389-3d39-4730-ada9-50ef5e11268e-kube-api-access-266pj\") pod \"7a9c3389-3d39-4730-ada9-50ef5e11268e\" (UID: \"7a9c3389-3d39-4730-ada9-50ef5e11268e\") " Jun 03 19:29:37.395765 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:37.395740 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a9c3389-3d39-4730-ada9-50ef5e11268e-bundle" (OuterVolumeSpecName: "bundle") pod "7a9c3389-3d39-4730-ada9-50ef5e11268e" (UID: "7a9c3389-3d39-4730-ada9-50ef5e11268e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:29:37.397356 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:37.397328 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a9c3389-3d39-4730-ada9-50ef5e11268e-kube-api-access-266pj" (OuterVolumeSpecName: "kube-api-access-266pj") pod "7a9c3389-3d39-4730-ada9-50ef5e11268e" (UID: "7a9c3389-3d39-4730-ada9-50ef5e11268e"). InnerVolumeSpecName "kube-api-access-266pj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:29:37.401206 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:37.401177 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a9c3389-3d39-4730-ada9-50ef5e11268e-util" (OuterVolumeSpecName: "util") pod "7a9c3389-3d39-4730-ada9-50ef5e11268e" (UID: "7a9c3389-3d39-4730-ada9-50ef5e11268e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:29:37.496399 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:37.496363 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-266pj\" (UniqueName: \"kubernetes.io/projected/7a9c3389-3d39-4730-ada9-50ef5e11268e-kube-api-access-266pj\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:29:37.496399 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:37.496393 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9c3389-3d39-4730-ada9-50ef5e11268e-bundle\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:29:37.496399 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:37.496402 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9c3389-3d39-4730-ada9-50ef5e11268e-util\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:29:38.119799 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:38.119774 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" Jun 03 19:29:38.119962 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:38.119772 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drmdpr" event={"ID":"7a9c3389-3d39-4730-ada9-50ef5e11268e","Type":"ContainerDied","Data":"0b9100355827ae4755342af2e330e15d1be3a8624f49949703cd7092021f96d9"} Jun 03 19:29:38.119962 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:38.119883 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b9100355827ae4755342af2e330e15d1be3a8624f49949703cd7092021f96d9" Jun 03 19:29:39.552228 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:39.552197 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:40.420136 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:40.420107 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:41.573734 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.573699 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zzvkl"] Jun 03 19:29:41.574128 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.574000 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9c3389-3d39-4730-ada9-50ef5e11268e" containerName="util" Jun 03 19:29:41.574128 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.574010 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9c3389-3d39-4730-ada9-50ef5e11268e" containerName="util" Jun 03 19:29:41.574128 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.574022 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9c3389-3d39-4730-ada9-50ef5e11268e" containerName="extract" Jun 03 19:29:41.574128 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.574027 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9c3389-3d39-4730-ada9-50ef5e11268e" containerName="extract" Jun 03 19:29:41.574128 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.574039 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9c3389-3d39-4730-ada9-50ef5e11268e" containerName="pull" Jun 03 19:29:41.574128 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.574045 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9c3389-3d39-4730-ada9-50ef5e11268e" containerName="pull" Jun 03 19:29:41.574128 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.574122 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a9c3389-3d39-4730-ada9-50ef5e11268e" containerName="extract" Jun 03 19:29:41.603334 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.603304 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zzvkl"] Jun 03 19:29:41.603483 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.603439 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zzvkl" Jun 03 19:29:41.607184 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.606939 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 19:29:41.607184 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.607140 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-p575q\"" Jun 03 19:29:41.612294 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.612267 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:29:41.733775 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.733737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e28cb4c4-e2f5-4224-85d6-d44dfc7cc290-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zzvkl\" (UID: \"e28cb4c4-e2f5-4224-85d6-d44dfc7cc290\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zzvkl" Jun 03 19:29:41.733954 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.733810 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvnfk\" (UniqueName: \"kubernetes.io/projected/e28cb4c4-e2f5-4224-85d6-d44dfc7cc290-kube-api-access-qvnfk\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zzvkl\" (UID: \"e28cb4c4-e2f5-4224-85d6-d44dfc7cc290\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zzvkl" Jun 03 19:29:41.834628 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.834552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e28cb4c4-e2f5-4224-85d6-d44dfc7cc290-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zzvkl\" (UID: \"e28cb4c4-e2f5-4224-85d6-d44dfc7cc290\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zzvkl" Jun 03 19:29:41.834628 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.834624 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvnfk\" (UniqueName: \"kubernetes.io/projected/e28cb4c4-e2f5-4224-85d6-d44dfc7cc290-kube-api-access-qvnfk\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zzvkl\" (UID: \"e28cb4c4-e2f5-4224-85d6-d44dfc7cc290\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zzvkl" Jun 03 19:29:41.834949 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.834927 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e28cb4c4-e2f5-4224-85d6-d44dfc7cc290-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zzvkl\" (UID: \"e28cb4c4-e2f5-4224-85d6-d44dfc7cc290\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zzvkl" Jun 03 19:29:41.846322 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.846294 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvnfk\" (UniqueName: \"kubernetes.io/projected/e28cb4c4-e2f5-4224-85d6-d44dfc7cc290-kube-api-access-qvnfk\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zzvkl\" (UID: \"e28cb4c4-e2f5-4224-85d6-d44dfc7cc290\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zzvkl" Jun 03 19:29:41.918826 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:41.918787 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zzvkl" Jun 03 19:29:42.081923 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:42.081897 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zzvkl"] Jun 03 19:29:42.083823 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:29:42.083798 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28cb4c4_e2f5_4224_85d6_d44dfc7cc290.slice/crio-7c678c6945796f0c11723ac67515f80966aa25a79100bec5df03cc65d05685d6 WatchSource:0}: Error finding container 7c678c6945796f0c11723ac67515f80966aa25a79100bec5df03cc65d05685d6: Status 404 returned error can't find the container with id 7c678c6945796f0c11723ac67515f80966aa25a79100bec5df03cc65d05685d6 Jun 03 19:29:42.136133 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:42.136095 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zzvkl" event={"ID":"e28cb4c4-e2f5-4224-85d6-d44dfc7cc290","Type":"ContainerStarted","Data":"7c678c6945796f0c11723ac67515f80966aa25a79100bec5df03cc65d05685d6"} Jun 03 19:29:43.152433 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:43.152335 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:43.222391 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:43.222358 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:44.146983 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:44.146950 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zzvkl" event={"ID":"e28cb4c4-e2f5-4224-85d6-d44dfc7cc290","Type":"ContainerStarted","Data":"86a50fe1c29f161e024eea86710398353585e25bf2de8478ac18bc9e1943a708"} Jun 03 19:29:44.173781 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:44.173735 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zzvkl" podStartSLOduration=1.229680555 podStartE2EDuration="3.173721763s" totalImagesPullingTime="1.944041208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:44.171356613 +0000 UTC m=+529.325156592" watchObservedRunningTime="2026-06-03 19:29:44.173721763 +0000 UTC m=+529.327521742" Jun 03 19:29:44.561118 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:44.561084 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:44.678261 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:44.678229 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:44.848892 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:44.848816 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:44.959661 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:44.959622 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:45.242403 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.242367 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f"] Jun 03 19:29:45.258597 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.258569 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f"] Jun 03 19:29:45.258782 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.258686 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" Jun 03 19:29:45.262248 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.262220 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:29:45.262394 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.262252 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bkt6w\"" Jun 03 19:29:45.263589 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.263566 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:29:45.362967 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.362930 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f\" (UID: \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" Jun 03 19:29:45.363195 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.362982 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f\" (UID: \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" Jun 03 19:29:45.363195 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.363043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvwwz\" (UniqueName: \"kubernetes.io/projected/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-kube-api-access-tvwwz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f\" (UID: \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" Jun 03 19:29:45.463815 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.463776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f\" (UID: \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" Jun 03 19:29:45.463996 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.463826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f\" (UID: \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" Jun 03 19:29:45.463996 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.463881 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwwz\" (UniqueName: \"kubernetes.io/projected/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-kube-api-access-tvwwz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f\" (UID: \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" Jun 03 19:29:45.464276 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.464243 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f\" (UID: \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" Jun 03 19:29:45.464320 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.464255 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f\" (UID: \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" Jun 03 19:29:45.477714 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.477692 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvwwz\" (UniqueName: \"kubernetes.io/projected/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-kube-api-access-tvwwz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f\" (UID: \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" Jun 03 19:29:45.568767 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.568669 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" Jun 03 19:29:45.702849 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:45.702825 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f"] Jun 03 19:29:45.704688 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:29:45.704664 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b3d3bed_26d5_4f39_ac7e_6b14ce433f89.slice/crio-98defcd6907a37c7d6167c702faed557162a6ac9b5781cf4053d133970563474 WatchSource:0}: Error finding container 98defcd6907a37c7d6167c702faed557162a6ac9b5781cf4053d133970563474: Status 404 returned error can't find the container with id 98defcd6907a37c7d6167c702faed557162a6ac9b5781cf4053d133970563474 Jun 03 19:29:46.156547 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:46.156514 2577 generic.go:356] "Generic (PLEG): container finished" podID="8b3d3bed-26d5-4f39-ac7e-6b14ce433f89" containerID="b8b8e419904ab552f3d196a1d66a0a15582b8b058510b20efbcc24fa6852fda8" exitCode=0 Jun 03 19:29:46.156749 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:46.156567 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" event={"ID":"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89","Type":"ContainerDied","Data":"b8b8e419904ab552f3d196a1d66a0a15582b8b058510b20efbcc24fa6852fda8"} Jun 03 19:29:46.156749 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:46.156652 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" event={"ID":"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89","Type":"ContainerStarted","Data":"98defcd6907a37c7d6167c702faed557162a6ac9b5781cf4053d133970563474"} Jun 03 19:29:48.259498 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.259459 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:48.452701 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.452677 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pzlcg"] Jun 03 19:29:48.454957 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.454942 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzlcg" Jun 03 19:29:48.458234 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.458217 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 19:29:48.459712 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.459694 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tc9pg\"" Jun 03 19:29:48.459782 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.459697 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 19:29:48.466566 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.466544 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pzlcg"] Jun 03 19:29:48.589245 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.589209 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq9b5\" (UniqueName: \"kubernetes.io/projected/8848ef7b-7f58-4512-bf14-a26410ecdbc5-kube-api-access-gq9b5\") pod \"cert-manager-cainjector-5d99449ffd-pzlcg\" (UID: \"8848ef7b-7f58-4512-bf14-a26410ecdbc5\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzlcg" Jun 03 19:29:48.589245 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.589261 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8848ef7b-7f58-4512-bf14-a26410ecdbc5-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pzlcg\" (UID: \"8848ef7b-7f58-4512-bf14-a26410ecdbc5\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzlcg" Jun 03 19:29:48.661082 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.661033 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:48.690040 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.690014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq9b5\" (UniqueName: \"kubernetes.io/projected/8848ef7b-7f58-4512-bf14-a26410ecdbc5-kube-api-access-gq9b5\") pod \"cert-manager-cainjector-5d99449ffd-pzlcg\" (UID: \"8848ef7b-7f58-4512-bf14-a26410ecdbc5\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzlcg" Jun 03 19:29:48.690183 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.690052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8848ef7b-7f58-4512-bf14-a26410ecdbc5-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pzlcg\" (UID: \"8848ef7b-7f58-4512-bf14-a26410ecdbc5\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzlcg" Jun 03 19:29:48.699842 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.699811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8848ef7b-7f58-4512-bf14-a26410ecdbc5-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pzlcg\" (UID: \"8848ef7b-7f58-4512-bf14-a26410ecdbc5\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzlcg" Jun 03 19:29:48.699941 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.699877 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq9b5\" (UniqueName: \"kubernetes.io/projected/8848ef7b-7f58-4512-bf14-a26410ecdbc5-kube-api-access-gq9b5\") pod \"cert-manager-cainjector-5d99449ffd-pzlcg\" (UID: \"8848ef7b-7f58-4512-bf14-a26410ecdbc5\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzlcg" Jun 03 19:29:48.767671 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.767639 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzlcg" Jun 03 19:29:48.892342 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:48.892201 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pzlcg"] Jun 03 19:29:48.894251 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:29:48.894226 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8848ef7b_7f58_4512_bf14_a26410ecdbc5.slice/crio-1f3d87a2f2bcd80f533f612f3fe3676cfda54ea22bc205fa3d7fae20faf5542e WatchSource:0}: Error finding container 1f3d87a2f2bcd80f533f612f3fe3676cfda54ea22bc205fa3d7fae20faf5542e: Status 404 returned error can't find the container with id 1f3d87a2f2bcd80f533f612f3fe3676cfda54ea22bc205fa3d7fae20faf5542e Jun 03 19:29:49.172349 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:49.172310 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzlcg" event={"ID":"8848ef7b-7f58-4512-bf14-a26410ecdbc5","Type":"ContainerStarted","Data":"1f3d87a2f2bcd80f533f612f3fe3676cfda54ea22bc205fa3d7fae20faf5542e"} Jun 03 19:29:49.173969 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:49.173941 2577 generic.go:356] "Generic (PLEG): container finished" podID="8b3d3bed-26d5-4f39-ac7e-6b14ce433f89" containerID="3780a00eddf03d143d238aa96273e60820e97b13820afc5935850c538fe320fa" exitCode=0 Jun 03 19:29:49.174119 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:49.174020 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" event={"ID":"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89","Type":"ContainerDied","Data":"3780a00eddf03d143d238aa96273e60820e97b13820afc5935850c538fe320fa"} Jun 03 19:29:49.948947 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:49.948911 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:50.007600 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:50.007563 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:50.181119 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:50.181083 2577 generic.go:356] "Generic (PLEG): container finished" podID="8b3d3bed-26d5-4f39-ac7e-6b14ce433f89" containerID="10be962eac861df4b7309c8378c5f04ff2a1b31e152502cfc675bbdcb91f77a5" exitCode=0 Jun 03 19:29:50.181295 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:50.181153 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" event={"ID":"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89","Type":"ContainerDied","Data":"10be962eac861df4b7309c8378c5f04ff2a1b31e152502cfc675bbdcb91f77a5"} Jun 03 19:29:51.324861 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:51.324839 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" Jun 03 19:29:51.412331 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:51.412290 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvwwz\" (UniqueName: \"kubernetes.io/projected/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-kube-api-access-tvwwz\") pod \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\" (UID: \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\") " Jun 03 19:29:51.412499 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:51.412354 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-util\") pod \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\" (UID: \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\") " Jun 03 19:29:51.412499 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:51.412403 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-bundle\") pod \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\" (UID: \"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89\") " Jun 03 19:29:51.412792 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:51.412768 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-bundle" (OuterVolumeSpecName: "bundle") pod "8b3d3bed-26d5-4f39-ac7e-6b14ce433f89" (UID: "8b3d3bed-26d5-4f39-ac7e-6b14ce433f89"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:29:51.414491 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:51.414466 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-kube-api-access-tvwwz" (OuterVolumeSpecName: "kube-api-access-tvwwz") pod "8b3d3bed-26d5-4f39-ac7e-6b14ce433f89" (UID: "8b3d3bed-26d5-4f39-ac7e-6b14ce433f89"). InnerVolumeSpecName "kube-api-access-tvwwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:29:51.417110 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:51.417084 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-util" (OuterVolumeSpecName: "util") pod "8b3d3bed-26d5-4f39-ac7e-6b14ce433f89" (UID: "8b3d3bed-26d5-4f39-ac7e-6b14ce433f89"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:29:51.513096 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:51.512993 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-bundle\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:29:51.513096 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:51.513018 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvwwz\" (UniqueName: \"kubernetes.io/projected/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-kube-api-access-tvwwz\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:29:51.513096 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:51.513032 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3d3bed-26d5-4f39-ac7e-6b14ce433f89-util\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:29:52.192466 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:52.192425 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzlcg" event={"ID":"8848ef7b-7f58-4512-bf14-a26410ecdbc5","Type":"ContainerStarted","Data":"0de7f7c6b43d441e4d17faa0d5cf23739e4671f41a9653b638d15935eb225ab6"} Jun 03 19:29:52.194290 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:52.194262 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" event={"ID":"8b3d3bed-26d5-4f39-ac7e-6b14ce433f89","Type":"ContainerDied","Data":"98defcd6907a37c7d6167c702faed557162a6ac9b5781cf4053d133970563474"} Jun 03 19:29:52.194290 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:52.194287 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2r5f" Jun 03 19:29:52.194483 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:52.194310 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98defcd6907a37c7d6167c702faed557162a6ac9b5781cf4053d133970563474" Jun 03 19:29:52.219410 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:52.219346 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzlcg" podStartSLOduration=1.893000005 podStartE2EDuration="4.219331785s" totalImagesPullingTime="2.32633178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:52.216285702 +0000 UTC m=+537.370085683" watchObservedRunningTime="2026-06-03 19:29:52.219331785 +0000 UTC m=+537.373131765" Jun 03 19:29:54.789959 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:54.789926 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:55.471474 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:55.471446 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:55.953215 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:55.953178 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:56.053262 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:56.053225 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:57.818609 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.818571 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-cgjsd"] Jun 03 19:29:57.819030 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.818890 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b3d3bed-26d5-4f39-ac7e-6b14ce433f89" containerName="util" Jun 03 19:29:57.819030 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.818905 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b3d3bed-26d5-4f39-ac7e-6b14ce433f89" containerName="util" Jun 03 19:29:57.819030 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.818918 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b3d3bed-26d5-4f39-ac7e-6b14ce433f89" containerName="pull" Jun 03 19:29:57.819030 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.818930 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b3d3bed-26d5-4f39-ac7e-6b14ce433f89" containerName="pull" Jun 03 19:29:57.819030 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.818942 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b3d3bed-26d5-4f39-ac7e-6b14ce433f89" containerName="extract" Jun 03 19:29:57.819030 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.818947 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b3d3bed-26d5-4f39-ac7e-6b14ce433f89" containerName="extract" Jun 03 19:29:57.819030 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.819003 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b3d3bed-26d5-4f39-ac7e-6b14ce433f89" containerName="extract" Jun 03 19:29:57.820839 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.820824 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-cgjsd" Jun 03 19:29:57.824083 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.824050 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-88z4d\"" Jun 03 19:29:57.834301 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.834277 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-cgjsd"] Jun 03 19:29:57.864782 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.864756 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7dcd2a6-cadd-4ba0-9439-c2ae82cb4721-bound-sa-token\") pod \"cert-manager-59c77684cc-cgjsd\" (UID: \"d7dcd2a6-cadd-4ba0-9439-c2ae82cb4721\") " pod="cert-manager/cert-manager-59c77684cc-cgjsd" Jun 03 19:29:57.864903 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.864810 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7gvf\" (UniqueName: \"kubernetes.io/projected/d7dcd2a6-cadd-4ba0-9439-c2ae82cb4721-kube-api-access-j7gvf\") pod \"cert-manager-59c77684cc-cgjsd\" (UID: \"d7dcd2a6-cadd-4ba0-9439-c2ae82cb4721\") " pod="cert-manager/cert-manager-59c77684cc-cgjsd" Jun 03 19:29:57.965223 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.965190 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7dcd2a6-cadd-4ba0-9439-c2ae82cb4721-bound-sa-token\") pod \"cert-manager-59c77684cc-cgjsd\" (UID: \"d7dcd2a6-cadd-4ba0-9439-c2ae82cb4721\") " pod="cert-manager/cert-manager-59c77684cc-cgjsd" Jun 03 19:29:57.965409 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.965252 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7gvf\" (UniqueName: \"kubernetes.io/projected/d7dcd2a6-cadd-4ba0-9439-c2ae82cb4721-kube-api-access-j7gvf\") pod \"cert-manager-59c77684cc-cgjsd\" (UID: \"d7dcd2a6-cadd-4ba0-9439-c2ae82cb4721\") " pod="cert-manager/cert-manager-59c77684cc-cgjsd" Jun 03 19:29:57.975848 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.975816 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7dcd2a6-cadd-4ba0-9439-c2ae82cb4721-bound-sa-token\") pod \"cert-manager-59c77684cc-cgjsd\" (UID: \"d7dcd2a6-cadd-4ba0-9439-c2ae82cb4721\") " pod="cert-manager/cert-manager-59c77684cc-cgjsd" Jun 03 19:29:57.975963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:57.975878 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7gvf\" (UniqueName: \"kubernetes.io/projected/d7dcd2a6-cadd-4ba0-9439-c2ae82cb4721-kube-api-access-j7gvf\") pod \"cert-manager-59c77684cc-cgjsd\" (UID: \"d7dcd2a6-cadd-4ba0-9439-c2ae82cb4721\") " pod="cert-manager/cert-manager-59c77684cc-cgjsd" Jun 03 19:29:58.129887 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:58.129797 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-cgjsd" Jun 03 19:29:58.258950 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:58.258919 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-cgjsd"] Jun 03 19:29:58.260936 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:29:58.260911 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7dcd2a6_cadd_4ba0_9439_c2ae82cb4721.slice/crio-81e34f88c904a7a8323f8794eae1d10bc258be4e0526d0992396ab05a37e11f8 WatchSource:0}: Error finding container 81e34f88c904a7a8323f8794eae1d10bc258be4e0526d0992396ab05a37e11f8: Status 404 returned error can't find the container with id 81e34f88c904a7a8323f8794eae1d10bc258be4e0526d0992396ab05a37e11f8 Jun 03 19:29:59.227528 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:59.227495 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-cgjsd" event={"ID":"d7dcd2a6-cadd-4ba0-9439-c2ae82cb4721","Type":"ContainerStarted","Data":"bfef6ea8f62ced7c8b5281221b6a13692b94f0662768766509cdd699cd736e73"} Jun 03 19:29:59.227895 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:59.227540 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-cgjsd" event={"ID":"d7dcd2a6-cadd-4ba0-9439-c2ae82cb4721","Type":"ContainerStarted","Data":"81e34f88c904a7a8323f8794eae1d10bc258be4e0526d0992396ab05a37e11f8"} Jun 03 19:29:59.244617 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:29:59.244558 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-cgjsd" podStartSLOduration=2.2445366780000002 podStartE2EDuration="2.244536678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:29:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:59.244335974 +0000 UTC m=+544.398135954" watchObservedRunningTime="2026-06-03 19:29:59.244536678 +0000 UTC m=+544.398336659" Jun 03 19:30:02.460829 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:02.460781 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:02.557514 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:02.557482 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:04.433101 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:04.433047 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:06.052868 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.052827 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8"] Jun 03 19:30:06.056693 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.056669 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" Jun 03 19:30:06.060253 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.060232 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:30:06.061722 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.061697 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bkt6w\"" Jun 03 19:30:06.061819 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.061697 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:30:06.067035 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.067013 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8"] Jun 03 19:30:06.134643 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.134612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2c87432-21ac-41b5-9ad5-e815db019e44-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8\" (UID: \"b2c87432-21ac-41b5-9ad5-e815db019e44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" Jun 03 19:30:06.134770 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.134710 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh66c\" (UniqueName: \"kubernetes.io/projected/b2c87432-21ac-41b5-9ad5-e815db019e44-kube-api-access-bh66c\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8\" (UID: \"b2c87432-21ac-41b5-9ad5-e815db019e44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" Jun 03 19:30:06.134770 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.134755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2c87432-21ac-41b5-9ad5-e815db019e44-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8\" (UID: \"b2c87432-21ac-41b5-9ad5-e815db019e44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" Jun 03 19:30:06.235896 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.235858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2c87432-21ac-41b5-9ad5-e815db019e44-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8\" (UID: \"b2c87432-21ac-41b5-9ad5-e815db019e44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" Jun 03 19:30:06.235896 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.235903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2c87432-21ac-41b5-9ad5-e815db019e44-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8\" (UID: \"b2c87432-21ac-41b5-9ad5-e815db019e44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" Jun 03 19:30:06.236147 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.235967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh66c\" (UniqueName: \"kubernetes.io/projected/b2c87432-21ac-41b5-9ad5-e815db019e44-kube-api-access-bh66c\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8\" (UID: \"b2c87432-21ac-41b5-9ad5-e815db019e44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" Jun 03 19:30:06.236311 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.236291 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2c87432-21ac-41b5-9ad5-e815db019e44-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8\" (UID: \"b2c87432-21ac-41b5-9ad5-e815db019e44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" Jun 03 19:30:06.236378 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.236360 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2c87432-21ac-41b5-9ad5-e815db019e44-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8\" (UID: \"b2c87432-21ac-41b5-9ad5-e815db019e44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" Jun 03 19:30:06.245383 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.245363 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh66c\" (UniqueName: \"kubernetes.io/projected/b2c87432-21ac-41b5-9ad5-e815db019e44-kube-api-access-bh66c\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8\" (UID: \"b2c87432-21ac-41b5-9ad5-e815db019e44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" Jun 03 19:30:06.365768 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.365691 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" Jun 03 19:30:06.500032 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:06.500007 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8"] Jun 03 19:30:06.501934 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:30:06.501906 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c87432_21ac_41b5_9ad5_e815db019e44.slice/crio-865fcff438ae1bb125c11de6f567aa75c8bd51e5d33d68d7654b321483a513d7 WatchSource:0}: Error finding container 865fcff438ae1bb125c11de6f567aa75c8bd51e5d33d68d7654b321483a513d7: Status 404 returned error can't find the container with id 865fcff438ae1bb125c11de6f567aa75c8bd51e5d33d68d7654b321483a513d7 Jun 03 19:30:07.263913 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:07.263884 2577 generic.go:356] "Generic (PLEG): container finished" podID="b2c87432-21ac-41b5-9ad5-e815db019e44" containerID="af696a29e36421f675c451146e0dca512c115c7c812bd139bb7a470d61991f61" exitCode=0 Jun 03 19:30:07.264350 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:07.263945 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" event={"ID":"b2c87432-21ac-41b5-9ad5-e815db019e44","Type":"ContainerDied","Data":"af696a29e36421f675c451146e0dca512c115c7c812bd139bb7a470d61991f61"} Jun 03 19:30:07.264350 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:07.263978 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" event={"ID":"b2c87432-21ac-41b5-9ad5-e815db019e44","Type":"ContainerStarted","Data":"865fcff438ae1bb125c11de6f567aa75c8bd51e5d33d68d7654b321483a513d7"} Jun 03 19:30:08.269720 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:08.269636 2577 generic.go:356] "Generic (PLEG): container finished" podID="b2c87432-21ac-41b5-9ad5-e815db019e44" containerID="b3d5aa89597810fe512890350fa2a5301ea7830e354c514110b4930fe0e5c54f" exitCode=0 Jun 03 19:30:08.269720 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:08.269706 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" event={"ID":"b2c87432-21ac-41b5-9ad5-e815db019e44","Type":"ContainerDied","Data":"b3d5aa89597810fe512890350fa2a5301ea7830e354c514110b4930fe0e5c54f"} Jun 03 19:30:09.277552 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:09.277520 2577 generic.go:356] "Generic (PLEG): container finished" podID="b2c87432-21ac-41b5-9ad5-e815db019e44" containerID="1a28e425e265355c395e226707d20b9af384de4b5c715792913e44cd10a75b19" exitCode=0 Jun 03 19:30:09.277937 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:09.277777 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" event={"ID":"b2c87432-21ac-41b5-9ad5-e815db019e44","Type":"ContainerDied","Data":"1a28e425e265355c395e226707d20b9af384de4b5c715792913e44cd10a75b19"} Jun 03 19:30:10.407014 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:10.406991 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" Jun 03 19:30:10.474172 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:10.474145 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh66c\" (UniqueName: \"kubernetes.io/projected/b2c87432-21ac-41b5-9ad5-e815db019e44-kube-api-access-bh66c\") pod \"b2c87432-21ac-41b5-9ad5-e815db019e44\" (UID: \"b2c87432-21ac-41b5-9ad5-e815db019e44\") " Jun 03 19:30:10.474327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:10.474210 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2c87432-21ac-41b5-9ad5-e815db019e44-util\") pod \"b2c87432-21ac-41b5-9ad5-e815db019e44\" (UID: \"b2c87432-21ac-41b5-9ad5-e815db019e44\") " Jun 03 19:30:10.474327 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:10.474249 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2c87432-21ac-41b5-9ad5-e815db019e44-bundle\") pod \"b2c87432-21ac-41b5-9ad5-e815db019e44\" (UID: \"b2c87432-21ac-41b5-9ad5-e815db019e44\") " Jun 03 19:30:10.474957 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:10.474914 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c87432-21ac-41b5-9ad5-e815db019e44-bundle" (OuterVolumeSpecName: "bundle") pod "b2c87432-21ac-41b5-9ad5-e815db019e44" (UID: "b2c87432-21ac-41b5-9ad5-e815db019e44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:30:10.476149 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:10.476121 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2c87432-21ac-41b5-9ad5-e815db019e44-kube-api-access-bh66c" (OuterVolumeSpecName: "kube-api-access-bh66c") pod "b2c87432-21ac-41b5-9ad5-e815db019e44" (UID: "b2c87432-21ac-41b5-9ad5-e815db019e44"). InnerVolumeSpecName "kube-api-access-bh66c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:30:10.482213 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:10.482185 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c87432-21ac-41b5-9ad5-e815db019e44-util" (OuterVolumeSpecName: "util") pod "b2c87432-21ac-41b5-9ad5-e815db019e44" (UID: "b2c87432-21ac-41b5-9ad5-e815db019e44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:30:10.575150 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:10.575085 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2c87432-21ac-41b5-9ad5-e815db019e44-util\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:30:10.575150 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:10.575108 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2c87432-21ac-41b5-9ad5-e815db019e44-bundle\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:30:10.575150 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:10.575117 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh66c\" (UniqueName: \"kubernetes.io/projected/b2c87432-21ac-41b5-9ad5-e815db019e44-kube-api-access-bh66c\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:30:11.287302 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:11.287269 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" event={"ID":"b2c87432-21ac-41b5-9ad5-e815db019e44","Type":"ContainerDied","Data":"865fcff438ae1bb125c11de6f567aa75c8bd51e5d33d68d7654b321483a513d7"} Jun 03 19:30:11.287412 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:11.287311 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsfpg8" Jun 03 19:30:11.287412 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:11.287321 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="865fcff438ae1bb125c11de6f567aa75c8bd51e5d33d68d7654b321483a513d7" Jun 03 19:30:16.377720 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:16.377689 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:16.502493 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:16.502455 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:16.780582 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:16.780545 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:16.949224 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:16.949189 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:17.457518 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.457485 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:17.773397 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.773299 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:17.876532 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.876480 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:17.951425 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.951392 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb"] Jun 03 19:30:17.951700 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.951689 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2c87432-21ac-41b5-9ad5-e815db019e44" containerName="pull" Jun 03 19:30:17.951740 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.951702 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2c87432-21ac-41b5-9ad5-e815db019e44" containerName="pull" Jun 03 19:30:17.951740 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.951713 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2c87432-21ac-41b5-9ad5-e815db019e44" containerName="util" Jun 03 19:30:17.951740 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.951718 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2c87432-21ac-41b5-9ad5-e815db019e44" containerName="util" Jun 03 19:30:17.951740 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.951733 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2c87432-21ac-41b5-9ad5-e815db019e44" containerName="extract" Jun 03 19:30:17.951740 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.951739 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2c87432-21ac-41b5-9ad5-e815db019e44" containerName="extract" Jun 03 19:30:17.951887 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.951788 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2c87432-21ac-41b5-9ad5-e815db019e44" containerName="extract" Jun 03 19:30:17.955679 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.955660 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:17.963605 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.963589 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 19:30:17.963889 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.963867 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 19:30:17.964005 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.963990 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-srlj4\"" Jun 03 19:30:17.965406 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.965386 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 19:30:17.965494 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:17.965424 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 19:30:18.010566 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.010533 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb"] Jun 03 19:30:18.042547 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.042475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-manifests\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.042547 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.042538 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-tmp\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.042697 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.042564 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.042697 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.042583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.042697 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.042658 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x7m6\" (UniqueName: \"kubernetes.io/projected/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-kube-api-access-7x7m6\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.143818 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.143791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x7m6\" (UniqueName: \"kubernetes.io/projected/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-kube-api-access-7x7m6\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.143963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.143825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-manifests\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.143963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.143950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-tmp\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.144090 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.143980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.144090 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.144000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.144208 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.144195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-manifests\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.146111 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.146092 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-tmp\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.146342 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.146327 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.146382 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.146370 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.162259 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.162239 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x7m6\" (UniqueName: \"kubernetes.io/projected/445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc-kube-api-access-7x7m6\") pod \"opendatahub-operator-controller-manager-7d56d45df5-swwvb\" (UID: \"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.230843 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.230805 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:18.265736 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.265708 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:18.336289 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.336259 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:18.410822 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.410785 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb"] Jun 03 19:30:18.414078 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:30:18.414044 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445ee3a7_d22d_4eb3_a7e0_45dc53f7a7dc.slice/crio-5854f9a1c166e6f3ebf10e4ab1ecd886b783092e5677a186654223bb8006e930 WatchSource:0}: Error finding container 5854f9a1c166e6f3ebf10e4ab1ecd886b783092e5677a186654223bb8006e930: Status 404 returned error can't find the container with id 5854f9a1c166e6f3ebf10e4ab1ecd886b783092e5677a186654223bb8006e930 Jun 03 19:30:18.439864 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.439840 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:18.514363 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.514331 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:18.612618 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.612540 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:18.712813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:18.712781 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:19.327390 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:19.327344 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" event={"ID":"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc","Type":"ContainerStarted","Data":"5854f9a1c166e6f3ebf10e4ab1ecd886b783092e5677a186654223bb8006e930"} Jun 03 19:30:22.346886 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:22.346854 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" event={"ID":"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc","Type":"ContainerStarted","Data":"33d0d7e1e9c7f5444b0bca5d929cfe1ee527ba3b8df88532b8c9785c1850c28d"} Jun 03 19:30:23.353034 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:23.352996 2577 generic.go:356] "Generic (PLEG): container finished" podID="445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc" containerID="33d0d7e1e9c7f5444b0bca5d929cfe1ee527ba3b8df88532b8c9785c1850c28d" exitCode=0 Jun 03 19:30:23.353499 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:23.353037 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" event={"ID":"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc","Type":"ContainerDied","Data":"33d0d7e1e9c7f5444b0bca5d929cfe1ee527ba3b8df88532b8c9785c1850c28d"} Jun 03 19:30:24.360014 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:24.359920 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" event={"ID":"445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc","Type":"ContainerStarted","Data":"60d400d30a3014f7f9f7e760d9206d1b81f55874f503cc15cd9b007a370b5d8c"} Jun 03 19:30:24.360470 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:24.360034 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:24.385144 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:24.385096 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" podStartSLOduration=2.929031225 podStartE2EDuration="7.385079998s" totalImagesPullingTime="3.545200424s" totalInitContainerRuntime="910.848349ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:24.38316371 +0000 UTC m=+569.536963685" watchObservedRunningTime="2026-06-03 19:30:24.385079998 +0000 UTC m=+569.538879969" Jun 03 19:30:28.390013 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:28.389981 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:28.490437 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:28.490391 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:35.365903 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.365877 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-swwvb" Jun 03 19:30:35.764241 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.764209 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:35.859505 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.859475 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:35.864968 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.864944 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk"] Jun 03 19:30:35.872488 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.872466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:35.877179 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.877159 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 19:30:35.877277 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.877258 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nhdrj\"" Jun 03 19:30:35.877469 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.877457 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:30:35.877622 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.877606 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 19:30:35.877912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.877895 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 19:30:35.878005 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.877918 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 19:30:35.889515 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.889494 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk"] Jun 03 19:30:35.904158 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.904138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f02d01d3-a7ac-4cda-95ad-c8c82a335ef3-manager-config\") pod \"lws-controller-manager-7fcc859b85-5jcgk\" (UID: \"f02d01d3-a7ac-4cda-95ad-c8c82a335ef3\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:35.904244 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.904173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f02d01d3-a7ac-4cda-95ad-c8c82a335ef3-metrics-cert\") pod \"lws-controller-manager-7fcc859b85-5jcgk\" (UID: \"f02d01d3-a7ac-4cda-95ad-c8c82a335ef3\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:35.904244 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.904204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sccnl\" (UniqueName: \"kubernetes.io/projected/f02d01d3-a7ac-4cda-95ad-c8c82a335ef3-kube-api-access-sccnl\") pod \"lws-controller-manager-7fcc859b85-5jcgk\" (UID: \"f02d01d3-a7ac-4cda-95ad-c8c82a335ef3\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:35.904312 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:35.904277 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f02d01d3-a7ac-4cda-95ad-c8c82a335ef3-cert\") pod \"lws-controller-manager-7fcc859b85-5jcgk\" (UID: \"f02d01d3-a7ac-4cda-95ad-c8c82a335ef3\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:36.005399 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:36.005366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f02d01d3-a7ac-4cda-95ad-c8c82a335ef3-cert\") pod \"lws-controller-manager-7fcc859b85-5jcgk\" (UID: \"f02d01d3-a7ac-4cda-95ad-c8c82a335ef3\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:36.005558 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:36.005407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f02d01d3-a7ac-4cda-95ad-c8c82a335ef3-manager-config\") pod \"lws-controller-manager-7fcc859b85-5jcgk\" (UID: \"f02d01d3-a7ac-4cda-95ad-c8c82a335ef3\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:36.005558 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:36.005446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f02d01d3-a7ac-4cda-95ad-c8c82a335ef3-metrics-cert\") pod \"lws-controller-manager-7fcc859b85-5jcgk\" (UID: \"f02d01d3-a7ac-4cda-95ad-c8c82a335ef3\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:36.005558 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:36.005474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sccnl\" (UniqueName: \"kubernetes.io/projected/f02d01d3-a7ac-4cda-95ad-c8c82a335ef3-kube-api-access-sccnl\") pod \"lws-controller-manager-7fcc859b85-5jcgk\" (UID: \"f02d01d3-a7ac-4cda-95ad-c8c82a335ef3\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:36.006232 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:36.006210 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f02d01d3-a7ac-4cda-95ad-c8c82a335ef3-manager-config\") pod \"lws-controller-manager-7fcc859b85-5jcgk\" (UID: \"f02d01d3-a7ac-4cda-95ad-c8c82a335ef3\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:36.007918 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:36.007897 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f02d01d3-a7ac-4cda-95ad-c8c82a335ef3-cert\") pod \"lws-controller-manager-7fcc859b85-5jcgk\" (UID: \"f02d01d3-a7ac-4cda-95ad-c8c82a335ef3\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:36.008029 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:36.008010 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f02d01d3-a7ac-4cda-95ad-c8c82a335ef3-metrics-cert\") pod \"lws-controller-manager-7fcc859b85-5jcgk\" (UID: \"f02d01d3-a7ac-4cda-95ad-c8c82a335ef3\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:36.017284 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:36.017231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sccnl\" (UniqueName: \"kubernetes.io/projected/f02d01d3-a7ac-4cda-95ad-c8c82a335ef3-kube-api-access-sccnl\") pod \"lws-controller-manager-7fcc859b85-5jcgk\" (UID: \"f02d01d3-a7ac-4cda-95ad-c8c82a335ef3\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:36.182006 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:36.181970 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:36.323085 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:36.323035 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk"] Jun 03 19:30:36.324632 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:30:36.324606 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02d01d3_a7ac_4cda_95ad_c8c82a335ef3.slice/crio-3c85315390bb48ede50fcbe70c582e1aee96c35703fa2b8e20d207ebcd00df7f WatchSource:0}: Error finding container 3c85315390bb48ede50fcbe70c582e1aee96c35703fa2b8e20d207ebcd00df7f: Status 404 returned error can't find the container with id 3c85315390bb48ede50fcbe70c582e1aee96c35703fa2b8e20d207ebcd00df7f Jun 03 19:30:36.418504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:36.418473 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" event={"ID":"f02d01d3-a7ac-4cda-95ad-c8c82a335ef3","Type":"ContainerStarted","Data":"3c85315390bb48ede50fcbe70c582e1aee96c35703fa2b8e20d207ebcd00df7f"} Jun 03 19:30:37.039208 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:37.039176 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:37.176713 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:37.176683 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:37.782948 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:37.782905 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:37.876759 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:37.876697 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:38.262532 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:38.262495 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:38.409220 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:38.409181 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:38.509250 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:38.509217 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:39.432434 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:39.432393 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" event={"ID":"f02d01d3-a7ac-4cda-95ad-c8c82a335ef3","Type":"ContainerStarted","Data":"a38007ecc827ae950c8c7397243cea8f0ac6b17edcfc971daab3abccc992030f"} Jun 03 19:30:39.432817 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:39.432459 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:39.456848 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:39.456792 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" podStartSLOduration=2.426952247 podStartE2EDuration="4.456777106s" totalImagesPullingTime="2.029824859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:39.455801318 +0000 UTC m=+584.609601297" watchObservedRunningTime="2026-06-03 19:30:39.456777106 +0000 UTC m=+584.610577086" Jun 03 19:30:42.972663 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:42.972625 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:43.069668 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:43.069632 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:43.169496 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:43.169462 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:43.275857 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:43.275770 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:44.823866 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.823834 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk"] Jun 03 19:30:44.827222 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.827200 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" Jun 03 19:30:44.830994 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.830971 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bkt6w\"" Jun 03 19:30:44.832083 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.832054 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:30:44.832619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.832598 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:30:44.837783 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.837762 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk"] Jun 03 19:30:44.883344 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.883316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6387113f-8cf7-463c-9ff0-d315c3512cde-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk\" (UID: \"6387113f-8cf7-463c-9ff0-d315c3512cde\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" Jun 03 19:30:44.883522 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.883384 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlqnd\" (UniqueName: \"kubernetes.io/projected/6387113f-8cf7-463c-9ff0-d315c3512cde-kube-api-access-vlqnd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk\" (UID: \"6387113f-8cf7-463c-9ff0-d315c3512cde\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" Jun 03 19:30:44.883522 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.883406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6387113f-8cf7-463c-9ff0-d315c3512cde-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk\" (UID: \"6387113f-8cf7-463c-9ff0-d315c3512cde\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" Jun 03 19:30:44.984653 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.984611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlqnd\" (UniqueName: \"kubernetes.io/projected/6387113f-8cf7-463c-9ff0-d315c3512cde-kube-api-access-vlqnd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk\" (UID: \"6387113f-8cf7-463c-9ff0-d315c3512cde\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" Jun 03 19:30:44.984653 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.984657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6387113f-8cf7-463c-9ff0-d315c3512cde-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk\" (UID: \"6387113f-8cf7-463c-9ff0-d315c3512cde\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" Jun 03 19:30:44.984909 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.984705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6387113f-8cf7-463c-9ff0-d315c3512cde-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk\" (UID: \"6387113f-8cf7-463c-9ff0-d315c3512cde\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" Jun 03 19:30:44.985092 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.985047 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6387113f-8cf7-463c-9ff0-d315c3512cde-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk\" (UID: \"6387113f-8cf7-463c-9ff0-d315c3512cde\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" Jun 03 19:30:44.985171 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.985119 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6387113f-8cf7-463c-9ff0-d315c3512cde-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk\" (UID: \"6387113f-8cf7-463c-9ff0-d315c3512cde\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" Jun 03 19:30:44.994874 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:44.994854 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlqnd\" (UniqueName: \"kubernetes.io/projected/6387113f-8cf7-463c-9ff0-d315c3512cde-kube-api-access-vlqnd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk\" (UID: \"6387113f-8cf7-463c-9ff0-d315c3512cde\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" Jun 03 19:30:45.136495 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:45.136464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" Jun 03 19:30:45.267002 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:45.266977 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk"] Jun 03 19:30:45.268950 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:30:45.268919 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6387113f_8cf7_463c_9ff0_d315c3512cde.slice/crio-0dd2803fd3a876731d54830f86f539093abed7a7281590886ec2120a9f35f4ea WatchSource:0}: Error finding container 0dd2803fd3a876731d54830f86f539093abed7a7281590886ec2120a9f35f4ea: Status 404 returned error can't find the container with id 0dd2803fd3a876731d54830f86f539093abed7a7281590886ec2120a9f35f4ea Jun 03 19:30:45.461862 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:45.461774 2577 generic.go:356] "Generic (PLEG): container finished" podID="6387113f-8cf7-463c-9ff0-d315c3512cde" containerID="face412c83277b458ba9630ddfd29c5402d954535f688e800dc57e9aa7db71a4" exitCode=0 Jun 03 19:30:45.461862 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:45.461845 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" event={"ID":"6387113f-8cf7-463c-9ff0-d315c3512cde","Type":"ContainerDied","Data":"face412c83277b458ba9630ddfd29c5402d954535f688e800dc57e9aa7db71a4"} Jun 03 19:30:45.462025 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:45.461930 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" event={"ID":"6387113f-8cf7-463c-9ff0-d315c3512cde","Type":"ContainerStarted","Data":"0dd2803fd3a876731d54830f86f539093abed7a7281590886ec2120a9f35f4ea"} Jun 03 19:30:47.473207 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:47.473169 2577 generic.go:356] "Generic (PLEG): container finished" podID="6387113f-8cf7-463c-9ff0-d315c3512cde" containerID="6f9a6c9bbf9ca1af0feb551b4352f75a5aa03ae55809782fc85604594561e585" exitCode=0 Jun 03 19:30:47.473608 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:47.473246 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" event={"ID":"6387113f-8cf7-463c-9ff0-d315c3512cde","Type":"ContainerDied","Data":"6f9a6c9bbf9ca1af0feb551b4352f75a5aa03ae55809782fc85604594561e585"} Jun 03 19:30:48.480425 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:48.480391 2577 generic.go:356] "Generic (PLEG): container finished" podID="6387113f-8cf7-463c-9ff0-d315c3512cde" containerID="ffe4420645caf5adea495e3f1f4019dbf073323a303ecd41ead6956f2e852344" exitCode=0 Jun 03 19:30:48.480836 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:48.480479 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" event={"ID":"6387113f-8cf7-463c-9ff0-d315c3512cde","Type":"ContainerDied","Data":"ffe4420645caf5adea495e3f1f4019dbf073323a303ecd41ead6956f2e852344"} Jun 03 19:30:49.091870 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:49.091837 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:49.202110 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:49.202056 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:49.364225 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:49.364141 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:49.519599 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:49.519556 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:49.615270 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:49.615213 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" Jun 03 19:30:49.730621 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:49.730589 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6387113f-8cf7-463c-9ff0-d315c3512cde-util\") pod \"6387113f-8cf7-463c-9ff0-d315c3512cde\" (UID: \"6387113f-8cf7-463c-9ff0-d315c3512cde\") " Jun 03 19:30:49.730776 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:49.730669 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlqnd\" (UniqueName: \"kubernetes.io/projected/6387113f-8cf7-463c-9ff0-d315c3512cde-kube-api-access-vlqnd\") pod \"6387113f-8cf7-463c-9ff0-d315c3512cde\" (UID: \"6387113f-8cf7-463c-9ff0-d315c3512cde\") " Jun 03 19:30:49.730776 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:49.730712 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6387113f-8cf7-463c-9ff0-d315c3512cde-bundle\") pod \"6387113f-8cf7-463c-9ff0-d315c3512cde\" (UID: \"6387113f-8cf7-463c-9ff0-d315c3512cde\") " Jun 03 19:30:49.731787 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:49.731756 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6387113f-8cf7-463c-9ff0-d315c3512cde-bundle" (OuterVolumeSpecName: "bundle") pod "6387113f-8cf7-463c-9ff0-d315c3512cde" (UID: "6387113f-8cf7-463c-9ff0-d315c3512cde"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:30:49.732742 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:49.732710 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6387113f-8cf7-463c-9ff0-d315c3512cde-kube-api-access-vlqnd" (OuterVolumeSpecName: "kube-api-access-vlqnd") pod "6387113f-8cf7-463c-9ff0-d315c3512cde" (UID: "6387113f-8cf7-463c-9ff0-d315c3512cde"). InnerVolumeSpecName "kube-api-access-vlqnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:30:49.736339 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:49.736318 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6387113f-8cf7-463c-9ff0-d315c3512cde-util" (OuterVolumeSpecName: "util") pod "6387113f-8cf7-463c-9ff0-d315c3512cde" (UID: "6387113f-8cf7-463c-9ff0-d315c3512cde"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:30:49.831723 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:49.831684 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlqnd\" (UniqueName: \"kubernetes.io/projected/6387113f-8cf7-463c-9ff0-d315c3512cde-kube-api-access-vlqnd\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:30:49.831723 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:49.831714 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6387113f-8cf7-463c-9ff0-d315c3512cde-bundle\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:30:49.831723 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:49.831724 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6387113f-8cf7-463c-9ff0-d315c3512cde-util\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:30:50.387758 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:50.387719 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:50.439767 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:50.439740 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-5jcgk" Jun 03 19:30:50.474768 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:50.474724 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:50.493217 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:50.493183 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" event={"ID":"6387113f-8cf7-463c-9ff0-d315c3512cde","Type":"ContainerDied","Data":"0dd2803fd3a876731d54830f86f539093abed7a7281590886ec2120a9f35f4ea"} Jun 03 19:30:50.493371 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:50.493240 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0dd2803fd3a876731d54830f86f539093abed7a7281590886ec2120a9f35f4ea" Jun 03 19:30:50.493371 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:50.493201 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sh7hk" Jun 03 19:30:50.553629 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:50.553599 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:55.258906 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:55.258871 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:30:55.259431 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:55.259418 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:30:57.775358 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:57.775321 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:58.976270 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:58.976237 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:59.165229 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.165177 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:59.862272 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.862239 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x"] Jun 03 19:30:59.862569 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.862558 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6387113f-8cf7-463c-9ff0-d315c3512cde" containerName="extract" Jun 03 19:30:59.862638 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.862571 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6387113f-8cf7-463c-9ff0-d315c3512cde" containerName="extract" Jun 03 19:30:59.862638 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.862581 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6387113f-8cf7-463c-9ff0-d315c3512cde" containerName="pull" Jun 03 19:30:59.862638 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.862586 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6387113f-8cf7-463c-9ff0-d315c3512cde" containerName="pull" Jun 03 19:30:59.862638 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.862601 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6387113f-8cf7-463c-9ff0-d315c3512cde" containerName="util" Jun 03 19:30:59.862638 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.862608 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6387113f-8cf7-463c-9ff0-d315c3512cde" containerName="util" Jun 03 19:30:59.862815 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.862672 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6387113f-8cf7-463c-9ff0-d315c3512cde" containerName="extract" Jun 03 19:30:59.865486 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.865470 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" Jun 03 19:30:59.869684 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.869666 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bkt6w\"" Jun 03 19:30:59.870709 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.870690 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:30:59.870811 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.870697 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:30:59.880521 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.880500 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x"] Jun 03 19:31:00.000009 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:30:59.999975 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:00.023625 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.023590 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x\" (UID: \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" Jun 03 19:31:00.023783 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.023629 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x\" (UID: \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" Jun 03 19:31:00.023783 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.023657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7zcx\" (UniqueName: \"kubernetes.io/projected/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-kube-api-access-x7zcx\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x\" (UID: \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" Jun 03 19:31:00.056778 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.056747 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-8b9ffc7d9-m4zfp"] Jun 03 19:31:00.060459 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.060441 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8b9ffc7d9-m4zfp" Jun 03 19:31:00.065179 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.065157 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 19:31:00.065416 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.065402 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wlplj\"" Jun 03 19:31:00.075187 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.075160 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8b9ffc7d9-m4zfp"] Jun 03 19:31:00.105038 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.105005 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:00.124762 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.124688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x\" (UID: \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" Jun 03 19:31:00.124762 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.124723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x\" (UID: \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" Jun 03 19:31:00.124762 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.124744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7zcx\" (UniqueName: \"kubernetes.io/projected/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-kube-api-access-x7zcx\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x\" (UID: \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" Jun 03 19:31:00.125085 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.125039 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x\" (UID: \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" Jun 03 19:31:00.125165 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.125143 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x\" (UID: \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" Jun 03 19:31:00.142245 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.142221 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7zcx\" (UniqueName: \"kubernetes.io/projected/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-kube-api-access-x7zcx\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x\" (UID: \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" Jun 03 19:31:00.173982 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.173955 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" Jun 03 19:31:00.225917 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.225876 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brdlf\" (UniqueName: \"kubernetes.io/projected/17f94266-2a38-4c97-85f1-a17192aec788-kube-api-access-brdlf\") pod \"dashboard-redirect-8b9ffc7d9-m4zfp\" (UID: \"17f94266-2a38-4c97-85f1-a17192aec788\") " pod="opendatahub/dashboard-redirect-8b9ffc7d9-m4zfp" Jun 03 19:31:00.226093 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.225964 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/17f94266-2a38-4c97-85f1-a17192aec788-redirect-config\") pod \"dashboard-redirect-8b9ffc7d9-m4zfp\" (UID: \"17f94266-2a38-4c97-85f1-a17192aec788\") " pod="opendatahub/dashboard-redirect-8b9ffc7d9-m4zfp" Jun 03 19:31:00.304258 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.304233 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x"] Jun 03 19:31:00.305941 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:31:00.305916 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194bc4c3_2a3e_4c38_8ad7_7e2167068d00.slice/crio-e8c26b362d5e00d484742ec25ca89cae01984342e8e0919c03cc37a66d180015 WatchSource:0}: Error finding container e8c26b362d5e00d484742ec25ca89cae01984342e8e0919c03cc37a66d180015: Status 404 returned error can't find the container with id e8c26b362d5e00d484742ec25ca89cae01984342e8e0919c03cc37a66d180015 Jun 03 19:31:00.326730 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.326708 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/17f94266-2a38-4c97-85f1-a17192aec788-redirect-config\") pod \"dashboard-redirect-8b9ffc7d9-m4zfp\" (UID: \"17f94266-2a38-4c97-85f1-a17192aec788\") " pod="opendatahub/dashboard-redirect-8b9ffc7d9-m4zfp" Jun 03 19:31:00.326846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.326808 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brdlf\" (UniqueName: \"kubernetes.io/projected/17f94266-2a38-4c97-85f1-a17192aec788-kube-api-access-brdlf\") pod \"dashboard-redirect-8b9ffc7d9-m4zfp\" (UID: \"17f94266-2a38-4c97-85f1-a17192aec788\") " pod="opendatahub/dashboard-redirect-8b9ffc7d9-m4zfp" Jun 03 19:31:00.327446 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.327425 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/17f94266-2a38-4c97-85f1-a17192aec788-redirect-config\") pod \"dashboard-redirect-8b9ffc7d9-m4zfp\" (UID: \"17f94266-2a38-4c97-85f1-a17192aec788\") " pod="opendatahub/dashboard-redirect-8b9ffc7d9-m4zfp" Jun 03 19:31:00.336172 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.336149 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brdlf\" (UniqueName: \"kubernetes.io/projected/17f94266-2a38-4c97-85f1-a17192aec788-kube-api-access-brdlf\") pod \"dashboard-redirect-8b9ffc7d9-m4zfp\" (UID: \"17f94266-2a38-4c97-85f1-a17192aec788\") " pod="opendatahub/dashboard-redirect-8b9ffc7d9-m4zfp" Jun 03 19:31:00.375705 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.375648 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8b9ffc7d9-m4zfp" Jun 03 19:31:00.506055 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.506031 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8b9ffc7d9-m4zfp"] Jun 03 19:31:00.507625 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:31:00.507597 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f94266_2a38_4c97_85f1_a17192aec788.slice/crio-acd131d4da1c1606f608ee0035defd52192bc86d76c8da767b26ff6466b1ebc2 WatchSource:0}: Error finding container acd131d4da1c1606f608ee0035defd52192bc86d76c8da767b26ff6466b1ebc2: Status 404 returned error can't find the container with id acd131d4da1c1606f608ee0035defd52192bc86d76c8da767b26ff6466b1ebc2 Jun 03 19:31:00.508929 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.508914 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:31:00.540862 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.540828 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8b9ffc7d9-m4zfp" event={"ID":"17f94266-2a38-4c97-85f1-a17192aec788","Type":"ContainerStarted","Data":"acd131d4da1c1606f608ee0035defd52192bc86d76c8da767b26ff6466b1ebc2"} Jun 03 19:31:00.542334 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.542312 2577 generic.go:356] "Generic (PLEG): container finished" podID="194bc4c3-2a3e-4c38-8ad7-7e2167068d00" containerID="ffd191bb7a2f46f1325deedc1222afca29c37d72ae90f2235bc17d8021e8231c" exitCode=0 Jun 03 19:31:00.542448 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.542369 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" event={"ID":"194bc4c3-2a3e-4c38-8ad7-7e2167068d00","Type":"ContainerDied","Data":"ffd191bb7a2f46f1325deedc1222afca29c37d72ae90f2235bc17d8021e8231c"} Jun 03 19:31:00.542448 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:00.542394 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" event={"ID":"194bc4c3-2a3e-4c38-8ad7-7e2167068d00","Type":"ContainerStarted","Data":"e8c26b362d5e00d484742ec25ca89cae01984342e8e0919c03cc37a66d180015"} Jun 03 19:31:01.801781 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:01.801746 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:02.555949 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:02.555862 2577 generic.go:356] "Generic (PLEG): container finished" podID="194bc4c3-2a3e-4c38-8ad7-7e2167068d00" containerID="36d438f53f994f538b829d033dd26ca3ee46142ecd915042ec42ebe94d06b4ac" exitCode=0 Jun 03 19:31:02.555949 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:02.555908 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" event={"ID":"194bc4c3-2a3e-4c38-8ad7-7e2167068d00","Type":"ContainerDied","Data":"36d438f53f994f538b829d033dd26ca3ee46142ecd915042ec42ebe94d06b4ac"} Jun 03 19:31:03.563912 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:03.563869 2577 generic.go:356] "Generic (PLEG): container finished" podID="194bc4c3-2a3e-4c38-8ad7-7e2167068d00" containerID="b7b327134db81c67ad829537a1ab0884a39e3e949abf84bb6c7d9c303c68880b" exitCode=0 Jun 03 19:31:03.564365 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:03.563932 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" event={"ID":"194bc4c3-2a3e-4c38-8ad7-7e2167068d00","Type":"ContainerDied","Data":"b7b327134db81c67ad829537a1ab0884a39e3e949abf84bb6c7d9c303c68880b"} Jun 03 19:31:05.124073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:05.124032 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" Jun 03 19:31:05.272508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:05.272460 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-bundle\") pod \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\" (UID: \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\") " Jun 03 19:31:05.272508 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:05.272518 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7zcx\" (UniqueName: \"kubernetes.io/projected/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-kube-api-access-x7zcx\") pod \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\" (UID: \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\") " Jun 03 19:31:05.272768 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:05.272608 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-util\") pod \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\" (UID: \"194bc4c3-2a3e-4c38-8ad7-7e2167068d00\") " Jun 03 19:31:05.273749 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:05.273697 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-bundle" (OuterVolumeSpecName: "bundle") pod "194bc4c3-2a3e-4c38-8ad7-7e2167068d00" (UID: "194bc4c3-2a3e-4c38-8ad7-7e2167068d00"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:31:05.275734 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:05.275712 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-kube-api-access-x7zcx" (OuterVolumeSpecName: "kube-api-access-x7zcx") pod "194bc4c3-2a3e-4c38-8ad7-7e2167068d00" (UID: "194bc4c3-2a3e-4c38-8ad7-7e2167068d00"). InnerVolumeSpecName "kube-api-access-x7zcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:31:05.279273 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:05.279248 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-util" (OuterVolumeSpecName: "util") pod "194bc4c3-2a3e-4c38-8ad7-7e2167068d00" (UID: "194bc4c3-2a3e-4c38-8ad7-7e2167068d00"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:31:05.373523 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:05.373446 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-bundle\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:31:05.373523 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:05.373471 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7zcx\" (UniqueName: \"kubernetes.io/projected/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-kube-api-access-x7zcx\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:31:05.373523 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:05.373487 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/194bc4c3-2a3e-4c38-8ad7-7e2167068d00-util\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:31:05.577334 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:05.577307 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" Jun 03 19:31:05.577334 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:05.577325 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9r8x" event={"ID":"194bc4c3-2a3e-4c38-8ad7-7e2167068d00","Type":"ContainerDied","Data":"e8c26b362d5e00d484742ec25ca89cae01984342e8e0919c03cc37a66d180015"} Jun 03 19:31:05.577510 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:05.577376 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8c26b362d5e00d484742ec25ca89cae01984342e8e0919c03cc37a66d180015" Jun 03 19:31:06.584323 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:06.584286 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8b9ffc7d9-m4zfp" event={"ID":"17f94266-2a38-4c97-85f1-a17192aec788","Type":"ContainerStarted","Data":"5fcef3042eadf6cb619c274ed004bdefe30d451dbe569abf1564f1ed7788a498"} Jun 03 19:31:06.603209 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:06.603160 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-8b9ffc7d9-m4zfp" podStartSLOduration=1.546350707 podStartE2EDuration="6.603146553s" totalImagesPullingTime="5.056795846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:06.602943254 +0000 UTC m=+611.756743226" watchObservedRunningTime="2026-06-03 19:31:06.603146553 +0000 UTC m=+611.756946533" Jun 03 19:31:12.312283 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:12.312249 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:12.412701 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:12.412665 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:14.466326 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:14.466246 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:14.534052 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:14.534022 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:15.058244 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:15.058208 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:19.119809 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.119768 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:19.219476 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.219439 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:19.393575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.393544 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m"] Jun 03 19:31:19.393877 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.393866 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194bc4c3-2a3e-4c38-8ad7-7e2167068d00" containerName="util" Jun 03 19:31:19.393914 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.393879 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="194bc4c3-2a3e-4c38-8ad7-7e2167068d00" containerName="util" Jun 03 19:31:19.393914 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.393894 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194bc4c3-2a3e-4c38-8ad7-7e2167068d00" containerName="pull" Jun 03 19:31:19.393914 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.393900 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="194bc4c3-2a3e-4c38-8ad7-7e2167068d00" containerName="pull" Jun 03 19:31:19.393914 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.393908 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194bc4c3-2a3e-4c38-8ad7-7e2167068d00" containerName="extract" Jun 03 19:31:19.393914 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.393913 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="194bc4c3-2a3e-4c38-8ad7-7e2167068d00" containerName="extract" Jun 03 19:31:19.394076 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.393967 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="194bc4c3-2a3e-4c38-8ad7-7e2167068d00" containerName="extract" Jun 03 19:31:19.397424 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.397409 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.401147 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.401129 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2cdhp\"" Jun 03 19:31:19.401308 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.401294 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 19:31:19.411108 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.411087 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m"] Jun 03 19:31:19.436686 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.436644 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:19.493620 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.493586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtmhl\" (UniqueName: \"kubernetes.io/projected/5cc72d2c-96e8-4c0d-9771-5c473157e27f-kube-api-access-xtmhl\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.493620 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.493623 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.493813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.493650 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.493813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.493704 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.493813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.493752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.493813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.493785 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.493930 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.493814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.493930 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.493846 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.493930 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.493863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.595057 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.595012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.595260 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.595085 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.595260 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.595137 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtmhl\" (UniqueName: \"kubernetes.io/projected/5cc72d2c-96e8-4c0d-9771-5c473157e27f-kube-api-access-xtmhl\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.595672 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.595641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.595768 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.595703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.595768 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.595758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.595874 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.595799 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.595874 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.595857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.595990 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.595959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.596311 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.596287 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.596462 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.596306 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.601096 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.596558 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.601096 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.596709 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.601096 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.598642 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.601096 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.598781 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cc72d2c-96e8-4c0d-9771-5c473157e27f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.603860 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.603839 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.605944 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.605918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cc72d2c-96e8-4c0d-9771-5c473157e27f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.607053 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.607032 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtmhl\" (UniqueName: \"kubernetes.io/projected/5cc72d2c-96e8-4c0d-9771-5c473157e27f-kube-api-access-xtmhl\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t254m\" (UID: \"5cc72d2c-96e8-4c0d-9771-5c473157e27f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.634435 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.634409 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:19.707228 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.707141 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:19.784594 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.784559 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:19.857247 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:19.857221 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m"] Jun 03 19:31:19.859288 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:31:19.859256 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cc72d2c_96e8_4c0d_9771_5c473157e27f.slice/crio-d848fc3a99dbbd66ce699bd1270f1590be3fac1a9d5b0426f2076e09adab5807 WatchSource:0}: Error finding container d848fc3a99dbbd66ce699bd1270f1590be3fac1a9d5b0426f2076e09adab5807: Status 404 returned error can't find the container with id d848fc3a99dbbd66ce699bd1270f1590be3fac1a9d5b0426f2076e09adab5807 Jun 03 19:31:20.338987 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:20.338954 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:20.651110 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:20.651076 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" event={"ID":"5cc72d2c-96e8-4c0d-9771-5c473157e27f","Type":"ContainerStarted","Data":"d848fc3a99dbbd66ce699bd1270f1590be3fac1a9d5b0426f2076e09adab5807"} Jun 03 19:31:22.849176 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:22.849138 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 19:31:22.849442 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:22.849230 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 19:31:22.849442 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:22.849261 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 19:31:23.668633 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:23.668587 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" event={"ID":"5cc72d2c-96e8-4c0d-9771-5c473157e27f","Type":"ContainerStarted","Data":"d2cf5146977c5d3461987e13082c18bb239ff0730d9b407c39755408c20ff3b8"} Jun 03 19:31:23.694406 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:23.694356 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" podStartSLOduration=1.706666547 podStartE2EDuration="4.694340523s" totalImagesPullingTime="2.987673976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:23.69296319 +0000 UTC m=+628.846763173" watchObservedRunningTime="2026-06-03 19:31:23.694340523 +0000 UTC m=+628.848140502" Jun 03 19:31:23.708030 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:23.708000 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:23.712621 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:23.712601 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:24.673604 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:24.673577 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:24.674562 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:24.674545 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t254m" Jun 03 19:31:38.637173 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:38.637117 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:38.728642 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:38.728609 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:38.748747 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:38.748717 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rtbt8"] Jun 03 19:31:38.825299 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:38.825265 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rtbt8"] Jun 03 19:31:38.825473 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:38.825364 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rtbt8" Jun 03 19:31:38.826597 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:38.826569 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:38.828951 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:38.828936 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 19:31:38.830324 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:38.830307 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xgtp9\"" Jun 03 19:31:38.830435 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:38.830309 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 19:31:38.964702 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:38.964608 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcdr2\" (UniqueName: \"kubernetes.io/projected/eeeee428-a711-48f2-8e51-01ad6f593062-kube-api-access-jcdr2\") pod \"kuadrant-operator-catalog-rtbt8\" (UID: \"eeeee428-a711-48f2-8e51-01ad6f593062\") " pod="kuadrant-system/kuadrant-operator-catalog-rtbt8" Jun 03 19:31:39.065935 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.065893 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcdr2\" (UniqueName: \"kubernetes.io/projected/eeeee428-a711-48f2-8e51-01ad6f593062-kube-api-access-jcdr2\") pod \"kuadrant-operator-catalog-rtbt8\" (UID: \"eeeee428-a711-48f2-8e51-01ad6f593062\") " pod="kuadrant-system/kuadrant-operator-catalog-rtbt8" Jun 03 19:31:39.075117 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.075093 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcdr2\" (UniqueName: \"kubernetes.io/projected/eeeee428-a711-48f2-8e51-01ad6f593062-kube-api-access-jcdr2\") pod \"kuadrant-operator-catalog-rtbt8\" (UID: \"eeeee428-a711-48f2-8e51-01ad6f593062\") " pod="kuadrant-system/kuadrant-operator-catalog-rtbt8" Jun 03 19:31:39.134798 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.134768 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rtbt8" Jun 03 19:31:39.176032 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.175999 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rtbt8"] Jun 03 19:31:39.310372 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.310337 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rtbt8"] Jun 03 19:31:39.314893 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:31:39.314867 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeeee428_a711_48f2_8e51_01ad6f593062.slice/crio-c291b4a7b5e50b7f1967b5373f8838d04b4dc36105cb5d781c49ec15dc4a421f WatchSource:0}: Error finding container c291b4a7b5e50b7f1967b5373f8838d04b4dc36105cb5d781c49ec15dc4a421f: Status 404 returned error can't find the container with id c291b4a7b5e50b7f1967b5373f8838d04b4dc36105cb5d781c49ec15dc4a421f Jun 03 19:31:39.342621 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.342600 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qrx56"] Jun 03 19:31:39.345790 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.345776 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qrx56" Jun 03 19:31:39.356875 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.356854 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qrx56"] Jun 03 19:31:39.469457 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.469419 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkqhl\" (UniqueName: \"kubernetes.io/projected/df3ec488-a82f-4393-b72c-678f41a510a1-kube-api-access-hkqhl\") pod \"kuadrant-operator-catalog-qrx56\" (UID: \"df3ec488-a82f-4393-b72c-678f41a510a1\") " pod="kuadrant-system/kuadrant-operator-catalog-qrx56" Jun 03 19:31:39.543455 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.543380 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:39.570602 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.570578 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkqhl\" (UniqueName: \"kubernetes.io/projected/df3ec488-a82f-4393-b72c-678f41a510a1-kube-api-access-hkqhl\") pod \"kuadrant-operator-catalog-qrx56\" (UID: \"df3ec488-a82f-4393-b72c-678f41a510a1\") " pod="kuadrant-system/kuadrant-operator-catalog-qrx56" Jun 03 19:31:39.579980 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.579949 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkqhl\" (UniqueName: \"kubernetes.io/projected/df3ec488-a82f-4393-b72c-678f41a510a1-kube-api-access-hkqhl\") pod \"kuadrant-operator-catalog-qrx56\" (UID: \"df3ec488-a82f-4393-b72c-678f41a510a1\") " pod="kuadrant-system/kuadrant-operator-catalog-qrx56" Jun 03 19:31:39.654984 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.654941 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qrx56" Jun 03 19:31:39.745305 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.745272 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rtbt8" event={"ID":"eeeee428-a711-48f2-8e51-01ad6f593062","Type":"ContainerStarted","Data":"c291b4a7b5e50b7f1967b5373f8838d04b4dc36105cb5d781c49ec15dc4a421f"} Jun 03 19:31:39.749107 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.749083 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:39.781841 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:39.781815 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qrx56"] Jun 03 19:31:39.783805 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:31:39.783776 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf3ec488_a82f_4393_b72c_678f41a510a1.slice/crio-17497b9819834789e1ba60d1c22d25794a05d5dfe33ecca7e3abd796406664d1 WatchSource:0}: Error finding container 17497b9819834789e1ba60d1c22d25794a05d5dfe33ecca7e3abd796406664d1: Status 404 returned error can't find the container with id 17497b9819834789e1ba60d1c22d25794a05d5dfe33ecca7e3abd796406664d1 Jun 03 19:31:40.761731 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:40.761687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qrx56" event={"ID":"df3ec488-a82f-4393-b72c-678f41a510a1","Type":"ContainerStarted","Data":"17497b9819834789e1ba60d1c22d25794a05d5dfe33ecca7e3abd796406664d1"} Jun 03 19:31:41.768190 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:41.768155 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rtbt8" event={"ID":"eeeee428-a711-48f2-8e51-01ad6f593062","Type":"ContainerStarted","Data":"6826318c4799e85b14d3a1a03aeb5716ca5b0c7f66487d7c373c94974a80ac04"} Jun 03 19:31:41.768655 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:41.768229 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rtbt8" podUID="eeeee428-a711-48f2-8e51-01ad6f593062" containerName="registry-server" containerID="cri-o://6826318c4799e85b14d3a1a03aeb5716ca5b0c7f66487d7c373c94974a80ac04" gracePeriod=2 Jun 03 19:31:41.769860 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:41.769830 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qrx56" event={"ID":"df3ec488-a82f-4393-b72c-678f41a510a1","Type":"ContainerStarted","Data":"ae2d03c325bd313765ab39834a30527d8acc3d8e1c0b221570c237f3542a4cc2"} Jun 03 19:31:41.787452 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:41.787403 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rtbt8" podStartSLOduration=1.502791501 podStartE2EDuration="3.787387801s" totalImagesPullingTime="2.2845963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:41.786668729 +0000 UTC m=+646.940468702" watchObservedRunningTime="2026-06-03 19:31:41.787387801 +0000 UTC m=+646.941187782" Jun 03 19:31:41.805945 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:41.805906 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qrx56" podStartSLOduration=0.993509067 podStartE2EDuration="2.805891519s" totalImagesPullingTime="1.812382452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:41.804126242 +0000 UTC m=+646.957926223" watchObservedRunningTime="2026-06-03 19:31:41.805891519 +0000 UTC m=+646.959691499" Jun 03 19:31:42.117123 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:42.117101 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rtbt8" Jun 03 19:31:42.194168 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:42.194080 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcdr2\" (UniqueName: \"kubernetes.io/projected/eeeee428-a711-48f2-8e51-01ad6f593062-kube-api-access-jcdr2\") pod \"eeeee428-a711-48f2-8e51-01ad6f593062\" (UID: \"eeeee428-a711-48f2-8e51-01ad6f593062\") " Jun 03 19:31:42.196198 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:42.196173 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeeee428-a711-48f2-8e51-01ad6f593062-kube-api-access-jcdr2" (OuterVolumeSpecName: "kube-api-access-jcdr2") pod "eeeee428-a711-48f2-8e51-01ad6f593062" (UID: "eeeee428-a711-48f2-8e51-01ad6f593062"). InnerVolumeSpecName "kube-api-access-jcdr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:31:42.294914 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:42.294878 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcdr2\" (UniqueName: \"kubernetes.io/projected/eeeee428-a711-48f2-8e51-01ad6f593062-kube-api-access-jcdr2\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:31:42.775805 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:42.775773 2577 generic.go:356] "Generic (PLEG): container finished" podID="eeeee428-a711-48f2-8e51-01ad6f593062" containerID="6826318c4799e85b14d3a1a03aeb5716ca5b0c7f66487d7c373c94974a80ac04" exitCode=0 Jun 03 19:31:42.776307 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:42.775816 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rtbt8" Jun 03 19:31:42.776307 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:42.775851 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rtbt8" event={"ID":"eeeee428-a711-48f2-8e51-01ad6f593062","Type":"ContainerDied","Data":"6826318c4799e85b14d3a1a03aeb5716ca5b0c7f66487d7c373c94974a80ac04"} Jun 03 19:31:42.776307 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:42.775888 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rtbt8" event={"ID":"eeeee428-a711-48f2-8e51-01ad6f593062","Type":"ContainerDied","Data":"c291b4a7b5e50b7f1967b5373f8838d04b4dc36105cb5d781c49ec15dc4a421f"} Jun 03 19:31:42.776307 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:42.775909 2577 scope.go:117] "RemoveContainer" containerID="6826318c4799e85b14d3a1a03aeb5716ca5b0c7f66487d7c373c94974a80ac04" Jun 03 19:31:42.785343 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:42.785326 2577 scope.go:117] "RemoveContainer" containerID="6826318c4799e85b14d3a1a03aeb5716ca5b0c7f66487d7c373c94974a80ac04" Jun 03 19:31:42.785587 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:31:42.785569 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6826318c4799e85b14d3a1a03aeb5716ca5b0c7f66487d7c373c94974a80ac04\": container with ID starting with 6826318c4799e85b14d3a1a03aeb5716ca5b0c7f66487d7c373c94974a80ac04 not found: ID does not exist" containerID="6826318c4799e85b14d3a1a03aeb5716ca5b0c7f66487d7c373c94974a80ac04" Jun 03 19:31:42.785656 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:42.785601 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6826318c4799e85b14d3a1a03aeb5716ca5b0c7f66487d7c373c94974a80ac04"} err="failed to get container status \"6826318c4799e85b14d3a1a03aeb5716ca5b0c7f66487d7c373c94974a80ac04\": rpc error: code = NotFound desc = could not find container \"6826318c4799e85b14d3a1a03aeb5716ca5b0c7f66487d7c373c94974a80ac04\": container with ID starting with 6826318c4799e85b14d3a1a03aeb5716ca5b0c7f66487d7c373c94974a80ac04 not found: ID does not exist" Jun 03 19:31:42.799888 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:42.799864 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rtbt8"] Jun 03 19:31:42.810837 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:42.810816 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rtbt8"] Jun 03 19:31:43.279253 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:43.279223 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeeee428-a711-48f2-8e51-01ad6f593062" path="/var/lib/kubelet/pods/eeeee428-a711-48f2-8e51-01ad6f593062/volumes" Jun 03 19:31:49.656043 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:49.656005 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qrx56" Jun 03 19:31:49.656503 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:49.656138 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qrx56" Jun 03 19:31:49.677850 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:49.677825 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qrx56" Jun 03 19:31:49.830984 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:49.830957 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qrx56" Jun 03 19:31:53.964545 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:53.964503 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr"] Jun 03 19:31:53.965088 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:53.965039 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeeee428-a711-48f2-8e51-01ad6f593062" containerName="registry-server" Jun 03 19:31:53.965088 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:53.965079 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeeee428-a711-48f2-8e51-01ad6f593062" containerName="registry-server" Jun 03 19:31:53.965230 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:53.965179 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeeee428-a711-48f2-8e51-01ad6f593062" containerName="registry-server" Jun 03 19:31:53.968479 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:53.968457 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" Jun 03 19:31:53.971733 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:53.971712 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dmfm7\"" Jun 03 19:31:53.980966 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:53.979329 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr"] Jun 03 19:31:54.106518 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.106478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxc4c\" (UniqueName: \"kubernetes.io/projected/528f64c4-fab7-450e-97f4-8de8b90e6a64-kube-api-access-mxc4c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr\" (UID: \"528f64c4-fab7-450e-97f4-8de8b90e6a64\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" Jun 03 19:31:54.106712 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.106571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528f64c4-fab7-450e-97f4-8de8b90e6a64-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr\" (UID: \"528f64c4-fab7-450e-97f4-8de8b90e6a64\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" Jun 03 19:31:54.106712 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.106619 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528f64c4-fab7-450e-97f4-8de8b90e6a64-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr\" (UID: \"528f64c4-fab7-450e-97f4-8de8b90e6a64\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" Jun 03 19:31:54.207455 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.207410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528f64c4-fab7-450e-97f4-8de8b90e6a64-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr\" (UID: \"528f64c4-fab7-450e-97f4-8de8b90e6a64\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" Jun 03 19:31:54.207626 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.207569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxc4c\" (UniqueName: \"kubernetes.io/projected/528f64c4-fab7-450e-97f4-8de8b90e6a64-kube-api-access-mxc4c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr\" (UID: \"528f64c4-fab7-450e-97f4-8de8b90e6a64\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" Jun 03 19:31:54.207670 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.207622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528f64c4-fab7-450e-97f4-8de8b90e6a64-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr\" (UID: \"528f64c4-fab7-450e-97f4-8de8b90e6a64\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" Jun 03 19:31:54.207821 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.207800 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528f64c4-fab7-450e-97f4-8de8b90e6a64-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr\" (UID: \"528f64c4-fab7-450e-97f4-8de8b90e6a64\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" Jun 03 19:31:54.207942 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.207923 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528f64c4-fab7-450e-97f4-8de8b90e6a64-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr\" (UID: \"528f64c4-fab7-450e-97f4-8de8b90e6a64\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" Jun 03 19:31:54.217371 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.217317 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxc4c\" (UniqueName: \"kubernetes.io/projected/528f64c4-fab7-450e-97f4-8de8b90e6a64-kube-api-access-mxc4c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr\" (UID: \"528f64c4-fab7-450e-97f4-8de8b90e6a64\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" Jun 03 19:31:54.278725 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.278690 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" Jun 03 19:31:54.363096 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.363035 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw"] Jun 03 19:31:54.368192 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.368165 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" Jun 03 19:31:54.379496 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.379467 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw"] Jun 03 19:31:54.417983 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.417958 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr"] Jun 03 19:31:54.420008 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:31:54.419980 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528f64c4_fab7_450e_97f4_8de8b90e6a64.slice/crio-f4faa3d2299e6243803fa8220dcdedee053e92dde9b957a384a6f7dcb6d498d2 WatchSource:0}: Error finding container f4faa3d2299e6243803fa8220dcdedee053e92dde9b957a384a6f7dcb6d498d2: Status 404 returned error can't find the container with id f4faa3d2299e6243803fa8220dcdedee053e92dde9b957a384a6f7dcb6d498d2 Jun 03 19:31:54.511203 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.511164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f71690e9-045b-463e-aebe-700a1f27af93-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw\" (UID: \"f71690e9-045b-463e-aebe-700a1f27af93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" Jun 03 19:31:54.511203 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.511214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f71690e9-045b-463e-aebe-700a1f27af93-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw\" (UID: \"f71690e9-045b-463e-aebe-700a1f27af93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" Jun 03 19:31:54.511442 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.511281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffsw8\" (UniqueName: \"kubernetes.io/projected/f71690e9-045b-463e-aebe-700a1f27af93-kube-api-access-ffsw8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw\" (UID: \"f71690e9-045b-463e-aebe-700a1f27af93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" Jun 03 19:31:54.612430 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.612387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f71690e9-045b-463e-aebe-700a1f27af93-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw\" (UID: \"f71690e9-045b-463e-aebe-700a1f27af93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" Jun 03 19:31:54.612430 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.612436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f71690e9-045b-463e-aebe-700a1f27af93-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw\" (UID: \"f71690e9-045b-463e-aebe-700a1f27af93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" Jun 03 19:31:54.612701 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.612483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffsw8\" (UniqueName: \"kubernetes.io/projected/f71690e9-045b-463e-aebe-700a1f27af93-kube-api-access-ffsw8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw\" (UID: \"f71690e9-045b-463e-aebe-700a1f27af93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" Jun 03 19:31:54.612819 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.612798 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f71690e9-045b-463e-aebe-700a1f27af93-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw\" (UID: \"f71690e9-045b-463e-aebe-700a1f27af93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" Jun 03 19:31:54.612885 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.612814 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f71690e9-045b-463e-aebe-700a1f27af93-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw\" (UID: \"f71690e9-045b-463e-aebe-700a1f27af93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" Jun 03 19:31:54.624895 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.624867 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffsw8\" (UniqueName: \"kubernetes.io/projected/f71690e9-045b-463e-aebe-700a1f27af93-kube-api-access-ffsw8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw\" (UID: \"f71690e9-045b-463e-aebe-700a1f27af93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" Jun 03 19:31:54.681379 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.681349 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" Jun 03 19:31:54.810276 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.810249 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw"] Jun 03 19:31:54.812371 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:31:54.812337 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf71690e9_045b_463e_aebe_700a1f27af93.slice/crio-d53c9db9a1f2cdd677001f8a5ff10ccb050e52ec05c56ac2fbec79601161038f WatchSource:0}: Error finding container d53c9db9a1f2cdd677001f8a5ff10ccb050e52ec05c56ac2fbec79601161038f: Status 404 returned error can't find the container with id d53c9db9a1f2cdd677001f8a5ff10ccb050e52ec05c56ac2fbec79601161038f Jun 03 19:31:54.835121 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.835090 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" event={"ID":"f71690e9-045b-463e-aebe-700a1f27af93","Type":"ContainerStarted","Data":"d53c9db9a1f2cdd677001f8a5ff10ccb050e52ec05c56ac2fbec79601161038f"} Jun 03 19:31:54.836451 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.836429 2577 generic.go:356] "Generic (PLEG): container finished" podID="528f64c4-fab7-450e-97f4-8de8b90e6a64" containerID="f7751cee19c8a88830c79f703a1ce6baf4e141122c2bab9774e6a0316674c94c" exitCode=0 Jun 03 19:31:54.836540 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.836502 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" event={"ID":"528f64c4-fab7-450e-97f4-8de8b90e6a64","Type":"ContainerDied","Data":"f7751cee19c8a88830c79f703a1ce6baf4e141122c2bab9774e6a0316674c94c"} Jun 03 19:31:54.836596 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.836539 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" event={"ID":"528f64c4-fab7-450e-97f4-8de8b90e6a64","Type":"ContainerStarted","Data":"f4faa3d2299e6243803fa8220dcdedee053e92dde9b957a384a6f7dcb6d498d2"} Jun 03 19:31:54.975652 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.975598 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb"] Jun 03 19:31:54.981777 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.981367 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" Jun 03 19:31:54.988297 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:54.988269 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb"] Jun 03 19:31:55.117973 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.117936 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h749m\" (UniqueName: \"kubernetes.io/projected/f6d83b00-ee2d-4304-8227-8f91c44201a5-kube-api-access-h749m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb\" (UID: \"f6d83b00-ee2d-4304-8227-8f91c44201a5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" Jun 03 19:31:55.117973 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.117978 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6d83b00-ee2d-4304-8227-8f91c44201a5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb\" (UID: \"f6d83b00-ee2d-4304-8227-8f91c44201a5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" Jun 03 19:31:55.118221 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.118002 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6d83b00-ee2d-4304-8227-8f91c44201a5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb\" (UID: \"f6d83b00-ee2d-4304-8227-8f91c44201a5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" Jun 03 19:31:55.218584 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.218551 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h749m\" (UniqueName: \"kubernetes.io/projected/f6d83b00-ee2d-4304-8227-8f91c44201a5-kube-api-access-h749m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb\" (UID: \"f6d83b00-ee2d-4304-8227-8f91c44201a5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" Jun 03 19:31:55.218765 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.218591 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6d83b00-ee2d-4304-8227-8f91c44201a5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb\" (UID: \"f6d83b00-ee2d-4304-8227-8f91c44201a5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" Jun 03 19:31:55.218765 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.218609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6d83b00-ee2d-4304-8227-8f91c44201a5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb\" (UID: \"f6d83b00-ee2d-4304-8227-8f91c44201a5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" Jun 03 19:31:55.219037 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.219014 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6d83b00-ee2d-4304-8227-8f91c44201a5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb\" (UID: \"f6d83b00-ee2d-4304-8227-8f91c44201a5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" Jun 03 19:31:55.219111 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.219037 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6d83b00-ee2d-4304-8227-8f91c44201a5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb\" (UID: \"f6d83b00-ee2d-4304-8227-8f91c44201a5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" Jun 03 19:31:55.229263 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.229231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h749m\" (UniqueName: \"kubernetes.io/projected/f6d83b00-ee2d-4304-8227-8f91c44201a5-kube-api-access-h749m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb\" (UID: \"f6d83b00-ee2d-4304-8227-8f91c44201a5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" Jun 03 19:31:55.291647 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.291617 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" Jun 03 19:31:55.443869 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.443848 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb"] Jun 03 19:31:55.445633 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:31:55.445607 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d83b00_ee2d_4304_8227_8f91c44201a5.slice/crio-ca987900b6f45321e9d3b317d8719aa2fa7f5a946ad8d7884ac27f14e5729514 WatchSource:0}: Error finding container ca987900b6f45321e9d3b317d8719aa2fa7f5a946ad8d7884ac27f14e5729514: Status 404 returned error can't find the container with id ca987900b6f45321e9d3b317d8719aa2fa7f5a946ad8d7884ac27f14e5729514 Jun 03 19:31:55.571913 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.571882 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl"] Jun 03 19:31:55.575738 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.575719 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" Jun 03 19:31:55.584992 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.584966 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl"] Jun 03 19:31:55.738620 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.738591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8da761c-5723-4f84-b134-6edc0f8b037c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl\" (UID: \"c8da761c-5723-4f84-b134-6edc0f8b037c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" Jun 03 19:31:55.738725 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.738638 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8da761c-5723-4f84-b134-6edc0f8b037c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl\" (UID: \"c8da761c-5723-4f84-b134-6edc0f8b037c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" Jun 03 19:31:55.738772 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.738733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5hjv\" (UniqueName: \"kubernetes.io/projected/c8da761c-5723-4f84-b134-6edc0f8b037c-kube-api-access-f5hjv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl\" (UID: \"c8da761c-5723-4f84-b134-6edc0f8b037c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" Jun 03 19:31:55.839714 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.839686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5hjv\" (UniqueName: \"kubernetes.io/projected/c8da761c-5723-4f84-b134-6edc0f8b037c-kube-api-access-f5hjv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl\" (UID: \"c8da761c-5723-4f84-b134-6edc0f8b037c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" Jun 03 19:31:55.839872 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.839785 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8da761c-5723-4f84-b134-6edc0f8b037c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl\" (UID: \"c8da761c-5723-4f84-b134-6edc0f8b037c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" Jun 03 19:31:55.839872 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.839827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8da761c-5723-4f84-b134-6edc0f8b037c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl\" (UID: \"c8da761c-5723-4f84-b134-6edc0f8b037c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" Jun 03 19:31:55.840205 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.840185 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8da761c-5723-4f84-b134-6edc0f8b037c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl\" (UID: \"c8da761c-5723-4f84-b134-6edc0f8b037c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" Jun 03 19:31:55.840296 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.840273 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8da761c-5723-4f84-b134-6edc0f8b037c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl\" (UID: \"c8da761c-5723-4f84-b134-6edc0f8b037c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" Jun 03 19:31:55.843353 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.843330 2577 generic.go:356] "Generic (PLEG): container finished" podID="f71690e9-045b-463e-aebe-700a1f27af93" containerID="e9f0de4d503d15be444cfd653007157d3b181eb3aa5df4ac2d8ee6f73454f3da" exitCode=0 Jun 03 19:31:55.843443 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.843410 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" event={"ID":"f71690e9-045b-463e-aebe-700a1f27af93","Type":"ContainerDied","Data":"e9f0de4d503d15be444cfd653007157d3b181eb3aa5df4ac2d8ee6f73454f3da"} Jun 03 19:31:55.845324 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.845303 2577 generic.go:356] "Generic (PLEG): container finished" podID="528f64c4-fab7-450e-97f4-8de8b90e6a64" containerID="fc3c935f5344235e5955e80fd80a56b24866ef030e85428d19778b0060fe66d6" exitCode=0 Jun 03 19:31:55.845421 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.845378 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" event={"ID":"528f64c4-fab7-450e-97f4-8de8b90e6a64","Type":"ContainerDied","Data":"fc3c935f5344235e5955e80fd80a56b24866ef030e85428d19778b0060fe66d6"} Jun 03 19:31:55.847659 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.847617 2577 generic.go:356] "Generic (PLEG): container finished" podID="f6d83b00-ee2d-4304-8227-8f91c44201a5" containerID="3b2f8c3ca2d7029d650b8378c38b3dfdef3b6ddd96ca3beee4dfd6c4f90d46c5" exitCode=0 Jun 03 19:31:55.847763 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.847663 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" event={"ID":"f6d83b00-ee2d-4304-8227-8f91c44201a5","Type":"ContainerDied","Data":"3b2f8c3ca2d7029d650b8378c38b3dfdef3b6ddd96ca3beee4dfd6c4f90d46c5"} Jun 03 19:31:55.847763 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.847740 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" event={"ID":"f6d83b00-ee2d-4304-8227-8f91c44201a5","Type":"ContainerStarted","Data":"ca987900b6f45321e9d3b317d8719aa2fa7f5a946ad8d7884ac27f14e5729514"} Jun 03 19:31:55.852909 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.852885 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5hjv\" (UniqueName: \"kubernetes.io/projected/c8da761c-5723-4f84-b134-6edc0f8b037c-kube-api-access-f5hjv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl\" (UID: \"c8da761c-5723-4f84-b134-6edc0f8b037c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" Jun 03 19:31:55.905898 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:55.905876 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" Jun 03 19:31:56.041154 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:56.041116 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl"] Jun 03 19:31:56.044501 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:31:56.044474 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8da761c_5723_4f84_b134_6edc0f8b037c.slice/crio-bc27a96163c811b953bae9f19d55a047c095883a115d6cee96f8c74cd8f4ae0b WatchSource:0}: Error finding container bc27a96163c811b953bae9f19d55a047c095883a115d6cee96f8c74cd8f4ae0b: Status 404 returned error can't find the container with id bc27a96163c811b953bae9f19d55a047c095883a115d6cee96f8c74cd8f4ae0b Jun 03 19:31:56.854249 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:56.854224 2577 generic.go:356] "Generic (PLEG): container finished" podID="f6d83b00-ee2d-4304-8227-8f91c44201a5" containerID="fb0846aadefcc028c20049f97d7205fd6e70fe80d81f1cfe55729c5a313c7172" exitCode=0 Jun 03 19:31:56.854367 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:56.854307 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" event={"ID":"f6d83b00-ee2d-4304-8227-8f91c44201a5","Type":"ContainerDied","Data":"fb0846aadefcc028c20049f97d7205fd6e70fe80d81f1cfe55729c5a313c7172"} Jun 03 19:31:56.856291 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:56.856275 2577 generic.go:356] "Generic (PLEG): container finished" podID="f71690e9-045b-463e-aebe-700a1f27af93" containerID="010e86b6c53eb083d82e4802f1a6d52a6edc9fb7d5f0f63744453ec8ec56184f" exitCode=0 Jun 03 19:31:56.856381 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:56.856338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" event={"ID":"f71690e9-045b-463e-aebe-700a1f27af93","Type":"ContainerDied","Data":"010e86b6c53eb083d82e4802f1a6d52a6edc9fb7d5f0f63744453ec8ec56184f"} Jun 03 19:31:56.858461 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:56.858442 2577 generic.go:356] "Generic (PLEG): container finished" podID="528f64c4-fab7-450e-97f4-8de8b90e6a64" containerID="91cd11d1419c484aa3e4bdc00ff32843dca980254b95ab764e90520624378927" exitCode=0 Jun 03 19:31:56.858554 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:56.858526 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" event={"ID":"528f64c4-fab7-450e-97f4-8de8b90e6a64","Type":"ContainerDied","Data":"91cd11d1419c484aa3e4bdc00ff32843dca980254b95ab764e90520624378927"} Jun 03 19:31:56.859959 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:56.859942 2577 generic.go:356] "Generic (PLEG): container finished" podID="c8da761c-5723-4f84-b134-6edc0f8b037c" containerID="9463406087c73bb758e2c6166d50675694f7ef3a7591cb6fad5423c62c6e443a" exitCode=0 Jun 03 19:31:56.860054 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:56.859986 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" event={"ID":"c8da761c-5723-4f84-b134-6edc0f8b037c","Type":"ContainerDied","Data":"9463406087c73bb758e2c6166d50675694f7ef3a7591cb6fad5423c62c6e443a"} Jun 03 19:31:56.860054 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:56.860011 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" event={"ID":"c8da761c-5723-4f84-b134-6edc0f8b037c","Type":"ContainerStarted","Data":"bc27a96163c811b953bae9f19d55a047c095883a115d6cee96f8c74cd8f4ae0b"} Jun 03 19:31:57.867664 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:57.867579 2577 generic.go:356] "Generic (PLEG): container finished" podID="f71690e9-045b-463e-aebe-700a1f27af93" containerID="44e51e3ea238f862d38ec88fe413d5e404e243cd5876f5a5385d71e999fd49f7" exitCode=0 Jun 03 19:31:57.867664 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:57.867650 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" event={"ID":"f71690e9-045b-463e-aebe-700a1f27af93","Type":"ContainerDied","Data":"44e51e3ea238f862d38ec88fe413d5e404e243cd5876f5a5385d71e999fd49f7"} Jun 03 19:31:57.869289 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:57.869265 2577 generic.go:356] "Generic (PLEG): container finished" podID="c8da761c-5723-4f84-b134-6edc0f8b037c" containerID="8895707140ca1475707450fe6c1074c82bc89a2e8501b9c6422d6f28597f948a" exitCode=0 Jun 03 19:31:57.869412 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:57.869340 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" event={"ID":"c8da761c-5723-4f84-b134-6edc0f8b037c","Type":"ContainerDied","Data":"8895707140ca1475707450fe6c1074c82bc89a2e8501b9c6422d6f28597f948a"} Jun 03 19:31:57.871387 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:57.871364 2577 generic.go:356] "Generic (PLEG): container finished" podID="f6d83b00-ee2d-4304-8227-8f91c44201a5" containerID="eb9e9edefaadb988404ea1e9b5912749b4d18052320ff198aebbbc8800356f7c" exitCode=0 Jun 03 19:31:57.871487 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:57.871441 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" event={"ID":"f6d83b00-ee2d-4304-8227-8f91c44201a5","Type":"ContainerDied","Data":"eb9e9edefaadb988404ea1e9b5912749b4d18052320ff198aebbbc8800356f7c"} Jun 03 19:31:58.008070 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.008033 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" Jun 03 19:31:58.057704 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.057674 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxc4c\" (UniqueName: \"kubernetes.io/projected/528f64c4-fab7-450e-97f4-8de8b90e6a64-kube-api-access-mxc4c\") pod \"528f64c4-fab7-450e-97f4-8de8b90e6a64\" (UID: \"528f64c4-fab7-450e-97f4-8de8b90e6a64\") " Jun 03 19:31:58.057869 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.057760 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528f64c4-fab7-450e-97f4-8de8b90e6a64-bundle\") pod \"528f64c4-fab7-450e-97f4-8de8b90e6a64\" (UID: \"528f64c4-fab7-450e-97f4-8de8b90e6a64\") " Jun 03 19:31:58.057869 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.057777 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528f64c4-fab7-450e-97f4-8de8b90e6a64-util\") pod \"528f64c4-fab7-450e-97f4-8de8b90e6a64\" (UID: \"528f64c4-fab7-450e-97f4-8de8b90e6a64\") " Jun 03 19:31:58.058243 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.058215 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528f64c4-fab7-450e-97f4-8de8b90e6a64-bundle" (OuterVolumeSpecName: "bundle") pod "528f64c4-fab7-450e-97f4-8de8b90e6a64" (UID: "528f64c4-fab7-450e-97f4-8de8b90e6a64"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:31:58.059630 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.059608 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/528f64c4-fab7-450e-97f4-8de8b90e6a64-kube-api-access-mxc4c" (OuterVolumeSpecName: "kube-api-access-mxc4c") pod "528f64c4-fab7-450e-97f4-8de8b90e6a64" (UID: "528f64c4-fab7-450e-97f4-8de8b90e6a64"). InnerVolumeSpecName "kube-api-access-mxc4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:31:58.063183 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.063164 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528f64c4-fab7-450e-97f4-8de8b90e6a64-util" (OuterVolumeSpecName: "util") pod "528f64c4-fab7-450e-97f4-8de8b90e6a64" (UID: "528f64c4-fab7-450e-97f4-8de8b90e6a64"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:31:58.158840 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.158808 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxc4c\" (UniqueName: \"kubernetes.io/projected/528f64c4-fab7-450e-97f4-8de8b90e6a64-kube-api-access-mxc4c\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:31:58.158840 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.158836 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528f64c4-fab7-450e-97f4-8de8b90e6a64-bundle\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:31:58.159035 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.158849 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528f64c4-fab7-450e-97f4-8de8b90e6a64-util\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:31:58.879679 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.879648 2577 generic.go:356] "Generic (PLEG): container finished" podID="c8da761c-5723-4f84-b134-6edc0f8b037c" containerID="87a36196e31b59e8037ae14cbd488ffc96a89a057f572d4d79c907011a8edb9f" exitCode=0 Jun 03 19:31:58.880085 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.879733 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" event={"ID":"c8da761c-5723-4f84-b134-6edc0f8b037c","Type":"ContainerDied","Data":"87a36196e31b59e8037ae14cbd488ffc96a89a057f572d4d79c907011a8edb9f"} Jun 03 19:31:58.881515 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.881494 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" Jun 03 19:31:58.881630 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.881527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr" event={"ID":"528f64c4-fab7-450e-97f4-8de8b90e6a64","Type":"ContainerDied","Data":"f4faa3d2299e6243803fa8220dcdedee053e92dde9b957a384a6f7dcb6d498d2"} Jun 03 19:31:58.881630 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:58.881570 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4faa3d2299e6243803fa8220dcdedee053e92dde9b957a384a6f7dcb6d498d2" Jun 03 19:31:59.012125 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.012102 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" Jun 03 19:31:59.041770 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.041744 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" Jun 03 19:31:59.064992 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.064962 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6d83b00-ee2d-4304-8227-8f91c44201a5-util\") pod \"f6d83b00-ee2d-4304-8227-8f91c44201a5\" (UID: \"f6d83b00-ee2d-4304-8227-8f91c44201a5\") " Jun 03 19:31:59.065138 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.065007 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f71690e9-045b-463e-aebe-700a1f27af93-bundle\") pod \"f71690e9-045b-463e-aebe-700a1f27af93\" (UID: \"f71690e9-045b-463e-aebe-700a1f27af93\") " Jun 03 19:31:59.065138 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.065079 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h749m\" (UniqueName: \"kubernetes.io/projected/f6d83b00-ee2d-4304-8227-8f91c44201a5-kube-api-access-h749m\") pod \"f6d83b00-ee2d-4304-8227-8f91c44201a5\" (UID: \"f6d83b00-ee2d-4304-8227-8f91c44201a5\") " Jun 03 19:31:59.065264 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.065142 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffsw8\" (UniqueName: \"kubernetes.io/projected/f71690e9-045b-463e-aebe-700a1f27af93-kube-api-access-ffsw8\") pod \"f71690e9-045b-463e-aebe-700a1f27af93\" (UID: \"f71690e9-045b-463e-aebe-700a1f27af93\") " Jun 03 19:31:59.065264 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.065174 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6d83b00-ee2d-4304-8227-8f91c44201a5-bundle\") pod \"f6d83b00-ee2d-4304-8227-8f91c44201a5\" (UID: \"f6d83b00-ee2d-4304-8227-8f91c44201a5\") " Jun 03 19:31:59.065264 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.065213 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f71690e9-045b-463e-aebe-700a1f27af93-util\") pod \"f71690e9-045b-463e-aebe-700a1f27af93\" (UID: \"f71690e9-045b-463e-aebe-700a1f27af93\") " Jun 03 19:31:59.065963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.065929 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f71690e9-045b-463e-aebe-700a1f27af93-bundle" (OuterVolumeSpecName: "bundle") pod "f71690e9-045b-463e-aebe-700a1f27af93" (UID: "f71690e9-045b-463e-aebe-700a1f27af93"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:31:59.066159 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.066120 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d83b00-ee2d-4304-8227-8f91c44201a5-bundle" (OuterVolumeSpecName: "bundle") pod "f6d83b00-ee2d-4304-8227-8f91c44201a5" (UID: "f6d83b00-ee2d-4304-8227-8f91c44201a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:31:59.067438 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.067412 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6d83b00-ee2d-4304-8227-8f91c44201a5-kube-api-access-h749m" (OuterVolumeSpecName: "kube-api-access-h749m") pod "f6d83b00-ee2d-4304-8227-8f91c44201a5" (UID: "f6d83b00-ee2d-4304-8227-8f91c44201a5"). InnerVolumeSpecName "kube-api-access-h749m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:31:59.068128 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.068099 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f71690e9-045b-463e-aebe-700a1f27af93-kube-api-access-ffsw8" (OuterVolumeSpecName: "kube-api-access-ffsw8") pod "f71690e9-045b-463e-aebe-700a1f27af93" (UID: "f71690e9-045b-463e-aebe-700a1f27af93"). InnerVolumeSpecName "kube-api-access-ffsw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:31:59.071110 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.071090 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d83b00-ee2d-4304-8227-8f91c44201a5-util" (OuterVolumeSpecName: "util") pod "f6d83b00-ee2d-4304-8227-8f91c44201a5" (UID: "f6d83b00-ee2d-4304-8227-8f91c44201a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:31:59.071596 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.071578 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f71690e9-045b-463e-aebe-700a1f27af93-util" (OuterVolumeSpecName: "util") pod "f71690e9-045b-463e-aebe-700a1f27af93" (UID: "f71690e9-045b-463e-aebe-700a1f27af93"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:31:59.165888 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.165853 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h749m\" (UniqueName: \"kubernetes.io/projected/f6d83b00-ee2d-4304-8227-8f91c44201a5-kube-api-access-h749m\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:31:59.165888 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.165886 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffsw8\" (UniqueName: \"kubernetes.io/projected/f71690e9-045b-463e-aebe-700a1f27af93-kube-api-access-ffsw8\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:31:59.166130 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.165900 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6d83b00-ee2d-4304-8227-8f91c44201a5-bundle\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:31:59.166130 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.165913 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f71690e9-045b-463e-aebe-700a1f27af93-util\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:31:59.166130 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.165922 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6d83b00-ee2d-4304-8227-8f91c44201a5-util\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:31:59.166130 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.165933 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f71690e9-045b-463e-aebe-700a1f27af93-bundle\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:31:59.892133 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.892105 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" Jun 03 19:31:59.892583 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.892100 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb" event={"ID":"f6d83b00-ee2d-4304-8227-8f91c44201a5","Type":"ContainerDied","Data":"ca987900b6f45321e9d3b317d8719aa2fa7f5a946ad8d7884ac27f14e5729514"} Jun 03 19:31:59.892583 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.892230 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca987900b6f45321e9d3b317d8719aa2fa7f5a946ad8d7884ac27f14e5729514" Jun 03 19:31:59.894122 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.894087 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" Jun 03 19:31:59.894122 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.894104 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw" event={"ID":"f71690e9-045b-463e-aebe-700a1f27af93","Type":"ContainerDied","Data":"d53c9db9a1f2cdd677001f8a5ff10ccb050e52ec05c56ac2fbec79601161038f"} Jun 03 19:31:59.894324 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:31:59.894145 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d53c9db9a1f2cdd677001f8a5ff10ccb050e52ec05c56ac2fbec79601161038f" Jun 03 19:32:00.031440 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:00.031416 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" Jun 03 19:32:00.071625 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:00.071589 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5hjv\" (UniqueName: \"kubernetes.io/projected/c8da761c-5723-4f84-b134-6edc0f8b037c-kube-api-access-f5hjv\") pod \"c8da761c-5723-4f84-b134-6edc0f8b037c\" (UID: \"c8da761c-5723-4f84-b134-6edc0f8b037c\") " Jun 03 19:32:00.071801 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:00.071641 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8da761c-5723-4f84-b134-6edc0f8b037c-util\") pod \"c8da761c-5723-4f84-b134-6edc0f8b037c\" (UID: \"c8da761c-5723-4f84-b134-6edc0f8b037c\") " Jun 03 19:32:00.071801 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:00.071680 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8da761c-5723-4f84-b134-6edc0f8b037c-bundle\") pod \"c8da761c-5723-4f84-b134-6edc0f8b037c\" (UID: \"c8da761c-5723-4f84-b134-6edc0f8b037c\") " Jun 03 19:32:00.072264 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:00.072222 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8da761c-5723-4f84-b134-6edc0f8b037c-bundle" (OuterVolumeSpecName: "bundle") pod "c8da761c-5723-4f84-b134-6edc0f8b037c" (UID: "c8da761c-5723-4f84-b134-6edc0f8b037c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:32:00.073827 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:00.073798 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8da761c-5723-4f84-b134-6edc0f8b037c-kube-api-access-f5hjv" (OuterVolumeSpecName: "kube-api-access-f5hjv") pod "c8da761c-5723-4f84-b134-6edc0f8b037c" (UID: "c8da761c-5723-4f84-b134-6edc0f8b037c"). InnerVolumeSpecName "kube-api-access-f5hjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:32:00.077200 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:00.077178 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8da761c-5723-4f84-b134-6edc0f8b037c-util" (OuterVolumeSpecName: "util") pod "c8da761c-5723-4f84-b134-6edc0f8b037c" (UID: "c8da761c-5723-4f84-b134-6edc0f8b037c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:32:00.172555 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:00.172467 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5hjv\" (UniqueName: \"kubernetes.io/projected/c8da761c-5723-4f84-b134-6edc0f8b037c-kube-api-access-f5hjv\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:32:00.172555 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:00.172496 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8da761c-5723-4f84-b134-6edc0f8b037c-util\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:32:00.172555 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:00.172507 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8da761c-5723-4f84-b134-6edc0f8b037c-bundle\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:32:00.900893 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:00.900864 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" Jun 03 19:32:00.900893 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:00.900880 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl" event={"ID":"c8da761c-5723-4f84-b134-6edc0f8b037c","Type":"ContainerDied","Data":"bc27a96163c811b953bae9f19d55a047c095883a115d6cee96f8c74cd8f4ae0b"} Jun 03 19:32:00.901331 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:00.900920 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc27a96163c811b953bae9f19d55a047c095883a115d6cee96f8c74cd8f4ae0b" Jun 03 19:32:07.237689 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:07.237657 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:10.705736 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:10.705704 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:12.002855 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.002826 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb"] Jun 03 19:32:12.003246 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003185 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6d83b00-ee2d-4304-8227-8f91c44201a5" containerName="util" Jun 03 19:32:12.003246 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003197 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6d83b00-ee2d-4304-8227-8f91c44201a5" containerName="util" Jun 03 19:32:12.003246 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003205 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f71690e9-045b-463e-aebe-700a1f27af93" containerName="extract" Jun 03 19:32:12.003246 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003210 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f71690e9-045b-463e-aebe-700a1f27af93" containerName="extract" Jun 03 19:32:12.003246 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003218 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8da761c-5723-4f84-b134-6edc0f8b037c" containerName="pull" Jun 03 19:32:12.003246 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003223 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8da761c-5723-4f84-b134-6edc0f8b037c" containerName="pull" Jun 03 19:32:12.003246 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003233 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6d83b00-ee2d-4304-8227-8f91c44201a5" containerName="extract" Jun 03 19:32:12.003246 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003239 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6d83b00-ee2d-4304-8227-8f91c44201a5" containerName="extract" Jun 03 19:32:12.003246 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003247 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528f64c4-fab7-450e-97f4-8de8b90e6a64" containerName="util" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003252 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="528f64c4-fab7-450e-97f4-8de8b90e6a64" containerName="util" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003260 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f71690e9-045b-463e-aebe-700a1f27af93" containerName="pull" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003266 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f71690e9-045b-463e-aebe-700a1f27af93" containerName="pull" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003273 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8da761c-5723-4f84-b134-6edc0f8b037c" containerName="extract" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003277 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8da761c-5723-4f84-b134-6edc0f8b037c" containerName="extract" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003286 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528f64c4-fab7-450e-97f4-8de8b90e6a64" containerName="pull" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003291 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="528f64c4-fab7-450e-97f4-8de8b90e6a64" containerName="pull" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003297 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528f64c4-fab7-450e-97f4-8de8b90e6a64" containerName="extract" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003302 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="528f64c4-fab7-450e-97f4-8de8b90e6a64" containerName="extract" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003308 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8da761c-5723-4f84-b134-6edc0f8b037c" containerName="util" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003313 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8da761c-5723-4f84-b134-6edc0f8b037c" containerName="util" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003319 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f71690e9-045b-463e-aebe-700a1f27af93" containerName="util" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003325 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f71690e9-045b-463e-aebe-700a1f27af93" containerName="util" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003330 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6d83b00-ee2d-4304-8227-8f91c44201a5" containerName="pull" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003334 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6d83b00-ee2d-4304-8227-8f91c44201a5" containerName="pull" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003391 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f71690e9-045b-463e-aebe-700a1f27af93" containerName="extract" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003399 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8da761c-5723-4f84-b134-6edc0f8b037c" containerName="extract" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003406 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6d83b00-ee2d-4304-8227-8f91c44201a5" containerName="extract" Jun 03 19:32:12.003527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.003412 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="528f64c4-fab7-450e-97f4-8de8b90e6a64" containerName="extract" Jun 03 19:32:12.009786 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.009770 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:12.013087 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.013055 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rxrjc\"" Jun 03 19:32:12.022390 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.022371 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb"] Jun 03 19:32:12.068120 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.068056 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/803facb2-de4e-4070-95b6-ceb9a0f5a04b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" (UID: \"803facb2-de4e-4070-95b6-ceb9a0f5a04b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:12.068309 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.068200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5psml\" (UniqueName: \"kubernetes.io/projected/803facb2-de4e-4070-95b6-ceb9a0f5a04b-kube-api-access-5psml\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" (UID: \"803facb2-de4e-4070-95b6-ceb9a0f5a04b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:12.168889 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.168856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5psml\" (UniqueName: \"kubernetes.io/projected/803facb2-de4e-4070-95b6-ceb9a0f5a04b-kube-api-access-5psml\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" (UID: \"803facb2-de4e-4070-95b6-ceb9a0f5a04b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:12.169085 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.168901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/803facb2-de4e-4070-95b6-ceb9a0f5a04b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" (UID: \"803facb2-de4e-4070-95b6-ceb9a0f5a04b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:12.169257 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.169241 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/803facb2-de4e-4070-95b6-ceb9a0f5a04b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" (UID: \"803facb2-de4e-4070-95b6-ceb9a0f5a04b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:12.179402 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.179378 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5psml\" (UniqueName: \"kubernetes.io/projected/803facb2-de4e-4070-95b6-ceb9a0f5a04b-kube-api-access-5psml\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" (UID: \"803facb2-de4e-4070-95b6-ceb9a0f5a04b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:12.289766 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.289663 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:12.320439 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.320404 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:12.481132 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.481098 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb"] Jun 03 19:32:12.482564 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:32:12.482539 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803facb2_de4e_4070_95b6_ceb9a0f5a04b.slice/crio-45189f928243ba5ccd63c9a2ea3eea797e49c509f8118503edfeba7d12ea71bc WatchSource:0}: Error finding container 45189f928243ba5ccd63c9a2ea3eea797e49c509f8118503edfeba7d12ea71bc: Status 404 returned error can't find the container with id 45189f928243ba5ccd63c9a2ea3eea797e49c509f8118503edfeba7d12ea71bc Jun 03 19:32:12.643498 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.643462 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:12.966842 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:12.966749 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" event={"ID":"803facb2-de4e-4070-95b6-ceb9a0f5a04b","Type":"ContainerStarted","Data":"45189f928243ba5ccd63c9a2ea3eea797e49c509f8118503edfeba7d12ea71bc"} Jun 03 19:32:13.712005 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:13.711970 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:13.852498 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:13.852463 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:15.271585 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:15.271553 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:15.365728 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:15.365674 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:16.802263 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:16.802230 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zslbh"] Jun 03 19:32:16.806804 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:16.806771 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zslbh" Jun 03 19:32:16.810545 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:16.810518 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8mhf7\"" Jun 03 19:32:16.811475 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:16.811455 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 19:32:16.830152 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:16.830113 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zslbh"] Jun 03 19:32:16.910464 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:16.910430 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vdn4\" (UniqueName: \"kubernetes.io/projected/e802d89c-afdb-410b-96fd-e22a55ba7b18-kube-api-access-6vdn4\") pod \"dns-operator-controller-manager-864dd78c4c-zslbh\" (UID: \"e802d89c-afdb-410b-96fd-e22a55ba7b18\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zslbh" Jun 03 19:32:17.011969 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:17.011930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vdn4\" (UniqueName: \"kubernetes.io/projected/e802d89c-afdb-410b-96fd-e22a55ba7b18-kube-api-access-6vdn4\") pod \"dns-operator-controller-manager-864dd78c4c-zslbh\" (UID: \"e802d89c-afdb-410b-96fd-e22a55ba7b18\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zslbh" Jun 03 19:32:17.022002 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:17.021959 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vdn4\" (UniqueName: \"kubernetes.io/projected/e802d89c-afdb-410b-96fd-e22a55ba7b18-kube-api-access-6vdn4\") pod \"dns-operator-controller-manager-864dd78c4c-zslbh\" (UID: \"e802d89c-afdb-410b-96fd-e22a55ba7b18\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zslbh" Jun 03 19:32:17.118995 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:17.118900 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zslbh" Jun 03 19:32:17.443924 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:17.443889 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:17.972398 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:17.972363 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zslbh"] Jun 03 19:32:17.973453 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:32:17.973423 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode802d89c_afdb_410b_96fd_e22a55ba7b18.slice/crio-c3265223788e1f41cccf80c312dd1273368af097c2a19bf6ee34de3fac18915f WatchSource:0}: Error finding container c3265223788e1f41cccf80c312dd1273368af097c2a19bf6ee34de3fac18915f: Status 404 returned error can't find the container with id c3265223788e1f41cccf80c312dd1273368af097c2a19bf6ee34de3fac18915f Jun 03 19:32:17.998186 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:17.998150 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" event={"ID":"803facb2-de4e-4070-95b6-ceb9a0f5a04b","Type":"ContainerStarted","Data":"d3cce7a40a24a819f42f6c5c58a03818af20cf91f8080b41b17c5633a668ff58"} Jun 03 19:32:17.998361 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:17.998345 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:17.999420 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:17.999400 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zslbh" event={"ID":"e802d89c-afdb-410b-96fd-e22a55ba7b18","Type":"ContainerStarted","Data":"c3265223788e1f41cccf80c312dd1273368af097c2a19bf6ee34de3fac18915f"} Jun 03 19:32:18.021793 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:18.021742 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" podStartSLOduration=1.602241595 podStartE2EDuration="7.021724923s" totalImagesPullingTime="5.419483328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:32:18.019710764 +0000 UTC m=+683.173510744" watchObservedRunningTime="2026-06-03 19:32:18.021724923 +0000 UTC m=+683.175524903" Jun 03 19:32:18.899520 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:18.899491 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf"] Jun 03 19:32:18.909490 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:18.909453 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:18.913239 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:18.913207 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wzpng\"" Jun 03 19:32:18.913518 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:18.913495 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf"] Jun 03 19:32:19.029381 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:19.029352 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrwmk\" (UniqueName: \"kubernetes.io/projected/e0dfc250-8bef-43c5-ab53-d6dc4708e8fa-kube-api-access-hrwmk\") pod \"limitador-operator-controller-manager-859d7b78bd-5b8cf\" (UID: \"e0dfc250-8bef-43c5-ab53-d6dc4708e8fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:19.130700 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:19.130661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrwmk\" (UniqueName: \"kubernetes.io/projected/e0dfc250-8bef-43c5-ab53-d6dc4708e8fa-kube-api-access-hrwmk\") pod \"limitador-operator-controller-manager-859d7b78bd-5b8cf\" (UID: \"e0dfc250-8bef-43c5-ab53-d6dc4708e8fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:19.140944 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:19.140918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrwmk\" (UniqueName: \"kubernetes.io/projected/e0dfc250-8bef-43c5-ab53-d6dc4708e8fa-kube-api-access-hrwmk\") pod \"limitador-operator-controller-manager-859d7b78bd-5b8cf\" (UID: \"e0dfc250-8bef-43c5-ab53-d6dc4708e8fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:19.221994 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:19.221905 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:19.306656 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:19.306621 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:19.384453 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:19.384422 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf"] Jun 03 19:32:19.384577 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:32:19.384421 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0dfc250_8bef_43c5_ab53_d6dc4708e8fa.slice/crio-569bfcafd6dc39c1cb4fa16addf4e934b3b71107d72512dfbf59eef49b2a24fa WatchSource:0}: Error finding container 569bfcafd6dc39c1cb4fa16addf4e934b3b71107d72512dfbf59eef49b2a24fa: Status 404 returned error can't find the container with id 569bfcafd6dc39c1cb4fa16addf4e934b3b71107d72512dfbf59eef49b2a24fa Jun 03 19:32:20.014940 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:20.014899 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" event={"ID":"e0dfc250-8bef-43c5-ab53-d6dc4708e8fa","Type":"ContainerStarted","Data":"569bfcafd6dc39c1cb4fa16addf4e934b3b71107d72512dfbf59eef49b2a24fa"} Jun 03 19:32:20.962629 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:20.962589 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:21.023139 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:21.023106 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zslbh" event={"ID":"e802d89c-afdb-410b-96fd-e22a55ba7b18","Type":"ContainerStarted","Data":"e1da244aa35bd3596057949c08a49ed7ecb7e198ebda6c665f87f36ac2d1d6a3"} Jun 03 19:32:21.023486 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:21.023199 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zslbh" Jun 03 19:32:21.044807 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:21.044752 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zslbh" podStartSLOduration=2.411549563 podStartE2EDuration="5.044736351s" totalImagesPullingTime="2.633186788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:32:21.044082893 +0000 UTC m=+686.197882867" watchObservedRunningTime="2026-06-03 19:32:21.044736351 +0000 UTC m=+686.198536330" Jun 03 19:32:21.048947 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:21.048914 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:21.203055 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:21.203019 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:21.295412 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:21.295327 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:22.029979 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:22.029933 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" event={"ID":"e0dfc250-8bef-43c5-ab53-d6dc4708e8fa","Type":"ContainerStarted","Data":"14fae6c83383984a58cf941f91a38c04d29a7662cae0eaeb93a7cbcd7082e87d"} Jun 03 19:32:22.030424 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:22.030269 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:22.059864 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:22.059815 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" podStartSLOduration=2.365148915 podStartE2EDuration="4.059801328s" totalImagesPullingTime="1.694652413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:32:22.057399559 +0000 UTC m=+687.211199550" watchObservedRunningTime="2026-06-03 19:32:22.059801328 +0000 UTC m=+687.213601307" Jun 03 19:32:25.848200 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:25.848163 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:25.909658 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:25.909623 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:29.008714 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:29.008677 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:30.310803 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.310760 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:30.413687 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.413652 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:30.669221 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.669185 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb"] Jun 03 19:32:30.669418 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.669395 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" containerName="manager" containerID="cri-o://d3cce7a40a24a819f42f6c5c58a03818af20cf91f8080b41b17c5633a668ff58" gracePeriod=2 Jun 03 19:32:30.681813 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.681788 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb"] Jun 03 19:32:30.709895 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.709859 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf"] Jun 03 19:32:30.710219 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.710188 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" containerName="manager" containerID="cri-o://14fae6c83383984a58cf941f91a38c04d29a7662cae0eaeb93a7cbcd7082e87d" gracePeriod=2 Jun 03 19:32:30.712576 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.712551 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:30.716976 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:30.716938 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:30.718924 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.718900 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf"] Jun 03 19:32:30.720459 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:30.720432 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5b8cf\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:30.725267 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:30.725239 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:30.728269 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:30.728244 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5b8cf\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:30.773481 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.773444 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljj6g"] Jun 03 19:32:30.774006 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.773986 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" containerName="manager" Jun 03 19:32:30.774134 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.774009 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" containerName="manager" Jun 03 19:32:30.774134 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.774028 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" containerName="manager" Jun 03 19:32:30.774134 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.774038 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" containerName="manager" Jun 03 19:32:30.774278 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.774173 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" containerName="manager" Jun 03 19:32:30.774278 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.774191 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" containerName="manager" Jun 03 19:32:30.777821 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.777793 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs"] Jun 03 19:32:30.777950 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.777925 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljj6g" Jun 03 19:32:30.781614 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:30.781589 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:30.781695 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.781620 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" Jun 03 19:32:30.784573 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:30.784550 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5b8cf\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:30.794214 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.794192 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljj6g"] Jun 03 19:32:30.804807 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.804782 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs"] Jun 03 19:32:30.833541 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:30.833499 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:30.837758 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:30.837719 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5b8cf\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:30.837990 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.837961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e56d81-4f20-43f7-bc28-9c1250f55daf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8xrcs\" (UID: \"72e56d81-4f20-43f7-bc28-9c1250f55daf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" Jun 03 19:32:30.838102 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.838033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqlpw\" (UniqueName: \"kubernetes.io/projected/72e56d81-4f20-43f7-bc28-9c1250f55daf-kube-api-access-wqlpw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8xrcs\" (UID: \"72e56d81-4f20-43f7-bc28-9c1250f55daf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" Jun 03 19:32:30.838102 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.838079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhdsd\" (UniqueName: \"kubernetes.io/projected/7b670adf-8933-4750-be87-6d07fee2ac9d-kube-api-access-vhdsd\") pod \"limitador-operator-controller-manager-859d7b78bd-ljj6g\" (UID: \"7b670adf-8933-4750-be87-6d07fee2ac9d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljj6g" Jun 03 19:32:30.938820 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.938786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqlpw\" (UniqueName: \"kubernetes.io/projected/72e56d81-4f20-43f7-bc28-9c1250f55daf-kube-api-access-wqlpw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8xrcs\" (UID: \"72e56d81-4f20-43f7-bc28-9c1250f55daf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" Jun 03 19:32:30.938945 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.938849 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhdsd\" (UniqueName: \"kubernetes.io/projected/7b670adf-8933-4750-be87-6d07fee2ac9d-kube-api-access-vhdsd\") pod \"limitador-operator-controller-manager-859d7b78bd-ljj6g\" (UID: \"7b670adf-8933-4750-be87-6d07fee2ac9d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljj6g" Jun 03 19:32:30.938945 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.938916 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e56d81-4f20-43f7-bc28-9c1250f55daf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8xrcs\" (UID: \"72e56d81-4f20-43f7-bc28-9c1250f55daf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" Jun 03 19:32:30.939394 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.939368 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e56d81-4f20-43f7-bc28-9c1250f55daf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8xrcs\" (UID: \"72e56d81-4f20-43f7-bc28-9c1250f55daf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" Jun 03 19:32:30.961299 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.961270 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhdsd\" (UniqueName: \"kubernetes.io/projected/7b670adf-8933-4750-be87-6d07fee2ac9d-kube-api-access-vhdsd\") pod \"limitador-operator-controller-manager-859d7b78bd-ljj6g\" (UID: \"7b670adf-8933-4750-be87-6d07fee2ac9d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljj6g" Jun 03 19:32:30.961407 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.961345 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqlpw\" (UniqueName: \"kubernetes.io/projected/72e56d81-4f20-43f7-bc28-9c1250f55daf-kube-api-access-wqlpw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8xrcs\" (UID: \"72e56d81-4f20-43f7-bc28-9c1250f55daf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" Jun 03 19:32:30.963188 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.963168 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:30.965772 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:30.965753 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:30.966103 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:30.966077 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:30.969039 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:30.969012 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5b8cf\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:30.971814 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:30.971794 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:30.976159 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:30.976142 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5b8cf\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:31.039677 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.039651 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrwmk\" (UniqueName: \"kubernetes.io/projected/e0dfc250-8bef-43c5-ab53-d6dc4708e8fa-kube-api-access-hrwmk\") pod \"e0dfc250-8bef-43c5-ab53-d6dc4708e8fa\" (UID: \"e0dfc250-8bef-43c5-ab53-d6dc4708e8fa\") " Jun 03 19:32:31.039812 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.039698 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5psml\" (UniqueName: \"kubernetes.io/projected/803facb2-de4e-4070-95b6-ceb9a0f5a04b-kube-api-access-5psml\") pod \"803facb2-de4e-4070-95b6-ceb9a0f5a04b\" (UID: \"803facb2-de4e-4070-95b6-ceb9a0f5a04b\") " Jun 03 19:32:31.039812 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.039747 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/803facb2-de4e-4070-95b6-ceb9a0f5a04b-extensions-socket-volume\") pod \"803facb2-de4e-4070-95b6-ceb9a0f5a04b\" (UID: \"803facb2-de4e-4070-95b6-ceb9a0f5a04b\") " Jun 03 19:32:31.040304 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.040280 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803facb2-de4e-4070-95b6-ceb9a0f5a04b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "803facb2-de4e-4070-95b6-ceb9a0f5a04b" (UID: "803facb2-de4e-4070-95b6-ceb9a0f5a04b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:32:31.041810 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.041788 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0dfc250-8bef-43c5-ab53-d6dc4708e8fa-kube-api-access-hrwmk" (OuterVolumeSpecName: "kube-api-access-hrwmk") pod "e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" (UID: "e0dfc250-8bef-43c5-ab53-d6dc4708e8fa"). InnerVolumeSpecName "kube-api-access-hrwmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:32:31.041865 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.041812 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803facb2-de4e-4070-95b6-ceb9a0f5a04b-kube-api-access-5psml" (OuterVolumeSpecName: "kube-api-access-5psml") pod "803facb2-de4e-4070-95b6-ceb9a0f5a04b" (UID: "803facb2-de4e-4070-95b6-ceb9a0f5a04b"). InnerVolumeSpecName "kube-api-access-5psml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:32:31.079247 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.079216 2577 generic.go:356] "Generic (PLEG): container finished" podID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" containerID="14fae6c83383984a58cf941f91a38c04d29a7662cae0eaeb93a7cbcd7082e87d" exitCode=0 Jun 03 19:32:31.079356 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.079276 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:31.079356 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.079316 2577 scope.go:117] "RemoveContainer" containerID="14fae6c83383984a58cf941f91a38c04d29a7662cae0eaeb93a7cbcd7082e87d" Jun 03 19:32:31.080815 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.080792 2577 generic.go:356] "Generic (PLEG): container finished" podID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" containerID="d3cce7a40a24a819f42f6c5c58a03818af20cf91f8080b41b17c5633a668ff58" exitCode=0 Jun 03 19:32:31.080920 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.080901 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:31.082513 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:31.082483 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:31.085192 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:31.085165 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5b8cf\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:31.087795 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:31.087764 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:31.089480 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.089464 2577 scope.go:117] "RemoveContainer" containerID="14fae6c83383984a58cf941f91a38c04d29a7662cae0eaeb93a7cbcd7082e87d" Jun 03 19:32:31.089760 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:31.089739 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14fae6c83383984a58cf941f91a38c04d29a7662cae0eaeb93a7cbcd7082e87d\": container with ID starting with 14fae6c83383984a58cf941f91a38c04d29a7662cae0eaeb93a7cbcd7082e87d not found: ID does not exist" containerID="14fae6c83383984a58cf941f91a38c04d29a7662cae0eaeb93a7cbcd7082e87d" Jun 03 19:32:31.089834 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.089764 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14fae6c83383984a58cf941f91a38c04d29a7662cae0eaeb93a7cbcd7082e87d"} err="failed to get container status \"14fae6c83383984a58cf941f91a38c04d29a7662cae0eaeb93a7cbcd7082e87d\": rpc error: code = NotFound desc = could not find container \"14fae6c83383984a58cf941f91a38c04d29a7662cae0eaeb93a7cbcd7082e87d\": container with ID starting with 14fae6c83383984a58cf941f91a38c04d29a7662cae0eaeb93a7cbcd7082e87d not found: ID does not exist" Jun 03 19:32:31.089834 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.089782 2577 scope.go:117] "RemoveContainer" containerID="d3cce7a40a24a819f42f6c5c58a03818af20cf91f8080b41b17c5633a668ff58" Jun 03 19:32:31.090725 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:31.090679 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5b8cf\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:31.093415 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:31.093387 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:31.095777 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:31.095755 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5b8cf\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:31.097829 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.097814 2577 scope.go:117] "RemoveContainer" containerID="d3cce7a40a24a819f42f6c5c58a03818af20cf91f8080b41b17c5633a668ff58" Jun 03 19:32:31.098056 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:31.098038 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3cce7a40a24a819f42f6c5c58a03818af20cf91f8080b41b17c5633a668ff58\": container with ID starting with d3cce7a40a24a819f42f6c5c58a03818af20cf91f8080b41b17c5633a668ff58 not found: ID does not exist" containerID="d3cce7a40a24a819f42f6c5c58a03818af20cf91f8080b41b17c5633a668ff58" Jun 03 19:32:31.098136 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.098112 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3cce7a40a24a819f42f6c5c58a03818af20cf91f8080b41b17c5633a668ff58"} err="failed to get container status \"d3cce7a40a24a819f42f6c5c58a03818af20cf91f8080b41b17c5633a668ff58\": rpc error: code = NotFound desc = could not find container \"d3cce7a40a24a819f42f6c5c58a03818af20cf91f8080b41b17c5633a668ff58\": container with ID starting with d3cce7a40a24a819f42f6c5c58a03818af20cf91f8080b41b17c5633a668ff58 not found: ID does not exist" Jun 03 19:32:31.098325 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:31.098308 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nfcgb\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nfcgb" Jun 03 19:32:31.100797 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:31.100777 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5b8cf\" is forbidden: User \"system:node:ip-10-0-137-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-13.ec2.internal' and this object" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5b8cf" Jun 03 19:32:31.106983 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.106966 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljj6g" Jun 03 19:32:31.113042 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.113025 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" Jun 03 19:32:31.140915 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.140885 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrwmk\" (UniqueName: \"kubernetes.io/projected/e0dfc250-8bef-43c5-ab53-d6dc4708e8fa-kube-api-access-hrwmk\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:32:31.140915 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.140913 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5psml\" (UniqueName: \"kubernetes.io/projected/803facb2-de4e-4070-95b6-ceb9a0f5a04b-kube-api-access-5psml\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:32:31.141155 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.140926 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/803facb2-de4e-4070-95b6-ceb9a0f5a04b-extensions-socket-volume\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:32:31.248071 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.248025 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljj6g"] Jun 03 19:32:31.248295 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:32:31.248273 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b670adf_8933_4750_be87_6d07fee2ac9d.slice/crio-ebe108201374174f26ea3466347435b70bc5eed6b310fd1440cc650458db4cf2 WatchSource:0}: Error finding container ebe108201374174f26ea3466347435b70bc5eed6b310fd1440cc650458db4cf2: Status 404 returned error can't find the container with id ebe108201374174f26ea3466347435b70bc5eed6b310fd1440cc650458db4cf2 Jun 03 19:32:31.267087 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.267050 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs"] Jun 03 19:32:31.268534 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:32:31.268504 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e56d81_4f20_43f7_bc28_9c1250f55daf.slice/crio-fc57e443ae818060a1172340e4dad183d9d497c46bc9f347dbf731f6857e95fd WatchSource:0}: Error finding container fc57e443ae818060a1172340e4dad183d9d497c46bc9f347dbf731f6857e95fd: Status 404 returned error can't find the container with id fc57e443ae818060a1172340e4dad183d9d497c46bc9f347dbf731f6857e95fd Jun 03 19:32:31.280962 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.280940 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="803facb2-de4e-4070-95b6-ceb9a0f5a04b" path="/var/lib/kubelet/pods/803facb2-de4e-4070-95b6-ceb9a0f5a04b/volumes" Jun 03 19:32:31.281295 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:31.281279 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0dfc250-8bef-43c5-ab53-d6dc4708e8fa" path="/var/lib/kubelet/pods/e0dfc250-8bef-43c5-ab53-d6dc4708e8fa/volumes" Jun 03 19:32:32.032569 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.032487 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zslbh" Jun 03 19:32:32.090353 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.090321 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljj6g" event={"ID":"7b670adf-8933-4750-be87-6d07fee2ac9d","Type":"ContainerStarted","Data":"981dd04b58a0cba8a6605a05326cb5490be0cf01eacf58e6d06a1fd59a73fdf7"} Jun 03 19:32:32.090554 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.090380 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljj6g" event={"ID":"7b670adf-8933-4750-be87-6d07fee2ac9d","Type":"ContainerStarted","Data":"ebe108201374174f26ea3466347435b70bc5eed6b310fd1440cc650458db4cf2"} Jun 03 19:32:32.090554 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.090413 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljj6g" Jun 03 19:32:32.091841 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.091816 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" event={"ID":"72e56d81-4f20-43f7-bc28-9c1250f55daf","Type":"ContainerStarted","Data":"467c7a2ca8a68a0893786e9faedd5b2fbcc02df3e8e18179f8faba8492460e07"} Jun 03 19:32:32.091939 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.091858 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" event={"ID":"72e56d81-4f20-43f7-bc28-9c1250f55daf","Type":"ContainerStarted","Data":"fc57e443ae818060a1172340e4dad183d9d497c46bc9f347dbf731f6857e95fd"} Jun 03 19:32:32.091939 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.091886 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" Jun 03 19:32:32.134485 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.134435 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljj6g" podStartSLOduration=2.13441862 podStartE2EDuration="2.13441862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:32:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:32:32.128444096 +0000 UTC m=+697.282244078" watchObservedRunningTime="2026-06-03 19:32:32.13441862 +0000 UTC m=+697.288218599" Jun 03 19:32:32.166519 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.166485 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84"] Jun 03 19:32:32.171314 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.171293 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" Jun 03 19:32:32.196659 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.196617 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" podStartSLOduration=2.196604241 podStartE2EDuration="2.196604241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:32:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:32:32.177594519 +0000 UTC m=+697.331394499" watchObservedRunningTime="2026-06-03 19:32:32.196604241 +0000 UTC m=+697.350404221" Jun 03 19:32:32.197127 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.197112 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84"] Jun 03 19:32:32.251709 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.251676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qnmq\" (UniqueName: \"kubernetes.io/projected/e18ddecc-d406-4acc-a6de-121a8087d16e-kube-api-access-6qnmq\") pod \"kuadrant-operator-controller-manager-86878c769f-l2v84\" (UID: \"e18ddecc-d406-4acc-a6de-121a8087d16e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" Jun 03 19:32:32.251850 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.251717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18ddecc-d406-4acc-a6de-121a8087d16e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l2v84\" (UID: \"e18ddecc-d406-4acc-a6de-121a8087d16e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" Jun 03 19:32:32.353165 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.353083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qnmq\" (UniqueName: \"kubernetes.io/projected/e18ddecc-d406-4acc-a6de-121a8087d16e-kube-api-access-6qnmq\") pod \"kuadrant-operator-controller-manager-86878c769f-l2v84\" (UID: \"e18ddecc-d406-4acc-a6de-121a8087d16e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" Jun 03 19:32:32.353165 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.353121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18ddecc-d406-4acc-a6de-121a8087d16e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l2v84\" (UID: \"e18ddecc-d406-4acc-a6de-121a8087d16e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" Jun 03 19:32:32.353447 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.353431 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18ddecc-d406-4acc-a6de-121a8087d16e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l2v84\" (UID: \"e18ddecc-d406-4acc-a6de-121a8087d16e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" Jun 03 19:32:32.368750 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.368721 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qnmq\" (UniqueName: \"kubernetes.io/projected/e18ddecc-d406-4acc-a6de-121a8087d16e-kube-api-access-6qnmq\") pod \"kuadrant-operator-controller-manager-86878c769f-l2v84\" (UID: \"e18ddecc-d406-4acc-a6de-121a8087d16e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" Jun 03 19:32:32.480983 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.480950 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" Jun 03 19:32:32.493947 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.493913 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:32.643696 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.643663 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84"] Jun 03 19:32:32.645793 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:32:32.645763 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode18ddecc_d406_4acc_a6de_121a8087d16e.slice/crio-45097c246570c538177f1a72e21bd2eed522338fd994140ffdf6fde1e4db7c03 WatchSource:0}: Error finding container 45097c246570c538177f1a72e21bd2eed522338fd994140ffdf6fde1e4db7c03: Status 404 returned error can't find the container with id 45097c246570c538177f1a72e21bd2eed522338fd994140ffdf6fde1e4db7c03 Jun 03 19:32:32.847618 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.847579 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:32.983011 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:32.982927 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:33.099041 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:33.098996 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" event={"ID":"e18ddecc-d406-4acc-a6de-121a8087d16e","Type":"ContainerStarted","Data":"145aa86d47100be6e0c7cfba204813fd3e54c07f72be1f2289e42fb508e0e45e"} Jun 03 19:32:33.099439 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:33.099165 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" Jun 03 19:32:33.099439 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:33.099208 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" event={"ID":"e18ddecc-d406-4acc-a6de-121a8087d16e","Type":"ContainerStarted","Data":"45097c246570c538177f1a72e21bd2eed522338fd994140ffdf6fde1e4db7c03"} Jun 03 19:32:33.129969 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:33.129912 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" podStartSLOduration=1.129897115 podStartE2EDuration="1.129897115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:32:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:32:33.127504737 +0000 UTC m=+698.281304729" watchObservedRunningTime="2026-06-03 19:32:33.129897115 +0000 UTC m=+698.283697162" Jun 03 19:32:36.546933 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:36.546896 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:36.648206 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:36.648168 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:37.486539 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:37.486501 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:37.583692 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:37.583606 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:41.264894 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:41.264859 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:41.350142 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:41.350110 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:43.101497 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:43.101423 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" Jun 03 19:32:43.101977 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:43.101573 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljj6g" Jun 03 19:32:44.106889 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:44.106860 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" Jun 03 19:32:44.170624 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:44.170587 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs"] Jun 03 19:32:44.170878 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:44.170852 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" podUID="72e56d81-4f20-43f7-bc28-9c1250f55daf" containerName="manager" containerID="cri-o://467c7a2ca8a68a0893786e9faedd5b2fbcc02df3e8e18179f8faba8492460e07" gracePeriod=10 Jun 03 19:32:44.423291 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:44.423265 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" Jun 03 19:32:44.561634 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:44.561605 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e56d81-4f20-43f7-bc28-9c1250f55daf-extensions-socket-volume\") pod \"72e56d81-4f20-43f7-bc28-9c1250f55daf\" (UID: \"72e56d81-4f20-43f7-bc28-9c1250f55daf\") " Jun 03 19:32:44.561805 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:44.561655 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqlpw\" (UniqueName: \"kubernetes.io/projected/72e56d81-4f20-43f7-bc28-9c1250f55daf-kube-api-access-wqlpw\") pod \"72e56d81-4f20-43f7-bc28-9c1250f55daf\" (UID: \"72e56d81-4f20-43f7-bc28-9c1250f55daf\") " Jun 03 19:32:44.561986 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:44.561962 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e56d81-4f20-43f7-bc28-9c1250f55daf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "72e56d81-4f20-43f7-bc28-9c1250f55daf" (UID: "72e56d81-4f20-43f7-bc28-9c1250f55daf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:32:44.563688 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:44.563666 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72e56d81-4f20-43f7-bc28-9c1250f55daf-kube-api-access-wqlpw" (OuterVolumeSpecName: "kube-api-access-wqlpw") pod "72e56d81-4f20-43f7-bc28-9c1250f55daf" (UID: "72e56d81-4f20-43f7-bc28-9c1250f55daf"). InnerVolumeSpecName "kube-api-access-wqlpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:32:44.662918 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:44.662827 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e56d81-4f20-43f7-bc28-9c1250f55daf-extensions-socket-volume\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:32:44.662918 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:44.662863 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqlpw\" (UniqueName: \"kubernetes.io/projected/72e56d81-4f20-43f7-bc28-9c1250f55daf-kube-api-access-wqlpw\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:32:45.170963 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:45.170916 2577 generic.go:356] "Generic (PLEG): container finished" podID="72e56d81-4f20-43f7-bc28-9c1250f55daf" containerID="467c7a2ca8a68a0893786e9faedd5b2fbcc02df3e8e18179f8faba8492460e07" exitCode=0 Jun 03 19:32:45.171416 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:45.170982 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" Jun 03 19:32:45.171416 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:45.171004 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" event={"ID":"72e56d81-4f20-43f7-bc28-9c1250f55daf","Type":"ContainerDied","Data":"467c7a2ca8a68a0893786e9faedd5b2fbcc02df3e8e18179f8faba8492460e07"} Jun 03 19:32:45.171416 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:45.171057 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs" event={"ID":"72e56d81-4f20-43f7-bc28-9c1250f55daf","Type":"ContainerDied","Data":"fc57e443ae818060a1172340e4dad183d9d497c46bc9f347dbf731f6857e95fd"} Jun 03 19:32:45.171416 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:45.171091 2577 scope.go:117] "RemoveContainer" containerID="467c7a2ca8a68a0893786e9faedd5b2fbcc02df3e8e18179f8faba8492460e07" Jun 03 19:32:45.180280 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:45.180264 2577 scope.go:117] "RemoveContainer" containerID="467c7a2ca8a68a0893786e9faedd5b2fbcc02df3e8e18179f8faba8492460e07" Jun 03 19:32:45.180511 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:32:45.180493 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"467c7a2ca8a68a0893786e9faedd5b2fbcc02df3e8e18179f8faba8492460e07\": container with ID starting with 467c7a2ca8a68a0893786e9faedd5b2fbcc02df3e8e18179f8faba8492460e07 not found: ID does not exist" containerID="467c7a2ca8a68a0893786e9faedd5b2fbcc02df3e8e18179f8faba8492460e07" Jun 03 19:32:45.180575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:45.180517 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"467c7a2ca8a68a0893786e9faedd5b2fbcc02df3e8e18179f8faba8492460e07"} err="failed to get container status \"467c7a2ca8a68a0893786e9faedd5b2fbcc02df3e8e18179f8faba8492460e07\": rpc error: code = NotFound desc = could not find container \"467c7a2ca8a68a0893786e9faedd5b2fbcc02df3e8e18179f8faba8492460e07\": container with ID starting with 467c7a2ca8a68a0893786e9faedd5b2fbcc02df3e8e18179f8faba8492460e07 not found: ID does not exist" Jun 03 19:32:45.199877 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:45.199848 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs"] Jun 03 19:32:45.207219 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:45.207197 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8xrcs"] Jun 03 19:32:45.279093 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:45.279054 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72e56d81-4f20-43f7-bc28-9c1250f55daf" path="/var/lib/kubelet/pods/72e56d81-4f20-43f7-bc28-9c1250f55daf/volumes" Jun 03 19:32:49.970636 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:49.970598 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:50.070760 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:50.070719 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:51.977285 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:51.977250 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:52.479088 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:52.479030 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:52.553892 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:52.553862 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:52.677254 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:52.677210 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:57.175370 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:57.175330 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:57.276301 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:32:57.276268 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:00.499731 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:00.499700 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:00.601286 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:00.601246 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:01.235995 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:01.235954 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:01.333133 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:01.333102 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:04.515751 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:04.515714 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:06.932984 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:06.932951 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:07.035612 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.035584 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:07.133354 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.133326 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:07.212976 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.212891 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:33:07.213310 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.213296 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e56d81-4f20-43f7-bc28-9c1250f55daf" containerName="manager" Jun 03 19:33:07.213367 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.213313 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e56d81-4f20-43f7-bc28-9c1250f55daf" containerName="manager" Jun 03 19:33:07.213405 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.213397 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="72e56d81-4f20-43f7-bc28-9c1250f55daf" containerName="manager" Jun 03 19:33:07.216731 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.216711 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-r2xf6" Jun 03 19:33:07.219743 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.219725 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 19:33:07.219843 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.219787 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dmfm7\"" Jun 03 19:33:07.225180 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.225154 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:33:07.256667 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.256635 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:33:07.260475 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.260450 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvckp\" (UniqueName: \"kubernetes.io/projected/8507314b-cc3c-4ba8-955f-4ca95e423950-kube-api-access-bvckp\") pod \"limitador-limitador-54d6d988d5-r2xf6\" (UID: \"8507314b-cc3c-4ba8-955f-4ca95e423950\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-r2xf6" Jun 03 19:33:07.260604 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.260498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8507314b-cc3c-4ba8-955f-4ca95e423950-config-file\") pod \"limitador-limitador-54d6d988d5-r2xf6\" (UID: \"8507314b-cc3c-4ba8-955f-4ca95e423950\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-r2xf6" Jun 03 19:33:07.362010 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.361976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvckp\" (UniqueName: \"kubernetes.io/projected/8507314b-cc3c-4ba8-955f-4ca95e423950-kube-api-access-bvckp\") pod \"limitador-limitador-54d6d988d5-r2xf6\" (UID: \"8507314b-cc3c-4ba8-955f-4ca95e423950\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-r2xf6" Jun 03 19:33:07.362190 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.362015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8507314b-cc3c-4ba8-955f-4ca95e423950-config-file\") pod \"limitador-limitador-54d6d988d5-r2xf6\" (UID: \"8507314b-cc3c-4ba8-955f-4ca95e423950\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-r2xf6" Jun 03 19:33:07.362640 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.362621 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8507314b-cc3c-4ba8-955f-4ca95e423950-config-file\") pod \"limitador-limitador-54d6d988d5-r2xf6\" (UID: \"8507314b-cc3c-4ba8-955f-4ca95e423950\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-r2xf6" Jun 03 19:33:07.374103 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.374074 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvckp\" (UniqueName: \"kubernetes.io/projected/8507314b-cc3c-4ba8-955f-4ca95e423950-kube-api-access-bvckp\") pod \"limitador-limitador-54d6d988d5-r2xf6\" (UID: \"8507314b-cc3c-4ba8-955f-4ca95e423950\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-r2xf6" Jun 03 19:33:07.528685 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.528598 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-r2xf6" Jun 03 19:33:07.662475 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.662447 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:33:07.663505 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:33:07.663483 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8507314b_cc3c_4ba8_955f_4ca95e423950.slice/crio-07582991a7d0ff2e73c0ee3e45013e0c4e84f303ed1c4045e08cfefe6cd68bdd WatchSource:0}: Error finding container 07582991a7d0ff2e73c0ee3e45013e0c4e84f303ed1c4045e08cfefe6cd68bdd: Status 404 returned error can't find the container with id 07582991a7d0ff2e73c0ee3e45013e0c4e84f303ed1c4045e08cfefe6cd68bdd Jun 03 19:33:07.778011 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.777973 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:07.854893 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.854814 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:07.859893 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.859871 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-kt5jm"] Jun 03 19:33:07.864506 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.864491 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kt5jm" Jun 03 19:33:07.867934 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.867911 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-spck8\"" Jun 03 19:33:07.870175 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.870155 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kt5jm"] Jun 03 19:33:07.968279 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:07.968243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w2vs\" (UniqueName: \"kubernetes.io/projected/a8088a2a-5725-4562-94ad-e59be38c69d7-kube-api-access-6w2vs\") pod \"authorino-75d556bd77-kt5jm\" (UID: \"a8088a2a-5725-4562-94ad-e59be38c69d7\") " pod="kuadrant-system/authorino-75d556bd77-kt5jm" Jun 03 19:33:08.069453 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:08.069421 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w2vs\" (UniqueName: \"kubernetes.io/projected/a8088a2a-5725-4562-94ad-e59be38c69d7-kube-api-access-6w2vs\") pod \"authorino-75d556bd77-kt5jm\" (UID: \"a8088a2a-5725-4562-94ad-e59be38c69d7\") " pod="kuadrant-system/authorino-75d556bd77-kt5jm" Jun 03 19:33:08.078169 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:08.078141 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w2vs\" (UniqueName: \"kubernetes.io/projected/a8088a2a-5725-4562-94ad-e59be38c69d7-kube-api-access-6w2vs\") pod \"authorino-75d556bd77-kt5jm\" (UID: \"a8088a2a-5725-4562-94ad-e59be38c69d7\") " pod="kuadrant-system/authorino-75d556bd77-kt5jm" Jun 03 19:33:08.174279 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:08.174235 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kt5jm" Jun 03 19:33:08.317459 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:08.317386 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-r2xf6" event={"ID":"8507314b-cc3c-4ba8-955f-4ca95e423950","Type":"ContainerStarted","Data":"07582991a7d0ff2e73c0ee3e45013e0c4e84f303ed1c4045e08cfefe6cd68bdd"} Jun 03 19:33:08.359966 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:08.359930 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kt5jm"] Jun 03 19:33:08.363075 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:33:08.363037 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8088a2a_5725_4562_94ad_e59be38c69d7.slice/crio-18c1c4f0ca2949bcfb06d787e55156891a951fe642de7bd1838e081fd9d28fc2 WatchSource:0}: Error finding container 18c1c4f0ca2949bcfb06d787e55156891a951fe642de7bd1838e081fd9d28fc2: Status 404 returned error can't find the container with id 18c1c4f0ca2949bcfb06d787e55156891a951fe642de7bd1838e081fd9d28fc2 Jun 03 19:33:09.328951 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:09.328874 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kt5jm" event={"ID":"a8088a2a-5725-4562-94ad-e59be38c69d7","Type":"ContainerStarted","Data":"18c1c4f0ca2949bcfb06d787e55156891a951fe642de7bd1838e081fd9d28fc2"} Jun 03 19:33:10.383748 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:10.383711 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:10.484935 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:10.484900 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:10.585898 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:10.585862 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:12.347353 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:12.347238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-r2xf6" event={"ID":"8507314b-cc3c-4ba8-955f-4ca95e423950","Type":"ContainerStarted","Data":"fbd4e020444aa3173daaf29c5ec0ec36859304c103f2852847fb3265300cf8a1"} Jun 03 19:33:12.347749 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:12.347435 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-r2xf6" Jun 03 19:33:12.348806 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:12.348785 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kt5jm" event={"ID":"a8088a2a-5725-4562-94ad-e59be38c69d7","Type":"ContainerStarted","Data":"6ef9217280e10eea6c766cf0521f72c6955ee545e75a629cef201c1fae3b1842"} Jun 03 19:33:12.382150 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:12.382097 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-r2xf6" podStartSLOduration=1.098447319 podStartE2EDuration="5.382083289s" totalImagesPullingTime="4.28363597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:33:12.380320658 +0000 UTC m=+737.534120638" watchObservedRunningTime="2026-06-03 19:33:12.382083289 +0000 UTC m=+737.535883269" Jun 03 19:33:12.404415 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:12.404369 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-kt5jm" podStartSLOduration=1.81460741 podStartE2EDuration="5.40435603s" totalImagesPullingTime="3.58974862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:33:12.402646844 +0000 UTC m=+737.556446823" watchObservedRunningTime="2026-06-03 19:33:12.40435603 +0000 UTC m=+737.558156009" Jun 03 19:33:12.839202 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:12.839164 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:12.939479 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:12.939447 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:17.585312 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:17.585264 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:17.686573 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:17.686544 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:23.355485 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:23.355451 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-r2xf6" Jun 03 19:33:24.887659 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:24.887625 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:28.188334 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:28.188299 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:37.946711 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:37.946673 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:38.045685 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:38.045648 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:38.304117 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:38.304009 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:39.393898 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.393863 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6"] Jun 03 19:33:39.397746 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.397729 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" Jun 03 19:33:39.401464 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.401444 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bkt6w\"" Jun 03 19:33:39.401934 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.401921 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:33:39.403034 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.403016 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:33:39.416607 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.416574 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6"] Jun 03 19:33:39.556958 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.556915 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a7ad612-1375-4a5c-8457-e8ddef63bf61-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6\" (UID: \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" Jun 03 19:33:39.556958 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.556963 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvlp8\" (UniqueName: \"kubernetes.io/projected/1a7ad612-1375-4a5c-8457-e8ddef63bf61-kube-api-access-lvlp8\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6\" (UID: \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" Jun 03 19:33:39.557255 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.557114 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a7ad612-1375-4a5c-8457-e8ddef63bf61-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6\" (UID: \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" Jun 03 19:33:39.658458 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.658371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a7ad612-1375-4a5c-8457-e8ddef63bf61-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6\" (UID: \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" Jun 03 19:33:39.658458 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.658420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvlp8\" (UniqueName: \"kubernetes.io/projected/1a7ad612-1375-4a5c-8457-e8ddef63bf61-kube-api-access-lvlp8\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6\" (UID: \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" Jun 03 19:33:39.658659 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.658520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a7ad612-1375-4a5c-8457-e8ddef63bf61-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6\" (UID: \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" Jun 03 19:33:39.658754 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.658735 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a7ad612-1375-4a5c-8457-e8ddef63bf61-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6\" (UID: \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" Jun 03 19:33:39.658885 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.658863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a7ad612-1375-4a5c-8457-e8ddef63bf61-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6\" (UID: \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" Jun 03 19:33:39.672744 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.672701 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvlp8\" (UniqueName: \"kubernetes.io/projected/1a7ad612-1375-4a5c-8457-e8ddef63bf61-kube-api-access-lvlp8\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6\" (UID: \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" Jun 03 19:33:39.707195 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.707167 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" Jun 03 19:33:39.841852 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:39.841780 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6"] Jun 03 19:33:39.846483 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:33:39.846451 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7ad612_1375_4a5c_8457_e8ddef63bf61.slice/crio-fb237c932b147e2fee174b08021e726834a416d5e22d2148c43b2f53f1991311 WatchSource:0}: Error finding container fb237c932b147e2fee174b08021e726834a416d5e22d2148c43b2f53f1991311: Status 404 returned error can't find the container with id fb237c932b147e2fee174b08021e726834a416d5e22d2148c43b2f53f1991311 Jun 03 19:33:40.510112 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:40.510055 2577 generic.go:356] "Generic (PLEG): container finished" podID="1a7ad612-1375-4a5c-8457-e8ddef63bf61" containerID="4ce653392083dbe20d1008d9f630b128f380c588adfe594d595254df90844bf8" exitCode=0 Jun 03 19:33:40.510112 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:40.510090 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" event={"ID":"1a7ad612-1375-4a5c-8457-e8ddef63bf61","Type":"ContainerDied","Data":"4ce653392083dbe20d1008d9f630b128f380c588adfe594d595254df90844bf8"} Jun 03 19:33:40.510640 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:40.510143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" event={"ID":"1a7ad612-1375-4a5c-8457-e8ddef63bf61","Type":"ContainerStarted","Data":"fb237c932b147e2fee174b08021e726834a416d5e22d2148c43b2f53f1991311"} Jun 03 19:33:42.524758 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:42.524719 2577 generic.go:356] "Generic (PLEG): container finished" podID="1a7ad612-1375-4a5c-8457-e8ddef63bf61" containerID="40175b765ab2431aeaa7c3444782f2756762979e9106114fcad726ab370afd6d" exitCode=0 Jun 03 19:33:42.525149 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:42.524801 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" event={"ID":"1a7ad612-1375-4a5c-8457-e8ddef63bf61","Type":"ContainerDied","Data":"40175b765ab2431aeaa7c3444782f2756762979e9106114fcad726ab370afd6d"} Jun 03 19:33:43.532293 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:43.532261 2577 generic.go:356] "Generic (PLEG): container finished" podID="1a7ad612-1375-4a5c-8457-e8ddef63bf61" containerID="0d22f6a1ddfd048c9de0b1ea55eb43e116f3f0b270d3e15456edf548edb5ff1b" exitCode=0 Jun 03 19:33:43.532673 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:43.532299 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" event={"ID":"1a7ad612-1375-4a5c-8457-e8ddef63bf61","Type":"ContainerDied","Data":"0d22f6a1ddfd048c9de0b1ea55eb43e116f3f0b270d3e15456edf548edb5ff1b"} Jun 03 19:33:44.679357 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:44.679333 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" Jun 03 19:33:44.697894 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:44.697865 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a7ad612-1375-4a5c-8457-e8ddef63bf61-bundle\") pod \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\" (UID: \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\") " Jun 03 19:33:44.698050 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:44.697988 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvlp8\" (UniqueName: \"kubernetes.io/projected/1a7ad612-1375-4a5c-8457-e8ddef63bf61-kube-api-access-lvlp8\") pod \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\" (UID: \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\") " Jun 03 19:33:44.698050 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:44.698019 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a7ad612-1375-4a5c-8457-e8ddef63bf61-util\") pod \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\" (UID: \"1a7ad612-1375-4a5c-8457-e8ddef63bf61\") " Jun 03 19:33:44.698399 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:44.698373 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a7ad612-1375-4a5c-8457-e8ddef63bf61-bundle" (OuterVolumeSpecName: "bundle") pod "1a7ad612-1375-4a5c-8457-e8ddef63bf61" (UID: "1a7ad612-1375-4a5c-8457-e8ddef63bf61"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:33:44.700553 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:44.700523 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a7ad612-1375-4a5c-8457-e8ddef63bf61-kube-api-access-lvlp8" (OuterVolumeSpecName: "kube-api-access-lvlp8") pod "1a7ad612-1375-4a5c-8457-e8ddef63bf61" (UID: "1a7ad612-1375-4a5c-8457-e8ddef63bf61"). InnerVolumeSpecName "kube-api-access-lvlp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:33:44.705126 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:44.705101 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a7ad612-1375-4a5c-8457-e8ddef63bf61-util" (OuterVolumeSpecName: "util") pod "1a7ad612-1375-4a5c-8457-e8ddef63bf61" (UID: "1a7ad612-1375-4a5c-8457-e8ddef63bf61"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:33:44.798717 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:44.798636 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvlp8\" (UniqueName: \"kubernetes.io/projected/1a7ad612-1375-4a5c-8457-e8ddef63bf61-kube-api-access-lvlp8\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:33:44.798717 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:44.798666 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a7ad612-1375-4a5c-8457-e8ddef63bf61-util\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:33:44.798717 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:44.798679 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a7ad612-1375-4a5c-8457-e8ddef63bf61-bundle\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:33:45.544846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:45.544764 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" event={"ID":"1a7ad612-1375-4a5c-8457-e8ddef63bf61","Type":"ContainerDied","Data":"fb237c932b147e2fee174b08021e726834a416d5e22d2148c43b2f53f1991311"} Jun 03 19:33:45.544846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:45.544820 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb237c932b147e2fee174b08021e726834a416d5e22d2148c43b2f53f1991311" Jun 03 19:33:45.544846 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:33:45.544780 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70mtjp6" Jun 03 19:34:05.337915 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:05.337878 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:05.395540 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:05.395506 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:08.025145 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:08.025054 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:08.125973 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:08.125942 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:38.597918 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:38.597884 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:38.824567 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:38.824537 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7znzb"] Jun 03 19:34:38.824938 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:38.824926 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a7ad612-1375-4a5c-8457-e8ddef63bf61" containerName="extract" Jun 03 19:34:38.824987 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:38.824940 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a7ad612-1375-4a5c-8457-e8ddef63bf61" containerName="extract" Jun 03 19:34:38.824987 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:38.824967 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a7ad612-1375-4a5c-8457-e8ddef63bf61" containerName="util" Jun 03 19:34:38.824987 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:38.824972 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a7ad612-1375-4a5c-8457-e8ddef63bf61" containerName="util" Jun 03 19:34:38.824987 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:38.824977 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a7ad612-1375-4a5c-8457-e8ddef63bf61" containerName="pull" Jun 03 19:34:38.824987 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:38.824982 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a7ad612-1375-4a5c-8457-e8ddef63bf61" containerName="pull" Jun 03 19:34:38.825169 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:38.825035 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a7ad612-1375-4a5c-8457-e8ddef63bf61" containerName="extract" Jun 03 19:34:38.828189 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:38.828166 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7znzb" Jun 03 19:34:38.841003 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:38.840971 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7znzb"] Jun 03 19:34:38.884722 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:38.884689 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:38.942917 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:38.942890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2pd6\" (UniqueName: \"kubernetes.io/projected/68a34bf9-6add-44d5-ab66-01be5efd4e12-kube-api-access-w2pd6\") pod \"authorino-5d4b67c446-7znzb\" (UID: \"68a34bf9-6add-44d5-ab66-01be5efd4e12\") " pod="kuadrant-system/authorino-5d4b67c446-7znzb" Jun 03 19:34:39.044370 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.044331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2pd6\" (UniqueName: \"kubernetes.io/projected/68a34bf9-6add-44d5-ab66-01be5efd4e12-kube-api-access-w2pd6\") pod \"authorino-5d4b67c446-7znzb\" (UID: \"68a34bf9-6add-44d5-ab66-01be5efd4e12\") " pod="kuadrant-system/authorino-5d4b67c446-7znzb" Jun 03 19:34:39.048942 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.048914 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7znzb"] Jun 03 19:34:39.049212 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:34:39.049192 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-w2pd6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-7znzb" podUID="68a34bf9-6add-44d5-ab66-01be5efd4e12" Jun 03 19:34:39.056151 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.056129 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2pd6\" (UniqueName: \"kubernetes.io/projected/68a34bf9-6add-44d5-ab66-01be5efd4e12-kube-api-access-w2pd6\") pod \"authorino-5d4b67c446-7znzb\" (UID: \"68a34bf9-6add-44d5-ab66-01be5efd4e12\") " pod="kuadrant-system/authorino-5d4b67c446-7znzb" Jun 03 19:34:39.078730 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.078703 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b7548ff5f-mlg5f"] Jun 03 19:34:39.082219 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.082203 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b7548ff5f-mlg5f" Jun 03 19:34:39.087482 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.087455 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b7548ff5f-mlg5f"] Jun 03 19:34:39.246267 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.246177 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5jz4\" (UniqueName: \"kubernetes.io/projected/96f5aa02-1a93-4f6d-a4f6-566f7daae947-kube-api-access-c5jz4\") pod \"authorino-7b7548ff5f-mlg5f\" (UID: \"96f5aa02-1a93-4f6d-a4f6-566f7daae947\") " pod="kuadrant-system/authorino-7b7548ff5f-mlg5f" Jun 03 19:34:39.279753 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.279723 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b7548ff5f-mlg5f"] Jun 03 19:34:39.279985 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:34:39.279965 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-c5jz4], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7b7548ff5f-mlg5f" podUID="96f5aa02-1a93-4f6d-a4f6-566f7daae947" Jun 03 19:34:39.347486 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.347449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5jz4\" (UniqueName: \"kubernetes.io/projected/96f5aa02-1a93-4f6d-a4f6-566f7daae947-kube-api-access-c5jz4\") pod \"authorino-7b7548ff5f-mlg5f\" (UID: \"96f5aa02-1a93-4f6d-a4f6-566f7daae947\") " pod="kuadrant-system/authorino-7b7548ff5f-mlg5f" Jun 03 19:34:39.357637 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.357601 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5jz4\" (UniqueName: \"kubernetes.io/projected/96f5aa02-1a93-4f6d-a4f6-566f7daae947-kube-api-access-c5jz4\") pod \"authorino-7b7548ff5f-mlg5f\" (UID: \"96f5aa02-1a93-4f6d-a4f6-566f7daae947\") " pod="kuadrant-system/authorino-7b7548ff5f-mlg5f" Jun 03 19:34:39.852881 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.852854 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7znzb" Jun 03 19:34:39.853283 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.852854 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b7548ff5f-mlg5f" Jun 03 19:34:39.860182 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.860163 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7znzb" Jun 03 19:34:39.863108 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.863091 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b7548ff5f-mlg5f" Jun 03 19:34:39.952567 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.952538 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2pd6\" (UniqueName: \"kubernetes.io/projected/68a34bf9-6add-44d5-ab66-01be5efd4e12-kube-api-access-w2pd6\") pod \"68a34bf9-6add-44d5-ab66-01be5efd4e12\" (UID: \"68a34bf9-6add-44d5-ab66-01be5efd4e12\") " Jun 03 19:34:39.952753 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.952605 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5jz4\" (UniqueName: \"kubernetes.io/projected/96f5aa02-1a93-4f6d-a4f6-566f7daae947-kube-api-access-c5jz4\") pod \"96f5aa02-1a93-4f6d-a4f6-566f7daae947\" (UID: \"96f5aa02-1a93-4f6d-a4f6-566f7daae947\") " Jun 03 19:34:39.954628 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.954586 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a34bf9-6add-44d5-ab66-01be5efd4e12-kube-api-access-w2pd6" (OuterVolumeSpecName: "kube-api-access-w2pd6") pod "68a34bf9-6add-44d5-ab66-01be5efd4e12" (UID: "68a34bf9-6add-44d5-ab66-01be5efd4e12"). InnerVolumeSpecName "kube-api-access-w2pd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:34:39.954745 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:39.954622 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96f5aa02-1a93-4f6d-a4f6-566f7daae947-kube-api-access-c5jz4" (OuterVolumeSpecName: "kube-api-access-c5jz4") pod "96f5aa02-1a93-4f6d-a4f6-566f7daae947" (UID: "96f5aa02-1a93-4f6d-a4f6-566f7daae947"). InnerVolumeSpecName "kube-api-access-c5jz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:34:40.053767 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:40.053724 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2pd6\" (UniqueName: \"kubernetes.io/projected/68a34bf9-6add-44d5-ab66-01be5efd4e12-kube-api-access-w2pd6\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:34:40.053767 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:40.053760 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5jz4\" (UniqueName: \"kubernetes.io/projected/96f5aa02-1a93-4f6d-a4f6-566f7daae947-kube-api-access-c5jz4\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:34:40.858602 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:40.858567 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b7548ff5f-mlg5f" Jun 03 19:34:40.859112 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:40.858567 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7znzb" Jun 03 19:34:40.893692 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:40.893667 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7znzb"] Jun 03 19:34:40.897797 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:40.897774 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7znzb"] Jun 03 19:34:40.921543 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:40.921519 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b7548ff5f-mlg5f"] Jun 03 19:34:40.925761 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:40.925735 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b7548ff5f-mlg5f"] Jun 03 19:34:41.033229 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.033195 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kt5jm"] Jun 03 19:34:41.033392 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.033371 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-kt5jm" podUID="a8088a2a-5725-4562-94ad-e59be38c69d7" containerName="authorino" containerID="cri-o://6ef9217280e10eea6c766cf0521f72c6955ee545e75a629cef201c1fae3b1842" gracePeriod=30 Jun 03 19:34:41.277470 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.277448 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kt5jm" Jun 03 19:34:41.279515 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.279489 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68a34bf9-6add-44d5-ab66-01be5efd4e12" path="/var/lib/kubelet/pods/68a34bf9-6add-44d5-ab66-01be5efd4e12/volumes" Jun 03 19:34:41.279716 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.279704 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96f5aa02-1a93-4f6d-a4f6-566f7daae947" path="/var/lib/kubelet/pods/96f5aa02-1a93-4f6d-a4f6-566f7daae947/volumes" Jun 03 19:34:41.363535 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.363504 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6w2vs\" (UniqueName: \"kubernetes.io/projected/a8088a2a-5725-4562-94ad-e59be38c69d7-kube-api-access-6w2vs\") pod \"a8088a2a-5725-4562-94ad-e59be38c69d7\" (UID: \"a8088a2a-5725-4562-94ad-e59be38c69d7\") " Jun 03 19:34:41.365590 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.365568 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8088a2a-5725-4562-94ad-e59be38c69d7-kube-api-access-6w2vs" (OuterVolumeSpecName: "kube-api-access-6w2vs") pod "a8088a2a-5725-4562-94ad-e59be38c69d7" (UID: "a8088a2a-5725-4562-94ad-e59be38c69d7"). InnerVolumeSpecName "kube-api-access-6w2vs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:34:41.464765 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.464686 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6w2vs\" (UniqueName: \"kubernetes.io/projected/a8088a2a-5725-4562-94ad-e59be38c69d7-kube-api-access-6w2vs\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:34:41.865408 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.865312 2577 generic.go:356] "Generic (PLEG): container finished" podID="a8088a2a-5725-4562-94ad-e59be38c69d7" containerID="6ef9217280e10eea6c766cf0521f72c6955ee545e75a629cef201c1fae3b1842" exitCode=0 Jun 03 19:34:41.865408 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.865376 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kt5jm" Jun 03 19:34:41.865408 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.865385 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kt5jm" event={"ID":"a8088a2a-5725-4562-94ad-e59be38c69d7","Type":"ContainerDied","Data":"6ef9217280e10eea6c766cf0521f72c6955ee545e75a629cef201c1fae3b1842"} Jun 03 19:34:41.865955 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.865425 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kt5jm" event={"ID":"a8088a2a-5725-4562-94ad-e59be38c69d7","Type":"ContainerDied","Data":"18c1c4f0ca2949bcfb06d787e55156891a951fe642de7bd1838e081fd9d28fc2"} Jun 03 19:34:41.865955 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.865442 2577 scope.go:117] "RemoveContainer" containerID="6ef9217280e10eea6c766cf0521f72c6955ee545e75a629cef201c1fae3b1842" Jun 03 19:34:41.874607 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.874591 2577 scope.go:117] "RemoveContainer" containerID="6ef9217280e10eea6c766cf0521f72c6955ee545e75a629cef201c1fae3b1842" Jun 03 19:34:41.874851 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:34:41.874831 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef9217280e10eea6c766cf0521f72c6955ee545e75a629cef201c1fae3b1842\": container with ID starting with 6ef9217280e10eea6c766cf0521f72c6955ee545e75a629cef201c1fae3b1842 not found: ID does not exist" containerID="6ef9217280e10eea6c766cf0521f72c6955ee545e75a629cef201c1fae3b1842" Jun 03 19:34:41.874894 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.874860 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef9217280e10eea6c766cf0521f72c6955ee545e75a629cef201c1fae3b1842"} err="failed to get container status \"6ef9217280e10eea6c766cf0521f72c6955ee545e75a629cef201c1fae3b1842\": rpc error: code = NotFound desc = could not find container \"6ef9217280e10eea6c766cf0521f72c6955ee545e75a629cef201c1fae3b1842\": container with ID starting with 6ef9217280e10eea6c766cf0521f72c6955ee545e75a629cef201c1fae3b1842 not found: ID does not exist" Jun 03 19:34:41.888664 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.888643 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kt5jm"] Jun 03 19:34:41.893270 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:41.893245 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kt5jm"] Jun 03 19:34:43.279389 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:43.279357 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8088a2a-5725-4562-94ad-e59be38c69d7" path="/var/lib/kubelet/pods/a8088a2a-5725-4562-94ad-e59be38c69d7/volumes" Jun 03 19:34:44.181446 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:44.181413 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79db6dccf5-p6qd9"] Jun 03 19:34:44.181815 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:44.181802 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8088a2a-5725-4562-94ad-e59be38c69d7" containerName="authorino" Jun 03 19:34:44.181859 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:44.181816 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8088a2a-5725-4562-94ad-e59be38c69d7" containerName="authorino" Jun 03 19:34:44.181931 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:44.181921 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8088a2a-5725-4562-94ad-e59be38c69d7" containerName="authorino" Jun 03 19:34:44.186421 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:44.186402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79db6dccf5-p6qd9" Jun 03 19:34:44.189543 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:44.189524 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 19:34:44.189543 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:44.189537 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hqcvx\"" Jun 03 19:34:44.195139 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:44.195118 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79db6dccf5-p6qd9"] Jun 03 19:34:44.288988 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:44.288953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdr47\" (UniqueName: \"kubernetes.io/projected/d3824155-9c96-4bcf-93a0-baacb4af3370-kube-api-access-tdr47\") pod \"maas-controller-79db6dccf5-p6qd9\" (UID: \"d3824155-9c96-4bcf-93a0-baacb4af3370\") " pod="opendatahub/maas-controller-79db6dccf5-p6qd9" Jun 03 19:34:44.389870 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:44.389837 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdr47\" (UniqueName: \"kubernetes.io/projected/d3824155-9c96-4bcf-93a0-baacb4af3370-kube-api-access-tdr47\") pod \"maas-controller-79db6dccf5-p6qd9\" (UID: \"d3824155-9c96-4bcf-93a0-baacb4af3370\") " pod="opendatahub/maas-controller-79db6dccf5-p6qd9" Jun 03 19:34:44.398667 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:44.398644 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdr47\" (UniqueName: \"kubernetes.io/projected/d3824155-9c96-4bcf-93a0-baacb4af3370-kube-api-access-tdr47\") pod \"maas-controller-79db6dccf5-p6qd9\" (UID: \"d3824155-9c96-4bcf-93a0-baacb4af3370\") " pod="opendatahub/maas-controller-79db6dccf5-p6qd9" Jun 03 19:34:44.497533 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:44.497445 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79db6dccf5-p6qd9" Jun 03 19:34:44.627087 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:44.627043 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79db6dccf5-p6qd9"] Jun 03 19:34:44.628186 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:34:44.628160 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3824155_9c96_4bcf_93a0_baacb4af3370.slice/crio-80cbe4e3c7d252364ca5ab4df0757c04ea6f209f9839c20e85513fa425f89131 WatchSource:0}: Error finding container 80cbe4e3c7d252364ca5ab4df0757c04ea6f209f9839c20e85513fa425f89131: Status 404 returned error can't find the container with id 80cbe4e3c7d252364ca5ab4df0757c04ea6f209f9839c20e85513fa425f89131 Jun 03 19:34:44.886680 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:44.886644 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79db6dccf5-p6qd9" event={"ID":"d3824155-9c96-4bcf-93a0-baacb4af3370","Type":"ContainerStarted","Data":"80cbe4e3c7d252364ca5ab4df0757c04ea6f209f9839c20e85513fa425f89131"} Jun 03 19:34:47.116590 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:47.116557 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:47.219779 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:47.219687 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:47.906299 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:47.906262 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79db6dccf5-p6qd9" event={"ID":"d3824155-9c96-4bcf-93a0-baacb4af3370","Type":"ContainerStarted","Data":"9ddbc07cb8a9433c7180c9e8bddb5b1a5a755f8538e60f9cfbf15ba3288b710d"} Jun 03 19:34:47.906483 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:47.906348 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79db6dccf5-p6qd9" Jun 03 19:34:47.927162 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:47.927110 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79db6dccf5-p6qd9" podStartSLOduration=1.6129356320000001 podStartE2EDuration="3.92709459s" totalImagesPullingTime="2.314158958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:47.925295537 +0000 UTC m=+833.079095518" watchObservedRunningTime="2026-06-03 19:34:47.92709459 +0000 UTC m=+833.080894602" Jun 03 19:34:53.797909 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:53.797872 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:58.919038 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:58.919007 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79db6dccf5-p6qd9" Jun 03 19:34:59.073797 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:59.073762 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79db6dccf5-p6qd9"] Jun 03 19:34:59.073982 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:59.073959 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-79db6dccf5-p6qd9" podUID="d3824155-9c96-4bcf-93a0-baacb4af3370" containerName="manager" containerID="cri-o://9ddbc07cb8a9433c7180c9e8bddb5b1a5a755f8538e60f9cfbf15ba3288b710d" gracePeriod=30 Jun 03 19:34:59.321050 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:59.321024 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79db6dccf5-p6qd9" Jun 03 19:34:59.419948 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:59.419910 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdr47\" (UniqueName: \"kubernetes.io/projected/d3824155-9c96-4bcf-93a0-baacb4af3370-kube-api-access-tdr47\") pod \"d3824155-9c96-4bcf-93a0-baacb4af3370\" (UID: \"d3824155-9c96-4bcf-93a0-baacb4af3370\") " Jun 03 19:34:59.422051 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:59.422030 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3824155-9c96-4bcf-93a0-baacb4af3370-kube-api-access-tdr47" (OuterVolumeSpecName: "kube-api-access-tdr47") pod "d3824155-9c96-4bcf-93a0-baacb4af3370" (UID: "d3824155-9c96-4bcf-93a0-baacb4af3370"). InnerVolumeSpecName "kube-api-access-tdr47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:34:59.520779 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:59.520694 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdr47\" (UniqueName: \"kubernetes.io/projected/d3824155-9c96-4bcf-93a0-baacb4af3370-kube-api-access-tdr47\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:34:59.974115 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:59.974078 2577 generic.go:356] "Generic (PLEG): container finished" podID="d3824155-9c96-4bcf-93a0-baacb4af3370" containerID="9ddbc07cb8a9433c7180c9e8bddb5b1a5a755f8538e60f9cfbf15ba3288b710d" exitCode=0 Jun 03 19:34:59.974567 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:59.974121 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79db6dccf5-p6qd9" Jun 03 19:34:59.974567 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:59.974165 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79db6dccf5-p6qd9" event={"ID":"d3824155-9c96-4bcf-93a0-baacb4af3370","Type":"ContainerDied","Data":"9ddbc07cb8a9433c7180c9e8bddb5b1a5a755f8538e60f9cfbf15ba3288b710d"} Jun 03 19:34:59.974567 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:59.974227 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79db6dccf5-p6qd9" event={"ID":"d3824155-9c96-4bcf-93a0-baacb4af3370","Type":"ContainerDied","Data":"80cbe4e3c7d252364ca5ab4df0757c04ea6f209f9839c20e85513fa425f89131"} Jun 03 19:34:59.974567 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:59.974262 2577 scope.go:117] "RemoveContainer" containerID="9ddbc07cb8a9433c7180c9e8bddb5b1a5a755f8538e60f9cfbf15ba3288b710d" Jun 03 19:34:59.983302 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:59.983285 2577 scope.go:117] "RemoveContainer" containerID="9ddbc07cb8a9433c7180c9e8bddb5b1a5a755f8538e60f9cfbf15ba3288b710d" Jun 03 19:34:59.983538 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:34:59.983520 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ddbc07cb8a9433c7180c9e8bddb5b1a5a755f8538e60f9cfbf15ba3288b710d\": container with ID starting with 9ddbc07cb8a9433c7180c9e8bddb5b1a5a755f8538e60f9cfbf15ba3288b710d not found: ID does not exist" containerID="9ddbc07cb8a9433c7180c9e8bddb5b1a5a755f8538e60f9cfbf15ba3288b710d" Jun 03 19:34:59.983590 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:59.983544 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ddbc07cb8a9433c7180c9e8bddb5b1a5a755f8538e60f9cfbf15ba3288b710d"} err="failed to get container status \"9ddbc07cb8a9433c7180c9e8bddb5b1a5a755f8538e60f9cfbf15ba3288b710d\": rpc error: code = NotFound desc = could not find container \"9ddbc07cb8a9433c7180c9e8bddb5b1a5a755f8538e60f9cfbf15ba3288b710d\": container with ID starting with 9ddbc07cb8a9433c7180c9e8bddb5b1a5a755f8538e60f9cfbf15ba3288b710d not found: ID does not exist" Jun 03 19:34:59.999204 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:34:59.999182 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79db6dccf5-p6qd9"] Jun 03 19:35:00.001432 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:00.001414 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79db6dccf5-p6qd9"] Jun 03 19:35:01.279092 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:01.279047 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3824155-9c96-4bcf-93a0-baacb4af3370" path="/var/lib/kubelet/pods/d3824155-9c96-4bcf-93a0-baacb4af3370/volumes" Jun 03 19:35:18.882614 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:18.882584 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:18.905387 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:18.905358 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-bc774799-f9q5b"] Jun 03 19:35:18.905794 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:18.905781 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3824155-9c96-4bcf-93a0-baacb4af3370" containerName="manager" Jun 03 19:35:18.905837 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:18.905797 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3824155-9c96-4bcf-93a0-baacb4af3370" containerName="manager" Jun 03 19:35:18.905871 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:18.905863 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3824155-9c96-4bcf-93a0-baacb4af3370" containerName="manager" Jun 03 19:35:18.912548 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:18.912527 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-bc774799-f9q5b" Jun 03 19:35:18.916088 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:18.916054 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 19:35:18.921550 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:18.921529 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-bc774799-f9q5b"] Jun 03 19:35:18.995639 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:18.995602 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15db0965-0f2c-436e-a824-392d21b0a634-maas-api-tls\") pod \"maas-api-bc774799-f9q5b\" (UID: \"15db0965-0f2c-436e-a824-392d21b0a634\") " pod="opendatahub/maas-api-bc774799-f9q5b" Jun 03 19:35:18.995819 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:18.995661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpq5r\" (UniqueName: \"kubernetes.io/projected/15db0965-0f2c-436e-a824-392d21b0a634-kube-api-access-cpq5r\") pod \"maas-api-bc774799-f9q5b\" (UID: \"15db0965-0f2c-436e-a824-392d21b0a634\") " pod="opendatahub/maas-api-bc774799-f9q5b" Jun 03 19:35:19.096718 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:19.096685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15db0965-0f2c-436e-a824-392d21b0a634-maas-api-tls\") pod \"maas-api-bc774799-f9q5b\" (UID: \"15db0965-0f2c-436e-a824-392d21b0a634\") " pod="opendatahub/maas-api-bc774799-f9q5b" Jun 03 19:35:19.096897 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:19.096738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpq5r\" (UniqueName: \"kubernetes.io/projected/15db0965-0f2c-436e-a824-392d21b0a634-kube-api-access-cpq5r\") pod \"maas-api-bc774799-f9q5b\" (UID: \"15db0965-0f2c-436e-a824-392d21b0a634\") " pod="opendatahub/maas-api-bc774799-f9q5b" Jun 03 19:35:19.096897 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:35:19.096828 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 03 19:35:19.096977 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:35:19.096897 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15db0965-0f2c-436e-a824-392d21b0a634-maas-api-tls podName:15db0965-0f2c-436e-a824-392d21b0a634 nodeName:}" failed. No retries permitted until 2026-06-03 19:35:19.596881165 +0000 UTC m=+864.750681123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/15db0965-0f2c-436e-a824-392d21b0a634-maas-api-tls") pod "maas-api-bc774799-f9q5b" (UID: "15db0965-0f2c-436e-a824-392d21b0a634") : secret "maas-api-serving-cert" not found Jun 03 19:35:19.105932 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:19.105906 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpq5r\" (UniqueName: \"kubernetes.io/projected/15db0965-0f2c-436e-a824-392d21b0a634-kube-api-access-cpq5r\") pod \"maas-api-bc774799-f9q5b\" (UID: \"15db0965-0f2c-436e-a824-392d21b0a634\") " pod="opendatahub/maas-api-bc774799-f9q5b" Jun 03 19:35:19.199266 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:19.199231 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:19.299885 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:19.299854 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:19.467687 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:19.467601 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:35:19.601941 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:19.601898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15db0965-0f2c-436e-a824-392d21b0a634-maas-api-tls\") pod \"maas-api-bc774799-f9q5b\" (UID: \"15db0965-0f2c-436e-a824-392d21b0a634\") " pod="opendatahub/maas-api-bc774799-f9q5b" Jun 03 19:35:19.604272 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:19.604251 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15db0965-0f2c-436e-a824-392d21b0a634-maas-api-tls\") pod \"maas-api-bc774799-f9q5b\" (UID: \"15db0965-0f2c-436e-a824-392d21b0a634\") " pod="opendatahub/maas-api-bc774799-f9q5b" Jun 03 19:35:19.824474 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:19.824393 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-bc774799-f9q5b" Jun 03 19:35:19.959570 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:19.959542 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-bc774799-f9q5b"] Jun 03 19:35:19.961165 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:35:19.961139 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15db0965_0f2c_436e_a824_392d21b0a634.slice/crio-5d2f6377193f62aa3bd1d4b44aa6209051784e3a1c68a1c76750da6119b40a6e WatchSource:0}: Error finding container 5d2f6377193f62aa3bd1d4b44aa6209051784e3a1c68a1c76750da6119b40a6e: Status 404 returned error can't find the container with id 5d2f6377193f62aa3bd1d4b44aa6209051784e3a1c68a1c76750da6119b40a6e Jun 03 19:35:20.086725 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:20.086639 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-bc774799-f9q5b" event={"ID":"15db0965-0f2c-436e-a824-392d21b0a634","Type":"ContainerStarted","Data":"5d2f6377193f62aa3bd1d4b44aa6209051784e3a1c68a1c76750da6119b40a6e"} Jun 03 19:35:22.100043 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:22.100002 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-bc774799-f9q5b" event={"ID":"15db0965-0f2c-436e-a824-392d21b0a634","Type":"ContainerStarted","Data":"7b1d6cce43e460cd1714ed22e2fbe5ed99adb56dd214c4b9855e4ff8430242af"} Jun 03 19:35:22.100436 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:22.100144 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-bc774799-f9q5b" Jun 03 19:35:22.122139 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:22.122090 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-bc774799-f9q5b" podStartSLOduration=2.460606198 podStartE2EDuration="4.122074402s" totalImagesPullingTime="1.661468204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:22.120228098 +0000 UTC m=+867.274028077" watchObservedRunningTime="2026-06-03 19:35:22.122074402 +0000 UTC m=+867.275874374" Jun 03 19:35:28.113469 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:28.113438 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-bc774799-f9q5b" Jun 03 19:35:39.938717 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:39.938683 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:55.307125 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:55.307034 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:35:55.307693 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:35:55.307659 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:36:08.516255 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.516217 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-664f9bd4c9-8b7kt"] Jun 03 19:36:08.519829 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.519807 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" Jun 03 19:36:08.524897 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.524871 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-spck8\"" Jun 03 19:36:08.525025 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.524871 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 19:36:08.525025 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.524872 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 19:36:08.529405 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.529381 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-664f9bd4c9-8b7kt"] Jun 03 19:36:08.654473 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.654436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/740cedc3-3a11-4885-96b6-ed46d9fe1698-tls-cert\") pod \"authorino-664f9bd4c9-8b7kt\" (UID: \"740cedc3-3a11-4885-96b6-ed46d9fe1698\") " pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" Jun 03 19:36:08.654665 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.654484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mgwx\" (UniqueName: \"kubernetes.io/projected/740cedc3-3a11-4885-96b6-ed46d9fe1698-kube-api-access-2mgwx\") pod \"authorino-664f9bd4c9-8b7kt\" (UID: \"740cedc3-3a11-4885-96b6-ed46d9fe1698\") " pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" Jun 03 19:36:08.654665 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.654562 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/740cedc3-3a11-4885-96b6-ed46d9fe1698-oidc-ca\") pod \"authorino-664f9bd4c9-8b7kt\" (UID: \"740cedc3-3a11-4885-96b6-ed46d9fe1698\") " pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" Jun 03 19:36:08.755211 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.755171 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/740cedc3-3a11-4885-96b6-ed46d9fe1698-tls-cert\") pod \"authorino-664f9bd4c9-8b7kt\" (UID: \"740cedc3-3a11-4885-96b6-ed46d9fe1698\") " pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" Jun 03 19:36:08.755413 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.755231 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mgwx\" (UniqueName: \"kubernetes.io/projected/740cedc3-3a11-4885-96b6-ed46d9fe1698-kube-api-access-2mgwx\") pod \"authorino-664f9bd4c9-8b7kt\" (UID: \"740cedc3-3a11-4885-96b6-ed46d9fe1698\") " pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" Jun 03 19:36:08.755413 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.755309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/740cedc3-3a11-4885-96b6-ed46d9fe1698-oidc-ca\") pod \"authorino-664f9bd4c9-8b7kt\" (UID: \"740cedc3-3a11-4885-96b6-ed46d9fe1698\") " pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" Jun 03 19:36:08.755970 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.755945 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/740cedc3-3a11-4885-96b6-ed46d9fe1698-oidc-ca\") pod \"authorino-664f9bd4c9-8b7kt\" (UID: \"740cedc3-3a11-4885-96b6-ed46d9fe1698\") " pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" Jun 03 19:36:08.757709 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.757687 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/740cedc3-3a11-4885-96b6-ed46d9fe1698-tls-cert\") pod \"authorino-664f9bd4c9-8b7kt\" (UID: \"740cedc3-3a11-4885-96b6-ed46d9fe1698\") " pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" Jun 03 19:36:08.764320 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.764300 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mgwx\" (UniqueName: \"kubernetes.io/projected/740cedc3-3a11-4885-96b6-ed46d9fe1698-kube-api-access-2mgwx\") pod \"authorino-664f9bd4c9-8b7kt\" (UID: \"740cedc3-3a11-4885-96b6-ed46d9fe1698\") " pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" Jun 03 19:36:08.829167 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.829097 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" Jun 03 19:36:08.965217 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.965186 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-664f9bd4c9-8b7kt"] Jun 03 19:36:08.965547 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:36:08.965520 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod740cedc3_3a11_4885_96b6_ed46d9fe1698.slice/crio-8927e49acc05a459e6b52e303fb71668a5b611d3a61db0c8b0ae2206f0b6b4a7 WatchSource:0}: Error finding container 8927e49acc05a459e6b52e303fb71668a5b611d3a61db0c8b0ae2206f0b6b4a7: Status 404 returned error can't find the container with id 8927e49acc05a459e6b52e303fb71668a5b611d3a61db0c8b0ae2206f0b6b4a7 Jun 03 19:36:08.966867 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:08.966854 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:36:09.371471 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:09.371429 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" event={"ID":"740cedc3-3a11-4885-96b6-ed46d9fe1698","Type":"ContainerStarted","Data":"8927e49acc05a459e6b52e303fb71668a5b611d3a61db0c8b0ae2206f0b6b4a7"} Jun 03 19:36:10.379794 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:10.379746 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" event={"ID":"740cedc3-3a11-4885-96b6-ed46d9fe1698","Type":"ContainerStarted","Data":"0601993981a3c584a4f58b3c20328a3414f2b0b87fc4466cb9cda6035b476f00"} Jun 03 19:36:10.399371 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:10.399322 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" podStartSLOduration=1.582633574 podStartE2EDuration="2.399303717s" totalImagesPullingTime="816.670143ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:36:10.396730199 +0000 UTC m=+915.550530189" watchObservedRunningTime="2026-06-03 19:36:10.399303717 +0000 UTC m=+915.553103697" Jun 03 19:36:10.852799 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:10.852768 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:12.094456 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:12.094422 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:22.942491 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:22.942444 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:23.435949 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:23.435917 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:36:32.180273 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:32.180236 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:32.606783 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:32.606701 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:36:39.997015 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:39.996943 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:40.895943 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:40.895910 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:36:50.139189 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:50.139152 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:50.903188 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:36:50.903154 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:37:00.971386 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:37:00.971340 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:02.198031 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:37:02.197999 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:37:09.679998 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:37:09.679960 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:11.204082 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:37:11.204024 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:38:12.070225 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.070188 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6887ffdd5d-plrgn"] Jun 03 19:38:12.073724 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.073707 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6887ffdd5d-plrgn" Jun 03 19:38:12.080525 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.080492 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6887ffdd5d-plrgn"] Jun 03 19:38:12.142809 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.142779 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/794de4f8-a42a-4384-adc0-bca4b821a00e-oidc-ca\") pod \"authorino-6887ffdd5d-plrgn\" (UID: \"794de4f8-a42a-4384-adc0-bca4b821a00e\") " pod="kuadrant-system/authorino-6887ffdd5d-plrgn" Jun 03 19:38:12.142959 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.142821 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwnfk\" (UniqueName: \"kubernetes.io/projected/794de4f8-a42a-4384-adc0-bca4b821a00e-kube-api-access-rwnfk\") pod \"authorino-6887ffdd5d-plrgn\" (UID: \"794de4f8-a42a-4384-adc0-bca4b821a00e\") " pod="kuadrant-system/authorino-6887ffdd5d-plrgn" Jun 03 19:38:12.142959 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.142857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/794de4f8-a42a-4384-adc0-bca4b821a00e-tls-cert\") pod \"authorino-6887ffdd5d-plrgn\" (UID: \"794de4f8-a42a-4384-adc0-bca4b821a00e\") " pod="kuadrant-system/authorino-6887ffdd5d-plrgn" Jun 03 19:38:12.244332 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.244297 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/794de4f8-a42a-4384-adc0-bca4b821a00e-oidc-ca\") pod \"authorino-6887ffdd5d-plrgn\" (UID: \"794de4f8-a42a-4384-adc0-bca4b821a00e\") " pod="kuadrant-system/authorino-6887ffdd5d-plrgn" Jun 03 19:38:12.244515 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.244342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwnfk\" (UniqueName: \"kubernetes.io/projected/794de4f8-a42a-4384-adc0-bca4b821a00e-kube-api-access-rwnfk\") pod \"authorino-6887ffdd5d-plrgn\" (UID: \"794de4f8-a42a-4384-adc0-bca4b821a00e\") " pod="kuadrant-system/authorino-6887ffdd5d-plrgn" Jun 03 19:38:12.244515 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.244371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/794de4f8-a42a-4384-adc0-bca4b821a00e-tls-cert\") pod \"authorino-6887ffdd5d-plrgn\" (UID: \"794de4f8-a42a-4384-adc0-bca4b821a00e\") " pod="kuadrant-system/authorino-6887ffdd5d-plrgn" Jun 03 19:38:12.244929 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.244908 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/794de4f8-a42a-4384-adc0-bca4b821a00e-oidc-ca\") pod \"authorino-6887ffdd5d-plrgn\" (UID: \"794de4f8-a42a-4384-adc0-bca4b821a00e\") " pod="kuadrant-system/authorino-6887ffdd5d-plrgn" Jun 03 19:38:12.246712 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.246689 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/794de4f8-a42a-4384-adc0-bca4b821a00e-tls-cert\") pod \"authorino-6887ffdd5d-plrgn\" (UID: \"794de4f8-a42a-4384-adc0-bca4b821a00e\") " pod="kuadrant-system/authorino-6887ffdd5d-plrgn" Jun 03 19:38:12.254783 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.254758 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwnfk\" (UniqueName: \"kubernetes.io/projected/794de4f8-a42a-4384-adc0-bca4b821a00e-kube-api-access-rwnfk\") pod \"authorino-6887ffdd5d-plrgn\" (UID: \"794de4f8-a42a-4384-adc0-bca4b821a00e\") " pod="kuadrant-system/authorino-6887ffdd5d-plrgn" Jun 03 19:38:12.385221 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.385196 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6887ffdd5d-plrgn" Jun 03 19:38:12.527374 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.527346 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6887ffdd5d-plrgn"] Jun 03 19:38:12.529502 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:38:12.529473 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod794de4f8_a42a_4384_adc0_bca4b821a00e.slice/crio-fe9700575dcb4de4a655b76180a96a507a0f20a7e5a43020955b77e8a664e6dc WatchSource:0}: Error finding container fe9700575dcb4de4a655b76180a96a507a0f20a7e5a43020955b77e8a664e6dc: Status 404 returned error can't find the container with id fe9700575dcb4de4a655b76180a96a507a0f20a7e5a43020955b77e8a664e6dc Jun 03 19:38:12.567966 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.567918 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:12.661165 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:12.661080 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:13.090527 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.090484 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6887ffdd5d-plrgn" event={"ID":"794de4f8-a42a-4384-adc0-bca4b821a00e","Type":"ContainerStarted","Data":"651cf299ed1184aabf9e867f9c3aa73f5890fdee7477775f69aeea07cc27e8aa"} Jun 03 19:38:13.090947 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.090541 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6887ffdd5d-plrgn" event={"ID":"794de4f8-a42a-4384-adc0-bca4b821a00e","Type":"ContainerStarted","Data":"fe9700575dcb4de4a655b76180a96a507a0f20a7e5a43020955b77e8a664e6dc"} Jun 03 19:38:13.109116 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.109039 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6887ffdd5d-plrgn" podStartSLOduration=0.664454193 podStartE2EDuration="1.109020681s" totalImagesPullingTime="444.566488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:38:13.107160564 +0000 UTC m=+1038.260960545" watchObservedRunningTime="2026-06-03 19:38:13.109020681 +0000 UTC m=+1038.262820661" Jun 03 19:38:13.137121 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.137055 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-664f9bd4c9-8b7kt"] Jun 03 19:38:13.137309 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.137284 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" podUID="740cedc3-3a11-4885-96b6-ed46d9fe1698" containerName="authorino" containerID="cri-o://0601993981a3c584a4f58b3c20328a3414f2b0b87fc4466cb9cda6035b476f00" gracePeriod=30 Jun 03 19:38:13.400590 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.400565 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" Jun 03 19:38:13.456429 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.456394 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mgwx\" (UniqueName: \"kubernetes.io/projected/740cedc3-3a11-4885-96b6-ed46d9fe1698-kube-api-access-2mgwx\") pod \"740cedc3-3a11-4885-96b6-ed46d9fe1698\" (UID: \"740cedc3-3a11-4885-96b6-ed46d9fe1698\") " Jun 03 19:38:13.456589 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.456509 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/740cedc3-3a11-4885-96b6-ed46d9fe1698-tls-cert\") pod \"740cedc3-3a11-4885-96b6-ed46d9fe1698\" (UID: \"740cedc3-3a11-4885-96b6-ed46d9fe1698\") " Jun 03 19:38:13.456645 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.456614 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/740cedc3-3a11-4885-96b6-ed46d9fe1698-oidc-ca\") pod \"740cedc3-3a11-4885-96b6-ed46d9fe1698\" (UID: \"740cedc3-3a11-4885-96b6-ed46d9fe1698\") " Jun 03 19:38:13.458958 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.458924 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/740cedc3-3a11-4885-96b6-ed46d9fe1698-kube-api-access-2mgwx" (OuterVolumeSpecName: "kube-api-access-2mgwx") pod "740cedc3-3a11-4885-96b6-ed46d9fe1698" (UID: "740cedc3-3a11-4885-96b6-ed46d9fe1698"). InnerVolumeSpecName "kube-api-access-2mgwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:38:13.463182 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.463142 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/740cedc3-3a11-4885-96b6-ed46d9fe1698-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "740cedc3-3a11-4885-96b6-ed46d9fe1698" (UID: "740cedc3-3a11-4885-96b6-ed46d9fe1698"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:38:13.467583 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.467557 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/740cedc3-3a11-4885-96b6-ed46d9fe1698-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "740cedc3-3a11-4885-96b6-ed46d9fe1698" (UID: "740cedc3-3a11-4885-96b6-ed46d9fe1698"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:38:13.558018 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.557937 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/740cedc3-3a11-4885-96b6-ed46d9fe1698-tls-cert\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:38:13.558018 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.557965 2577 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/740cedc3-3a11-4885-96b6-ed46d9fe1698-oidc-ca\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:38:13.558018 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.557980 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mgwx\" (UniqueName: \"kubernetes.io/projected/740cedc3-3a11-4885-96b6-ed46d9fe1698-kube-api-access-2mgwx\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:38:13.644735 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.644699 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:13.742430 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:13.742391 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:14.097464 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:14.097433 2577 generic.go:356] "Generic (PLEG): container finished" podID="740cedc3-3a11-4885-96b6-ed46d9fe1698" containerID="0601993981a3c584a4f58b3c20328a3414f2b0b87fc4466cb9cda6035b476f00" exitCode=0 Jun 03 19:38:14.097937 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:14.097484 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" Jun 03 19:38:14.097937 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:14.097516 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" event={"ID":"740cedc3-3a11-4885-96b6-ed46d9fe1698","Type":"ContainerDied","Data":"0601993981a3c584a4f58b3c20328a3414f2b0b87fc4466cb9cda6035b476f00"} Jun 03 19:38:14.097937 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:14.097558 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-664f9bd4c9-8b7kt" event={"ID":"740cedc3-3a11-4885-96b6-ed46d9fe1698","Type":"ContainerDied","Data":"8927e49acc05a459e6b52e303fb71668a5b611d3a61db0c8b0ae2206f0b6b4a7"} Jun 03 19:38:14.097937 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:14.097575 2577 scope.go:117] "RemoveContainer" containerID="0601993981a3c584a4f58b3c20328a3414f2b0b87fc4466cb9cda6035b476f00" Jun 03 19:38:14.107686 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:14.107667 2577 scope.go:117] "RemoveContainer" containerID="0601993981a3c584a4f58b3c20328a3414f2b0b87fc4466cb9cda6035b476f00" Jun 03 19:38:14.107935 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:38:14.107920 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0601993981a3c584a4f58b3c20328a3414f2b0b87fc4466cb9cda6035b476f00\": container with ID starting with 0601993981a3c584a4f58b3c20328a3414f2b0b87fc4466cb9cda6035b476f00 not found: ID does not exist" containerID="0601993981a3c584a4f58b3c20328a3414f2b0b87fc4466cb9cda6035b476f00" Jun 03 19:38:14.108012 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:14.107943 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0601993981a3c584a4f58b3c20328a3414f2b0b87fc4466cb9cda6035b476f00"} err="failed to get container status \"0601993981a3c584a4f58b3c20328a3414f2b0b87fc4466cb9cda6035b476f00\": rpc error: code = NotFound desc = could not find container \"0601993981a3c584a4f58b3c20328a3414f2b0b87fc4466cb9cda6035b476f00\": container with ID starting with 0601993981a3c584a4f58b3c20328a3414f2b0b87fc4466cb9cda6035b476f00 not found: ID does not exist" Jun 03 19:38:14.123960 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:14.123937 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-664f9bd4c9-8b7kt"] Jun 03 19:38:14.126426 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:14.126408 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-664f9bd4c9-8b7kt"] Jun 03 19:38:15.279575 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:15.279542 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="740cedc3-3a11-4885-96b6-ed46d9fe1698" path="/var/lib/kubelet/pods/740cedc3-3a11-4885-96b6-ed46d9fe1698/volumes" Jun 03 19:38:27.376786 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:27.376752 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:43.919544 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:43.919458 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:43.978102 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:43.978047 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:44.095862 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:44.095825 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:38:55.099850 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:38:55.099812 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:39:03.892409 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:03.892366 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:39:14.591871 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:14.591833 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:39:22.900395 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:22.900354 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:39:33.795150 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:33.795117 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:39:41.391420 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:41.391387 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7db85598d-wzlzm"] Jun 03 19:39:41.391794 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:41.391757 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="740cedc3-3a11-4885-96b6-ed46d9fe1698" containerName="authorino" Jun 03 19:39:41.391794 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:41.391768 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="740cedc3-3a11-4885-96b6-ed46d9fe1698" containerName="authorino" Jun 03 19:39:41.391869 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:41.391837 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="740cedc3-3a11-4885-96b6-ed46d9fe1698" containerName="authorino" Jun 03 19:39:41.394991 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:41.394976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db85598d-wzlzm" Jun 03 19:39:41.399074 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:41.399046 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 19:39:41.399194 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:41.399176 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hqcvx\"" Jun 03 19:39:41.404744 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:41.404719 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db85598d-wzlzm"] Jun 03 19:39:41.440242 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:41.440212 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6q62\" (UniqueName: \"kubernetes.io/projected/e1a9dce9-f034-4f85-a133-a59bbd173851-kube-api-access-z6q62\") pod \"maas-controller-7db85598d-wzlzm\" (UID: \"e1a9dce9-f034-4f85-a133-a59bbd173851\") " pod="opendatahub/maas-controller-7db85598d-wzlzm" Jun 03 19:39:41.540890 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:41.540857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6q62\" (UniqueName: \"kubernetes.io/projected/e1a9dce9-f034-4f85-a133-a59bbd173851-kube-api-access-z6q62\") pod \"maas-controller-7db85598d-wzlzm\" (UID: \"e1a9dce9-f034-4f85-a133-a59bbd173851\") " pod="opendatahub/maas-controller-7db85598d-wzlzm" Jun 03 19:39:41.550774 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:41.550750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6q62\" (UniqueName: \"kubernetes.io/projected/e1a9dce9-f034-4f85-a133-a59bbd173851-kube-api-access-z6q62\") pod \"maas-controller-7db85598d-wzlzm\" (UID: \"e1a9dce9-f034-4f85-a133-a59bbd173851\") " pod="opendatahub/maas-controller-7db85598d-wzlzm" Jun 03 19:39:41.706138 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:41.706040 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db85598d-wzlzm" Jun 03 19:39:41.837571 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:41.837541 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db85598d-wzlzm"] Jun 03 19:39:41.838836 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:39:41.838806 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1a9dce9_f034_4f85_a133_a59bbd173851.slice/crio-07e629170162ced14f895119d9525482127eca75489128e1b8ec580367343a56 WatchSource:0}: Error finding container 07e629170162ced14f895119d9525482127eca75489128e1b8ec580367343a56: Status 404 returned error can't find the container with id 07e629170162ced14f895119d9525482127eca75489128e1b8ec580367343a56 Jun 03 19:39:42.589636 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:42.589596 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db85598d-wzlzm" event={"ID":"e1a9dce9-f034-4f85-a133-a59bbd173851","Type":"ContainerStarted","Data":"0007ce64feec04fe6eeced051f26095b64f390d01248b544a62c5f990749033e"} Jun 03 19:39:42.590047 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:42.589660 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7db85598d-wzlzm" Jun 03 19:39:42.590047 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:42.589678 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db85598d-wzlzm" event={"ID":"e1a9dce9-f034-4f85-a133-a59bbd173851","Type":"ContainerStarted","Data":"07e629170162ced14f895119d9525482127eca75489128e1b8ec580367343a56"} Jun 03 19:39:42.610952 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:42.610899 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7db85598d-wzlzm" podStartSLOduration=1.047380239 podStartE2EDuration="1.610883402s" totalImagesPullingTime="563.503163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:39:42.608389208 +0000 UTC m=+1127.762189225" watchObservedRunningTime="2026-06-03 19:39:42.610883402 +0000 UTC m=+1127.764683426" Jun 03 19:39:53.601505 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:39:53.601476 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7db85598d-wzlzm" Jun 03 19:40:04.801105 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:40:04.801046 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:40:11.102494 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:40:11.102450 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:40:23.274432 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:40:23.274347 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:23.357040 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:40:23.357003 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:31.650727 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:40:31.650656 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:37.600164 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:40:37.600035 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:37.725023 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:40:37.724987 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:47.692516 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:40:47.692481 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:40:55.346838 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:40:55.346806 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:40:55.348944 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:40:55.348918 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:41:03.099892 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:03.099856 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:41:09.704889 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:09.704857 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:09.803321 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:09.803286 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:24.040473 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:24.040433 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:25.271310 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:25.271257 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:33.559896 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:33.559856 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:39.892793 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:39.892753 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:39.958238 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:39.958206 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:40.059053 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:40.059018 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:40.180026 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:40.179936 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:40.266438 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:40.266405 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:40.369430 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:40.369397 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:42.499137 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:42.499096 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:41:56.787688 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:56.787650 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:56.923737 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:56.923696 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:57.025865 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:57.025836 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:58.391539 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:41:58.391501 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:42:02.972309 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:42:02.972275 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:03.034849 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:42:03.034815 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:11.116633 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:42:11.116600 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:11.229166 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:42:11.229132 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:11.357856 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:42:11.357813 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:11.448810 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:42:11.448775 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:14.002168 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:42:14.002129 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:42:27.880294 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:42:27.880260 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:28.008596 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:42:28.008555 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:28.110272 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:42:28.110231 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:30.192405 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:42:30.192373 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:42:34.444561 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:42:34.444527 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:34.499777 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:42:34.499744 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:58.000270 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:42:58.000180 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:43:03.799494 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:43:03.799455 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:43:21.020447 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:43:21.020364 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:28.395251 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:43:28.395212 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:43:37.598353 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:43:37.598320 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:43:54.496781 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:43:54.496743 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:44:03.903910 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:44:03.903871 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:44:20.102619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:44:20.102583 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:44:28.993421 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:44:28.993383 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:45:00.795680 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:45:00.795601 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:45:08.902228 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:45:08.902186 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:45:18.090498 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:45:18.090460 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:45:25.799561 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:45:25.799524 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:45:35.194636 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:45:35.194600 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:45:42.494318 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:45:42.494288 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:45:48.690367 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:45:48.690332 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:45:54.393875 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:45:54.393835 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:45:55.385341 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:45:55.385312 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:45:55.388826 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:45:55.388800 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:46:05.600399 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:46:05.600365 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:46:52.310247 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:46:52.310207 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:47:00.332207 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:47:00.332168 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:47:05.804198 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:47:05.804165 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:47:14.496864 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:47:14.496826 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:47:23.596950 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:47:23.596911 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:47:31.584865 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:47:31.584832 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:32.697892 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:47:32.697857 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:47:40.808518 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:47:40.808479 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:47:49.601452 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:47:49.601368 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:47:52.380428 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:47:52.380376 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:58.588073 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:47:58.588032 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:48:07.611277 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:48:07.611242 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:48:15.898253 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:48:15.898219 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:48:24.794677 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:48:24.794641 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:48:33.412925 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:48:33.412889 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:48:42.196292 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:48:42.196253 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:48:50.699493 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:48:50.699460 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:48:58.896779 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:48:58.896736 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:49:07.792626 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:49:07.792592 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:49:16.603650 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:49:16.603567 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:49:41.293499 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:49:41.293471 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:49:41.381431 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:49:41.381402 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:50:09.602011 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:09.601972 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84"] Jun 03 19:50:09.602458 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:09.602195 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" podUID="e18ddecc-d406-4acc-a6de-121a8087d16e" containerName="manager" containerID="cri-o://145aa86d47100be6e0c7cfba204813fd3e54c07f72be1f2289e42fb508e0e45e" gracePeriod=10 Jun 03 19:50:09.949953 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:09.949930 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" Jun 03 19:50:10.047337 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.047306 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qnmq\" (UniqueName: \"kubernetes.io/projected/e18ddecc-d406-4acc-a6de-121a8087d16e-kube-api-access-6qnmq\") pod \"e18ddecc-d406-4acc-a6de-121a8087d16e\" (UID: \"e18ddecc-d406-4acc-a6de-121a8087d16e\") " Jun 03 19:50:10.047337 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.047338 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18ddecc-d406-4acc-a6de-121a8087d16e-extensions-socket-volume\") pod \"e18ddecc-d406-4acc-a6de-121a8087d16e\" (UID: \"e18ddecc-d406-4acc-a6de-121a8087d16e\") " Jun 03 19:50:10.047659 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.047640 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e18ddecc-d406-4acc-a6de-121a8087d16e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e18ddecc-d406-4acc-a6de-121a8087d16e" (UID: "e18ddecc-d406-4acc-a6de-121a8087d16e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:50:10.049325 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.049298 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e18ddecc-d406-4acc-a6de-121a8087d16e-kube-api-access-6qnmq" (OuterVolumeSpecName: "kube-api-access-6qnmq") pod "e18ddecc-d406-4acc-a6de-121a8087d16e" (UID: "e18ddecc-d406-4acc-a6de-121a8087d16e"). InnerVolumeSpecName "kube-api-access-6qnmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:50:10.142437 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.142412 2577 generic.go:356] "Generic (PLEG): container finished" podID="e18ddecc-d406-4acc-a6de-121a8087d16e" containerID="145aa86d47100be6e0c7cfba204813fd3e54c07f72be1f2289e42fb508e0e45e" exitCode=0 Jun 03 19:50:10.142547 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.142456 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" Jun 03 19:50:10.142547 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.142497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" event={"ID":"e18ddecc-d406-4acc-a6de-121a8087d16e","Type":"ContainerDied","Data":"145aa86d47100be6e0c7cfba204813fd3e54c07f72be1f2289e42fb508e0e45e"} Jun 03 19:50:10.142626 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.142550 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84" event={"ID":"e18ddecc-d406-4acc-a6de-121a8087d16e","Type":"ContainerDied","Data":"45097c246570c538177f1a72e21bd2eed522338fd994140ffdf6fde1e4db7c03"} Jun 03 19:50:10.142626 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.142576 2577 scope.go:117] "RemoveContainer" containerID="145aa86d47100be6e0c7cfba204813fd3e54c07f72be1f2289e42fb508e0e45e" Jun 03 19:50:10.149170 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.149139 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qnmq\" (UniqueName: \"kubernetes.io/projected/e18ddecc-d406-4acc-a6de-121a8087d16e-kube-api-access-6qnmq\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:50:10.149287 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.149174 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18ddecc-d406-4acc-a6de-121a8087d16e-extensions-socket-volume\") on node \"ip-10-0-137-13.ec2.internal\" DevicePath \"\"" Jun 03 19:50:10.157449 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.157431 2577 scope.go:117] "RemoveContainer" containerID="145aa86d47100be6e0c7cfba204813fd3e54c07f72be1f2289e42fb508e0e45e" Jun 03 19:50:10.157691 ip-10-0-137-13 kubenswrapper[2577]: E0603 19:50:10.157673 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"145aa86d47100be6e0c7cfba204813fd3e54c07f72be1f2289e42fb508e0e45e\": container with ID starting with 145aa86d47100be6e0c7cfba204813fd3e54c07f72be1f2289e42fb508e0e45e not found: ID does not exist" containerID="145aa86d47100be6e0c7cfba204813fd3e54c07f72be1f2289e42fb508e0e45e" Jun 03 19:50:10.157753 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.157696 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"145aa86d47100be6e0c7cfba204813fd3e54c07f72be1f2289e42fb508e0e45e"} err="failed to get container status \"145aa86d47100be6e0c7cfba204813fd3e54c07f72be1f2289e42fb508e0e45e\": rpc error: code = NotFound desc = could not find container \"145aa86d47100be6e0c7cfba204813fd3e54c07f72be1f2289e42fb508e0e45e\": container with ID starting with 145aa86d47100be6e0c7cfba204813fd3e54c07f72be1f2289e42fb508e0e45e not found: ID does not exist" Jun 03 19:50:10.174480 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.174450 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84"] Jun 03 19:50:10.178921 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:10.178895 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2v84"] Jun 03 19:50:11.279169 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:11.279138 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e18ddecc-d406-4acc-a6de-121a8087d16e" path="/var/lib/kubelet/pods/e18ddecc-d406-4acc-a6de-121a8087d16e/volumes" Jun 03 19:50:55.427480 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:55.427454 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:50:55.429767 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:50:55.429746 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:51:15.744501 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:15.744467 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7"] Jun 03 19:51:15.744885 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:15.744842 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18ddecc-d406-4acc-a6de-121a8087d16e" containerName="manager" Jun 03 19:51:15.744885 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:15.744853 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18ddecc-d406-4acc-a6de-121a8087d16e" containerName="manager" Jun 03 19:51:15.744956 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:15.744926 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e18ddecc-d406-4acc-a6de-121a8087d16e" containerName="manager" Jun 03 19:51:15.749143 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:15.749127 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7" Jun 03 19:51:15.753272 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:15.753255 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rxrjc\"" Jun 03 19:51:15.765468 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:15.765444 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7"] Jun 03 19:51:15.804167 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:15.804137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvv5h\" (UniqueName: \"kubernetes.io/projected/9a00f905-7346-4816-b9a3-9b78fafc1ff3-kube-api-access-qvv5h\") pod \"kuadrant-operator-controller-manager-86878c769f-qjlf7\" (UID: \"9a00f905-7346-4816-b9a3-9b78fafc1ff3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7" Jun 03 19:51:15.804320 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:15.804201 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a00f905-7346-4816-b9a3-9b78fafc1ff3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qjlf7\" (UID: \"9a00f905-7346-4816-b9a3-9b78fafc1ff3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7" Jun 03 19:51:15.905591 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:15.905555 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvv5h\" (UniqueName: \"kubernetes.io/projected/9a00f905-7346-4816-b9a3-9b78fafc1ff3-kube-api-access-qvv5h\") pod \"kuadrant-operator-controller-manager-86878c769f-qjlf7\" (UID: \"9a00f905-7346-4816-b9a3-9b78fafc1ff3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7" Jun 03 19:51:15.905791 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:15.905622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a00f905-7346-4816-b9a3-9b78fafc1ff3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qjlf7\" (UID: \"9a00f905-7346-4816-b9a3-9b78fafc1ff3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7" Jun 03 19:51:15.905979 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:15.905962 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a00f905-7346-4816-b9a3-9b78fafc1ff3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qjlf7\" (UID: \"9a00f905-7346-4816-b9a3-9b78fafc1ff3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7" Jun 03 19:51:15.917356 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:15.917333 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvv5h\" (UniqueName: \"kubernetes.io/projected/9a00f905-7346-4816-b9a3-9b78fafc1ff3-kube-api-access-qvv5h\") pod \"kuadrant-operator-controller-manager-86878c769f-qjlf7\" (UID: \"9a00f905-7346-4816-b9a3-9b78fafc1ff3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7" Jun 03 19:51:16.059380 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:16.059284 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7" Jun 03 19:51:16.203679 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:16.203652 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7"] Jun 03 19:51:16.205766 ip-10-0-137-13 kubenswrapper[2577]: W0603 19:51:16.205739 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a00f905_7346_4816_b9a3_9b78fafc1ff3.slice/crio-a2456c3be271299c96ae669684fbc23557a9a37dcd6c0e835a0c8b6ecd3150f1 WatchSource:0}: Error finding container a2456c3be271299c96ae669684fbc23557a9a37dcd6c0e835a0c8b6ecd3150f1: Status 404 returned error can't find the container with id a2456c3be271299c96ae669684fbc23557a9a37dcd6c0e835a0c8b6ecd3150f1 Jun 03 19:51:16.514034 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:16.513996 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7" event={"ID":"9a00f905-7346-4816-b9a3-9b78fafc1ff3","Type":"ContainerStarted","Data":"7a1a31fa4d1461bc8e24b0a5a37f3309f12a6b3dfe513ff74f42da39ce28578f"} Jun 03 19:51:16.514248 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:16.514046 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7" event={"ID":"9a00f905-7346-4816-b9a3-9b78fafc1ff3","Type":"ContainerStarted","Data":"a2456c3be271299c96ae669684fbc23557a9a37dcd6c0e835a0c8b6ecd3150f1"} Jun 03 19:51:16.514248 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:16.514096 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7" Jun 03 19:51:16.542105 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:16.542024 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7" podStartSLOduration=1.542004444 podStartE2EDuration="1.542004444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:51:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:51:16.539469408 +0000 UTC m=+1821.693269409" watchObservedRunningTime="2026-06-03 19:51:16.542004444 +0000 UTC m=+1821.695804404" Jun 03 19:51:27.522085 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:27.522028 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qjlf7" Jun 03 19:51:36.098035 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:36.098004 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:51:38.057447 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:38.057409 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:51:38.145052 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:38.145011 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:51:44.087203 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:51:44.087168 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:52:07.087020 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:52:07.086983 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:52:13.007104 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:52:13.007014 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:52:23.892258 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:52:23.892228 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:52:33.104401 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:52:33.104369 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:52:41.491896 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:52:41.491867 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:52:53.502501 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:52:53.502463 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:53:01.801150 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:53:01.801120 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:53:12.600565 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:53:12.600530 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:53:20.697223 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:53:20.697186 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:53:31.000300 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:53:31.000259 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:53:41.048365 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:53:41.048327 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:54:15.399093 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:54:15.399004 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:54:58.696779 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:54:58.696741 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:55:07.291447 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:55:07.291412 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:55:16.189718 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:55:16.189638 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:55:25.204535 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:55:25.204500 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:55:34.094754 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:55:34.094716 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:55:48.491729 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:55:48.491693 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:55:55.467177 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:55:55.467151 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:55:55.471287 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:55:55.471264 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 19:55:57.300395 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:55:57.300356 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:56:07.702619 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:56:07.702585 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:56:15.995794 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:56:15.995755 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:56:24.400504 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:56:24.400467 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:56:33.190577 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:56:33.190544 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:56:41.472378 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:56:41.472333 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:56:42.577422 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:56:42.577392 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 19:56:44.902041 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:56:44.902013 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:57:01.807250 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:57:01.807204 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:57:10.602000 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:57:10.601965 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:57:20.309141 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:57:20.309110 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:57:28.199773 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:57:28.199739 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:57:44.496217 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:57:44.496176 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:57:53.296170 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:57:53.296131 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:58:01.598979 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:58:01.598943 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:58:09.897394 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:58:09.897360 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:58:20.401955 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:58:20.401877 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:58:28.901709 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:58:28.901676 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:58:37.400186 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:58:37.400153 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:58:49.797328 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:58:49.797285 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:58:58.494961 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:58:58.494911 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:59:13.196381 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:59:13.196349 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:59:21.098490 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:59:21.098448 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:59:28.316154 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:59:28.316119 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:59:37.999245 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:59:37.999207 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 19:59:48.397349 ip-10-0-137-13 kubenswrapper[2577]: I0603 19:59:48.397273 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 20:00:05.090014 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:00:05.089977 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 20:00:13.899736 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:00:13.899698 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 20:00:19.534481 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:00:19.534449 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 20:00:22.509366 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:00:22.509333 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 20:00:29.079361 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:00:29.079331 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 20:00:32.497326 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:00:32.497287 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 20:00:53.356718 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:00:53.356688 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 20:00:55.505075 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:00:55.505034 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 20:00:55.511919 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:00:55.511900 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzxkd_5b80904c-705a-43ea-a92e-aec87054d9a9/ovn-acl-logging/0.log" Jun 03 20:00:56.490402 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:00:56.490372 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 20:01:06.398975 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:06.398932 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 20:01:07.690760 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:07.690724 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r2xf6"] Jun 03 20:01:13.888266 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:13.888194 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6887ffdd5d-plrgn_794de4f8-a42a-4384-adc0-bca4b821a00e/authorino/0.log" Jun 03 20:01:18.360020 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:18.359990 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8b9ffc7d9-m4zfp_17f94266-2a38-4c97-85f1-a17192aec788/nginx/0.log" Jun 03 20:01:18.845326 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:18.845299 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-bc774799-f9q5b_15db0965-0f2c-436e-a824-392d21b0a634/maas-api/0.log" Jun 03 20:01:19.179369 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:19.179342 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7db85598d-wzlzm_e1a9dce9-f034-4f85-a133-a59bbd173851/manager/0.log" Jun 03 20:01:19.803940 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:19.803910 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d56d45df5-swwvb_445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc/copy-manifests/0.log" Jun 03 20:01:19.810593 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:19.810570 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d56d45df5-swwvb_445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc/manager/0.log" Jun 03 20:01:20.696425 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:20.696390 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr_528f64c4-fab7-450e-97f4-8de8b90e6a64/util/0.log" Jun 03 20:01:20.702945 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:20.702917 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr_528f64c4-fab7-450e-97f4-8de8b90e6a64/pull/0.log" Jun 03 20:01:20.708980 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:20.708962 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr_528f64c4-fab7-450e-97f4-8de8b90e6a64/extract/0.log" Jun 03 20:01:20.822038 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:20.822002 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw_f71690e9-045b-463e-aebe-700a1f27af93/util/0.log" Jun 03 20:01:20.828903 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:20.828879 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw_f71690e9-045b-463e-aebe-700a1f27af93/pull/0.log" Jun 03 20:01:20.835588 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:20.835567 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw_f71690e9-045b-463e-aebe-700a1f27af93/extract/0.log" Jun 03 20:01:20.945874 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:20.945848 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb_f6d83b00-ee2d-4304-8227-8f91c44201a5/util/0.log" Jun 03 20:01:20.952495 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:20.952437 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb_f6d83b00-ee2d-4304-8227-8f91c44201a5/pull/0.log" Jun 03 20:01:20.958561 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:20.958543 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb_f6d83b00-ee2d-4304-8227-8f91c44201a5/extract/0.log" Jun 03 20:01:21.072354 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:21.072335 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl_c8da761c-5723-4f84-b134-6edc0f8b037c/util/0.log" Jun 03 20:01:21.078505 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:21.078484 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl_c8da761c-5723-4f84-b134-6edc0f8b037c/pull/0.log" Jun 03 20:01:21.085183 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:21.085166 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl_c8da761c-5723-4f84-b134-6edc0f8b037c/extract/0.log" Jun 03 20:01:21.206589 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:21.206509 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6887ffdd5d-plrgn_794de4f8-a42a-4384-adc0-bca4b821a00e/authorino/0.log" Jun 03 20:01:21.439103 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:21.439078 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zslbh_e802d89c-afdb-410b-96fd-e22a55ba7b18/manager/0.log" Jun 03 20:01:21.671484 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:21.671457 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qrx56_df3ec488-a82f-4393-b72c-678f41a510a1/registry-server/0.log" Jun 03 20:01:21.794510 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:21.794477 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qjlf7_9a00f905-7346-4816-b9a3-9b78fafc1ff3/manager/0.log" Jun 03 20:01:21.901809 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:21.901781 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-r2xf6_8507314b-cc3c-4ba8-955f-4ca95e423950/limitador/0.log" Jun 03 20:01:22.019257 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:22.019172 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ljj6g_7b670adf-8933-4750-be87-6d07fee2ac9d/manager/0.log" Jun 03 20:01:22.357298 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:22.357194 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795t254m_5cc72d2c-96e8-4c0d-9771-5c473157e27f/istio-proxy/0.log" Jun 03 20:01:23.056654 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:23.056629 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54c9bb4859-mjcg4_45d61802-f1e6-4f1e-8686-953b64e982e1/router/0.log" Jun 03 20:01:28.014879 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.014836 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sfrrm/must-gather-gn52x"] Jun 03 20:01:28.018285 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.018263 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sfrrm/must-gather-gn52x" Jun 03 20:01:28.021521 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.021492 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sfrrm\"/\"openshift-service-ca.crt\"" Jun 03 20:01:28.021521 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.021507 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sfrrm\"/\"default-dockercfg-h4xnk\"" Jun 03 20:01:28.021705 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.021492 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sfrrm\"/\"kube-root-ca.crt\"" Jun 03 20:01:28.026732 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.026708 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 20:01:28.028895 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.028875 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sfrrm/must-gather-gn52x"] Jun 03 20:01:28.068239 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.068220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m79q\" (UniqueName: \"kubernetes.io/projected/29427c7d-7c9a-4726-89c0-ed4bf49914f1-kube-api-access-9m79q\") pod \"must-gather-gn52x\" (UID: \"29427c7d-7c9a-4726-89c0-ed4bf49914f1\") " pod="openshift-must-gather-sfrrm/must-gather-gn52x" Jun 03 20:01:28.068332 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.068254 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/29427c7d-7c9a-4726-89c0-ed4bf49914f1-must-gather-output\") pod \"must-gather-gn52x\" (UID: \"29427c7d-7c9a-4726-89c0-ed4bf49914f1\") " pod="openshift-must-gather-sfrrm/must-gather-gn52x" Jun 03 20:01:28.124658 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.124634 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 20:01:28.168921 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.168898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m79q\" (UniqueName: \"kubernetes.io/projected/29427c7d-7c9a-4726-89c0-ed4bf49914f1-kube-api-access-9m79q\") pod \"must-gather-gn52x\" (UID: \"29427c7d-7c9a-4726-89c0-ed4bf49914f1\") " pod="openshift-must-gather-sfrrm/must-gather-gn52x" Jun 03 20:01:28.169000 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.168933 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/29427c7d-7c9a-4726-89c0-ed4bf49914f1-must-gather-output\") pod \"must-gather-gn52x\" (UID: \"29427c7d-7c9a-4726-89c0-ed4bf49914f1\") " pod="openshift-must-gather-sfrrm/must-gather-gn52x" Jun 03 20:01:28.169330 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.169314 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/29427c7d-7c9a-4726-89c0-ed4bf49914f1-must-gather-output\") pod \"must-gather-gn52x\" (UID: \"29427c7d-7c9a-4726-89c0-ed4bf49914f1\") " pod="openshift-must-gather-sfrrm/must-gather-gn52x" Jun 03 20:01:28.179044 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.179024 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m79q\" (UniqueName: \"kubernetes.io/projected/29427c7d-7c9a-4726-89c0-ed4bf49914f1-kube-api-access-9m79q\") pod \"must-gather-gn52x\" (UID: \"29427c7d-7c9a-4726-89c0-ed4bf49914f1\") " pod="openshift-must-gather-sfrrm/must-gather-gn52x" Jun 03 20:01:28.328819 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.328768 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sfrrm/must-gather-gn52x" Jun 03 20:01:28.458860 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.458835 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sfrrm/must-gather-gn52x"] Jun 03 20:01:28.459770 ip-10-0-137-13 kubenswrapper[2577]: W0603 20:01:28.459750 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29427c7d_7c9a_4726_89c0_ed4bf49914f1.slice/crio-8be049d4e596a5bbc0884ffc392a6f8bd8cbaa5cbdf35a49ca32478d408f4798 WatchSource:0}: Error finding container 8be049d4e596a5bbc0884ffc392a6f8bd8cbaa5cbdf35a49ca32478d408f4798: Status 404 returned error can't find the container with id 8be049d4e596a5bbc0884ffc392a6f8bd8cbaa5cbdf35a49ca32478d408f4798 Jun 03 20:01:28.461647 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.461628 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:01:28.937304 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:28.937272 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sfrrm/must-gather-gn52x" event={"ID":"29427c7d-7c9a-4726-89c0-ed4bf49914f1","Type":"ContainerStarted","Data":"8be049d4e596a5bbc0884ffc392a6f8bd8cbaa5cbdf35a49ca32478d408f4798"} Jun 03 20:01:29.947374 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:29.947305 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sfrrm/must-gather-gn52x" event={"ID":"29427c7d-7c9a-4726-89c0-ed4bf49914f1","Type":"ContainerStarted","Data":"ecdd8eda571018b26e0ca772853355362cb4004eaa3f4407b2ee349e39b9d601"} Jun 03 20:01:29.947374 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:29.947357 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sfrrm/must-gather-gn52x" event={"ID":"29427c7d-7c9a-4726-89c0-ed4bf49914f1","Type":"ContainerStarted","Data":"6f18bd8c9876de2b310947175c0c6a86c5b426674f4d2fc6fd9a7168c1ca1ee3"} Jun 03 20:01:31.490701 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:31.490673 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mqnqr_6f5da0f5-156c-4957-9bda-9ca3ee8424d5/global-pull-secret-syncer/0.log" Jun 03 20:01:31.564189 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:31.564157 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" Jun 03 20:01:31.727892 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:31.727851 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-13.ec2.internal_7eb3c1cfcb49aa68904ca072c5dfae8e/haproxy/0.log" Jun 03 20:01:33.447735 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:33.447698 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 20:01:33.505050 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:33.505007 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mb5qw_3c01f875-c8ce-40f5-93b4-24b85c92f915/konnectivity-agent/0.log" limit=1024 Jun 03 20:01:35.898603 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:35.898553 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr_528f64c4-fab7-450e-97f4-8de8b90e6a64/extract/0.log" Jun 03 20:01:35.921019 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:35.920965 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr_528f64c4-fab7-450e-97f4-8de8b90e6a64/util/0.log" Jun 03 20:01:35.944603 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:35.944526 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h6zwr_528f64c4-fab7-450e-97f4-8de8b90e6a64/pull/0.log" Jun 03 20:01:35.981412 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:35.981380 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw_f71690e9-045b-463e-aebe-700a1f27af93/extract/0.log" Jun 03 20:01:36.014955 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:36.014645 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw_f71690e9-045b-463e-aebe-700a1f27af93/util/0.log" Jun 03 20:01:36.048927 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:36.048887 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hzw_f71690e9-045b-463e-aebe-700a1f27af93/pull/0.log" Jun 03 20:01:36.083983 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:36.083953 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb_f6d83b00-ee2d-4304-8227-8f91c44201a5/extract/0.log" Jun 03 20:01:36.104689 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:36.104654 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb_f6d83b00-ee2d-4304-8227-8f91c44201a5/util/0.log" Jun 03 20:01:36.129995 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:36.129910 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734vqcb_f6d83b00-ee2d-4304-8227-8f91c44201a5/pull/0.log" Jun 03 20:01:36.172954 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:36.172912 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl_c8da761c-5723-4f84-b134-6edc0f8b037c/extract/0.log" Jun 03 20:01:36.198153 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:36.198116 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl_c8da761c-5723-4f84-b134-6edc0f8b037c/util/0.log" Jun 03 20:01:36.230748 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:36.230711 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k25wl_c8da761c-5723-4f84-b134-6edc0f8b037c/pull/0.log" Jun 03 20:01:36.527078 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:36.526956 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6887ffdd5d-plrgn_794de4f8-a42a-4384-adc0-bca4b821a00e/authorino/0.log" Jun 03 20:01:36.612429 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:36.612391 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zslbh_e802d89c-afdb-410b-96fd-e22a55ba7b18/manager/0.log" Jun 03 20:01:36.687415 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:36.687381 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qrx56_df3ec488-a82f-4393-b72c-678f41a510a1/registry-server/0.log" Jun 03 20:01:36.757134 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:36.757100 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qjlf7_9a00f905-7346-4816-b9a3-9b78fafc1ff3/manager/0.log" Jun 03 20:01:36.784381 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:36.784291 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-r2xf6_8507314b-cc3c-4ba8-955f-4ca95e423950/limitador/0.log" Jun 03 20:01:36.868083 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:36.867884 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ljj6g_7b670adf-8933-4750-be87-6d07fee2ac9d/manager/0.log" Jun 03 20:01:38.425453 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:38.425425 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7528efa2-4cc0-44bd-88f7-2f724631d050/alertmanager/0.log" Jun 03 20:01:38.455720 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:38.455694 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7528efa2-4cc0-44bd-88f7-2f724631d050/config-reloader/0.log" Jun 03 20:01:38.480873 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:38.480848 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7528efa2-4cc0-44bd-88f7-2f724631d050/kube-rbac-proxy-web/0.log" Jun 03 20:01:38.505111 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:38.505076 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7528efa2-4cc0-44bd-88f7-2f724631d050/kube-rbac-proxy/0.log" Jun 03 20:01:38.531034 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:38.531004 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7528efa2-4cc0-44bd-88f7-2f724631d050/kube-rbac-proxy-metric/0.log" Jun 03 20:01:38.555611 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:38.555584 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7528efa2-4cc0-44bd-88f7-2f724631d050/prom-label-proxy/0.log" Jun 03 20:01:38.580755 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:38.580728 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7528efa2-4cc0-44bd-88f7-2f724631d050/init-config-reloader/0.log" Jun 03 20:01:38.623618 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:38.623588 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-57769895dd-qhn5z_3716079f-b675-4a70-8cb8-a096320abdfd/cluster-monitoring-operator/0.log" Jun 03 20:01:38.907344 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:38.907316 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67rbb_595873e0-90c0-43cd-a8ab-218af0d80478/node-exporter/0.log" Jun 03 20:01:38.934173 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:38.934145 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67rbb_595873e0-90c0-43cd-a8ab-218af0d80478/kube-rbac-proxy/0.log" Jun 03 20:01:38.966691 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:38.966657 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67rbb_595873e0-90c0-43cd-a8ab-218af0d80478/init-textfile/0.log" Jun 03 20:01:39.411169 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:39.411139 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-fsqw6_57198e72-4919-484a-87e6-dbe74f218b85/prometheus-operator/0.log" Jun 03 20:01:39.435947 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:39.435921 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-fsqw6_57198e72-4919-484a-87e6-dbe74f218b85/kube-rbac-proxy/0.log" Jun 03 20:01:39.509857 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:39.509827 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6ff645f84-cbnlr_5aee757f-5f14-4da8-8628-198c36a3b941/telemeter-client/0.log" Jun 03 20:01:39.539583 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:39.539536 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6ff645f84-cbnlr_5aee757f-5f14-4da8-8628-198c36a3b941/reload/0.log" Jun 03 20:01:39.579351 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:39.579290 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6ff645f84-cbnlr_5aee757f-5f14-4da8-8628-198c36a3b941/kube-rbac-proxy/0.log" Jun 03 20:01:41.204074 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:41.204032 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-68d6b54856-qx6q2_c7c39a4e-167c-48f2-a0cb-b751f918e9d0/networking-console-plugin/0.log" Jun 03 20:01:42.529704 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:42.529664 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-56b467f5ff-t6v8k_76a07518-27b3-4d26-b03d-dc1b07b74b9c/download-server/0.log" Jun 03 20:01:43.283073 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:43.283035 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-fw75d_c3351a51-09d5-4424-8601-10bafbe6293e/volume-data-source-validator/0.log" Jun 03 20:01:43.784089 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:43.784012 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sfrrm/must-gather-gn52x" podStartSLOduration=15.720090345 podStartE2EDuration="16.783977335s" totalImagesPullingTime="1.06388699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:01:29.966948499 +0000 UTC m=+2435.120748479" watchObservedRunningTime="2026-06-03 20:01:43.783977335 +0000 UTC m=+2448.937777315" Jun 03 20:01:43.788406 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:43.788370 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v"] Jun 03 20:01:43.795350 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:43.795321 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:43.804014 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:43.803984 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v"] Jun 03 20:01:43.929227 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:43.929189 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b393687-345d-4790-8f31-7462fe2e45fa-sys\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:43.929565 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:43.929541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b393687-345d-4790-8f31-7462fe2e45fa-lib-modules\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:43.929754 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:43.929735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b393687-345d-4790-8f31-7462fe2e45fa-podres\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:43.929921 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:43.929907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b393687-345d-4790-8f31-7462fe2e45fa-proc\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:43.930106 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:43.930087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfwnw\" (UniqueName: \"kubernetes.io/projected/3b393687-345d-4790-8f31-7462fe2e45fa-kube-api-access-zfwnw\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:44.031630 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.031592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b393687-345d-4790-8f31-7462fe2e45fa-sys\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:44.031821 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.031675 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b393687-345d-4790-8f31-7462fe2e45fa-lib-modules\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:44.031821 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.031717 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b393687-345d-4790-8f31-7462fe2e45fa-sys\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:44.031821 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.031735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b393687-345d-4790-8f31-7462fe2e45fa-podres\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:44.031821 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.031777 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b393687-345d-4790-8f31-7462fe2e45fa-proc\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:44.031821 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.031820 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfwnw\" (UniqueName: \"kubernetes.io/projected/3b393687-345d-4790-8f31-7462fe2e45fa-kube-api-access-zfwnw\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:44.032159 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.031891 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b393687-345d-4790-8f31-7462fe2e45fa-podres\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:44.032159 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.031955 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b393687-345d-4790-8f31-7462fe2e45fa-proc\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:44.032159 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.032053 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b393687-345d-4790-8f31-7462fe2e45fa-lib-modules\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:44.041735 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.041660 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfwnw\" (UniqueName: \"kubernetes.io/projected/3b393687-345d-4790-8f31-7462fe2e45fa-kube-api-access-zfwnw\") pod \"perf-node-gather-daemonset-6f96v\" (UID: \"3b393687-345d-4790-8f31-7462fe2e45fa\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:44.108790 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.108744 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:44.281295 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.281263 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v"] Jun 03 20:01:44.283810 ip-10-0-137-13 kubenswrapper[2577]: W0603 20:01:44.283745 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3b393687_345d_4790_8f31_7462fe2e45fa.slice/crio-939cff7e9df7c898080fe20c5a44a446ef755941197c7641f4c3d284d375fa07 WatchSource:0}: Error finding container 939cff7e9df7c898080fe20c5a44a446ef755941197c7641f4c3d284d375fa07: Status 404 returned error can't find the container with id 939cff7e9df7c898080fe20c5a44a446ef755941197c7641f4c3d284d375fa07 Jun 03 20:01:44.564427 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.564344 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vps9j_bf4a425b-e55d-427d-891c-fb976b02efcc/dns/0.log" Jun 03 20:01:44.584914 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.584892 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vps9j_bf4a425b-e55d-427d-891c-fb976b02efcc/kube-rbac-proxy/0.log" Jun 03 20:01:44.629230 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:44.629203 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sn9xs_85f61ce5-2bce-478c-96a4-4082d38e04aa/dns-node-resolver/0.log" Jun 03 20:01:45.087098 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:45.087035 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" event={"ID":"3b393687-345d-4790-8f31-7462fe2e45fa","Type":"ContainerStarted","Data":"3a6c36af5b88b7bc39e5ed178b9656ca3a1e7126073398816a411d11bc1add8b"} Jun 03 20:01:45.087521 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:45.087112 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:45.087521 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:45.087136 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" event={"ID":"3b393687-345d-4790-8f31-7462fe2e45fa","Type":"ContainerStarted","Data":"939cff7e9df7c898080fe20c5a44a446ef755941197c7641f4c3d284d375fa07"} Jun 03 20:01:45.105589 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:45.105539 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" podStartSLOduration=2.105520643 podStartE2EDuration="2.105520643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:01:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:01:45.105257636 +0000 UTC m=+2450.259057616" watchObservedRunningTime="2026-06-03 20:01:45.105520643 +0000 UTC m=+2450.259320623" Jun 03 20:01:45.284862 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:45.284833 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zqdtg_7347a83b-e12c-4675-abe4-87c8bf2b2a44/node-ca/0.log" Jun 03 20:01:46.257986 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:46.257937 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795t254m_5cc72d2c-96e8-4c0d-9771-5c473157e27f/istio-proxy/0.log" Jun 03 20:01:46.605262 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:46.605191 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54c9bb4859-mjcg4_45d61802-f1e6-4f1e-8686-953b64e982e1/router/0.log" Jun 03 20:01:47.306384 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:47.306331 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5srf2_e6ce57d8-c75c-44b6-a785-20e4d2bf09f2/serve-healthcheck-canary/0.log" Jun 03 20:01:47.883745 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:47.883712 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-djmrc_31598752-4c6d-47a4-9e99-36f86d580ccd/insights-operator/0.log" Jun 03 20:01:47.884578 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:47.884553 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-djmrc_31598752-4c6d-47a4-9e99-36f86d580ccd/insights-operator/1.log" Jun 03 20:01:47.983672 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:47.983640 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mdshr_f0bb6dc3-78fd-4143-88bb-22df87d5ee58/kube-rbac-proxy/0.log" Jun 03 20:01:48.004639 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:48.004609 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mdshr_f0bb6dc3-78fd-4143-88bb-22df87d5ee58/exporter/0.log" Jun 03 20:01:48.028371 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:48.028351 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mdshr_f0bb6dc3-78fd-4143-88bb-22df87d5ee58/extractor/0.log" Jun 03 20:01:50.437619 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:50.437582 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8b9ffc7d9-m4zfp_17f94266-2a38-4c97-85f1-a17192aec788/nginx/0.log" Jun 03 20:01:50.610918 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:50.610889 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-bc774799-f9q5b_15db0965-0f2c-436e-a824-392d21b0a634/maas-api/0.log" Jun 03 20:01:50.747928 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:50.747840 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7db85598d-wzlzm_e1a9dce9-f034-4f85-a133-a59bbd173851/manager/0.log" Jun 03 20:01:51.008474 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:51.008394 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d56d45df5-swwvb_445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc/manager/0.log" Jun 03 20:01:51.028543 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:51.028518 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d56d45df5-swwvb_445ee3a7-d22d-4eb3-a7e0-45dc53f7a7dc/copy-manifests/0.log" Jun 03 20:01:51.111158 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:51.111132 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-6f96v" Jun 03 20:01:52.625722 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:52.625681 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fcc859b85-5jcgk_f02d01d3-a7ac-4cda-95ad-c8c82a335ef3/manager/0.log" Jun 03 20:01:56.103577 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:56.103464 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795t254m_5cc72d2c-96e8-4c0d-9771-5c473157e27f/istio-proxy/0.log" Jun 03 20:01:56.334658 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:56.334622 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54c9bb4859-mjcg4_45d61802-f1e6-4f1e-8686-953b64e982e1/router/0.log" Jun 03 20:01:57.532103 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:57.532047 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795t254m_5cc72d2c-96e8-4c0d-9771-5c473157e27f/istio-proxy/0.log" Jun 03 20:01:57.780955 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:57.780925 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54c9bb4859-mjcg4_45d61802-f1e6-4f1e-8686-953b64e982e1/router/0.log" Jun 03 20:01:58.998500 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:58.998397 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj_1e7a8bd0-5535-428b-8505-777710a3dd19/kube-storage-version-migrator-operator/1.log" Jun 03 20:01:59.000593 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:59.000567 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-nxpbj_1e7a8bd0-5535-428b-8505-777710a3dd19/kube-storage-version-migrator-operator/0.log" Jun 03 20:01:59.404603 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:59.404571 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795t254m_5cc72d2c-96e8-4c0d-9771-5c473157e27f/istio-proxy/0.log" Jun 03 20:01:59.643391 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:01:59.643364 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54c9bb4859-mjcg4_45d61802-f1e6-4f1e-8686-953b64e982e1/router/0.log" Jun 03 20:02:00.233257 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:02:00.233228 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9v8s_fa17f395-1ee9-4474-b12f-c79309f369e8/kube-multus-additional-cni-plugins/0.log" Jun 03 20:02:00.255026 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:02:00.254991 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9v8s_fa17f395-1ee9-4474-b12f-c79309f369e8/egress-router-binary-copy/0.log" Jun 03 20:02:00.276771 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:02:00.276742 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9v8s_fa17f395-1ee9-4474-b12f-c79309f369e8/cni-plugins/0.log" Jun 03 20:02:00.296512 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:02:00.296486 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9v8s_fa17f395-1ee9-4474-b12f-c79309f369e8/bond-cni-plugin/0.log" Jun 03 20:02:00.316373 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:02:00.316347 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9v8s_fa17f395-1ee9-4474-b12f-c79309f369e8/routeoverride-cni/0.log" Jun 03 20:02:00.336457 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:02:00.336426 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9v8s_fa17f395-1ee9-4474-b12f-c79309f369e8/whereabouts-cni-bincopy/0.log" Jun 03 20:02:00.356988 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:02:00.356955 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9v8s_fa17f395-1ee9-4474-b12f-c79309f369e8/whereabouts-cni/0.log" Jun 03 20:02:00.761551 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:02:00.761515 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n7g4g_f7362bdb-bb9f-45ef-886c-6681b6477b0a/kube-multus/0.log" Jun 03 20:02:00.873609 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:02:00.873524 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s7c4p_995cd1f6-5df5-45c1-80cf-1921f567c92f/network-metrics-daemon/0.log" Jun 03 20:02:00.897291 ip-10-0-137-13 kubenswrapper[2577]: I0603 20:02:00.897222 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s7c4p_995cd1f6-5df5-45c1-80cf-1921f567c92f/kube-rbac-proxy/0.log"