Jun 09 01:12:54.348358 ip-10-0-137-100 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 01:12:54.348368 ip-10-0-137-100 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 01:12:54.348375 ip-10-0-137-100 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 01:12:54.348518 ip-10-0-137-100 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 01:13:04.399770 ip-10-0-137-100 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 01:13:04.399787 ip-10-0-137-100 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4eee74817981462fb7b4dd5f2e81034b -- Jun 09 01:15:36.767541 ip-10-0-137-100 systemd[1]: Starting Kubernetes Kubelet... Jun 09 01:15:37.179661 ip-10-0-137-100 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 01:15:37.179661 ip-10-0-137-100 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 01:15:37.179661 ip-10-0-137-100 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 01:15:37.179661 ip-10-0-137-100 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 01:15:37.179661 ip-10-0-137-100 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 01:15:37.180738 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.180608 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 01:15:37.188901 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188877 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 01:15:37.188901 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188897 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 01:15:37.188901 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188901 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 01:15:37.188901 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188904 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 01:15:37.188901 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188907 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188910 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188914 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188917 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188920 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188923 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188928 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188930 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188933 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188936 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188938 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188940 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188943 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188946 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188948 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188951 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188953 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188956 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188958 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188961 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 01:15:37.189092 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188966 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188970 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188972 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188975 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188978 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188980 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188983 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188985 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188988 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188990 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188993 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188995 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.188998 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189001 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189004 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189007 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189010 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189013 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189016 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189018 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 01:15:37.189588 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189021 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189024 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189026 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189030 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189034 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189036 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189041 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189046 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189049 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189052 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189055 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189058 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189061 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189063 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189066 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189068 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189071 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189074 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189076 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 01:15:37.190139 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189078 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189081 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189083 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189086 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189088 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189091 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189095 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189098 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189101 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189103 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189106 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189109 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189111 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189114 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189117 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189119 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189122 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189124 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189127 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189129 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 01:15:37.190600 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189133 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189135 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189137 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189140 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189143 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189145 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189149 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189152 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189155 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189158 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189161 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189164 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189166 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189169 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189172 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189174 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189857 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189864 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189867 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189871 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 01:15:37.191086 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189875 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189878 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189881 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189884 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189887 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189890 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189892 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189895 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189898 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189901 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189904 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189908 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189910 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189913 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189916 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189919 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189921 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189924 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189926 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189929 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 01:15:37.191566 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189931 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189933 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189936 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189939 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189942 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189944 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189947 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189949 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189954 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189958 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189961 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189966 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189969 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189971 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189974 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189977 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189979 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189982 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189985 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 01:15:37.192054 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189988 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189990 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189993 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.189996 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190000 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190003 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190006 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190009 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190012 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190015 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190018 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190020 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190023 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190026 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190028 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190031 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190033 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190036 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190038 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 01:15:37.192523 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190041 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190043 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190046 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190049 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190052 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190056 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190058 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190061 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190064 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190067 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190070 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190072 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190075 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190077 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190079 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190082 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190084 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190087 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190090 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190092 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 01:15:37.192975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190095 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190097 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190100 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190102 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190105 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190107 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190110 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190112 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190115 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190118 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190120 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190123 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190125 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190128 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190130 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190135 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190137 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190518 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190523 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190526 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 01:15:37.193492 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190529 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190532 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190534 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190537 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190540 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190543 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190546 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190548 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190551 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190553 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190556 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190558 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190561 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190564 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190567 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190571 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190574 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190577 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190579 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190582 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 01:15:37.193972 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190586 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190588 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190591 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190593 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190598 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190601 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190605 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190610 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190613 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190616 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190619 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190622 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190625 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190627 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190630 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190633 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190635 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190638 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190641 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190643 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 01:15:37.194461 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190646 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190648 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190651 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190653 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190656 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190658 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190661 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190664 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190666 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190669 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190671 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190674 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190677 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190679 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190682 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190684 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190687 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190690 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190693 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190696 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 01:15:37.194975 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190699 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190702 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190704 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190707 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190709 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190712 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190715 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190717 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190719 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190722 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190724 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190727 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190730 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190732 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190734 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190737 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190739 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190742 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190744 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190747 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 01:15:37.195469 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190751 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190754 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190756 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190759 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190761 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190763 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190767 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190771 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190774 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190776 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190779 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190783 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190788 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190790 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190793 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.190796 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190864 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190886 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190893 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190897 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 01:15:37.195950 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190900 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190903 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190907 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190911 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190914 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190917 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190920 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190924 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190927 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190930 2567 flags.go:64] FLAG: --cgroup-root="" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190933 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190935 2567 flags.go:64] FLAG: --client-ca-file="" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190939 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190942 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190946 2567 flags.go:64] FLAG: --cluster-domain="" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190948 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190952 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190955 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190958 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190962 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190964 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190967 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190970 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190975 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 09 01:15:37.196439 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190980 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190982 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190986 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190988 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190992 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190995 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.190999 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191001 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191004 2567 flags.go:64] FLAG: --enable-server="true" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191007 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191012 2567 flags.go:64] FLAG: --event-burst="100" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191015 2567 flags.go:64] FLAG: --event-qps="50" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191017 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191020 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191023 2567 flags.go:64] FLAG: --eviction-hard="" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191027 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191030 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191033 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191036 2567 flags.go:64] FLAG: --eviction-soft="" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191039 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191042 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191045 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191048 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191051 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191054 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 01:15:37.196993 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191056 2567 flags.go:64] FLAG: --feature-gates="" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191060 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191063 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191065 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191068 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191071 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191076 2567 flags.go:64] FLAG: --help="false" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191080 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191083 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191086 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191089 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191092 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191095 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191098 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191101 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191104 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191107 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191110 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191113 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191116 2567 flags.go:64] FLAG: --kube-reserved="" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191119 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191122 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191124 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191127 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 01:15:37.197640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191130 2567 flags.go:64] FLAG: --lock-file="" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191133 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191136 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191138 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191144 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191147 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191150 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191153 2567 flags.go:64] FLAG: --logging-format="text" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191156 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191159 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191161 2567 flags.go:64] FLAG: --manifest-url="" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191164 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191168 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191171 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191176 2567 flags.go:64] FLAG: --max-pods="110" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191180 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191183 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191185 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191188 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191191 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191194 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191197 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191204 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191207 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191210 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 01:15:37.198576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191212 2567 flags.go:64] FLAG: --pod-cidr="" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191215 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191220 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191223 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191226 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191229 2567 flags.go:64] FLAG: --port="10250" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191232 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191235 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00f821f643f3f2e77" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191238 2567 flags.go:64] FLAG: --qos-reserved="" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191241 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191244 2567 flags.go:64] FLAG: --register-node="true" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191246 2567 flags.go:64] FLAG: --register-with-taints="" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191250 2567 flags.go:64] FLAG: --registry-burst="10" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191253 2567 flags.go:64] FLAG: --registry-qps="5" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191256 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191259 2567 flags.go:64] FLAG: --reserved-memory="" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191274 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191277 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191280 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191283 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191286 2567 flags.go:64] FLAG: --runonce="false" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191288 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191293 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191296 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191299 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 01:15:37.199650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191302 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191305 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191307 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191310 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191313 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191316 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191319 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191321 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191324 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191327 2567 flags.go:64] FLAG: --system-cgroups="" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191330 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191335 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191337 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191340 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191344 2567 flags.go:64] FLAG: --tls-min-version="" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191347 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191350 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191353 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191355 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191358 2567 flags.go:64] FLAG: --v="2" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191362 2567 flags.go:64] FLAG: --version="false" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191366 2567 flags.go:64] FLAG: --vmodule="" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191369 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.191373 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191479 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 01:15:37.200515 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191483 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191486 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191489 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191492 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191496 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191499 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191502 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191504 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191508 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191512 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191515 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191517 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191520 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191523 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191525 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191528 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191531 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191533 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191536 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 01:15:37.201175 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191538 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191541 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191543 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191546 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191548 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191552 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191555 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191558 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191560 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191563 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191566 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191569 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191572 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191574 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191577 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191580 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191583 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191586 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191589 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 01:15:37.202164 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191592 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191594 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191598 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191601 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191604 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191607 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191609 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191612 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191614 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191617 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191619 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191622 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191624 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191627 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191629 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191632 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191634 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191636 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191639 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 01:15:37.202767 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191642 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191644 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191647 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191649 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191652 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191655 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191657 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191660 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191662 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191664 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191667 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191672 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191675 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191677 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191680 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191683 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191685 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191688 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191690 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191693 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 01:15:37.203500 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191695 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191698 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191701 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191703 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191705 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191708 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191710 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191713 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191715 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191717 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191720 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191722 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191725 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191728 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191730 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191733 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191736 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191739 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191742 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191744 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 01:15:37.204329 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.191747 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.192525 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.200100 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.200120 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.201019 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.201033 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201120 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201128 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201132 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201137 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201141 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201146 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201150 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201154 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201158 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 01:15:37.204836 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201162 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201166 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201170 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201174 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201178 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201182 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201186 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201190 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201196 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201201 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201207 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201212 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201216 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201220 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201224 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201229 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201234 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201238 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201242 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 01:15:37.205384 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201247 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201267 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201271 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201275 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201278 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201282 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201287 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201291 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201294 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201298 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201303 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201306 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201310 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201314 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201318 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201322 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201326 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201329 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201333 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 01:15:37.205853 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201339 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201343 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201347 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201351 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201355 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201359 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201362 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201366 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201371 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201375 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201380 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201385 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201389 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201393 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201397 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201401 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201405 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201409 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201414 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201417 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 01:15:37.206328 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201421 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201426 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201430 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201434 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201438 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201442 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201446 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201450 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201454 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201458 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201462 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201466 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201470 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201477 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201483 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201488 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201492 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201497 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201501 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 01:15:37.206835 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201506 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201510 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201515 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201519 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201525 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201529 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201533 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201538 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201542 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201547 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201551 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201555 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201559 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.201568 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201739 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 01:15:37.207341 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201748 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201753 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201760 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201766 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201771 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201776 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201781 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201787 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201792 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201796 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201800 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201805 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201809 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201813 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201819 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201824 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201829 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201834 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201838 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 01:15:37.207730 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201842 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201846 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201850 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201856 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201860 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201864 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201868 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201872 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201876 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201881 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201885 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201889 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201893 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201897 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201901 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201905 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201909 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201913 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201917 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201921 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 01:15:37.208195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201926 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201930 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201934 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201938 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201942 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201945 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201949 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201954 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201958 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201962 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201966 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201970 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201974 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201978 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201982 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201986 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201991 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.201995 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202000 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202005 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 01:15:37.208715 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202009 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202013 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202017 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202022 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202026 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202030 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202034 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202037 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202042 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202046 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202050 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202055 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202059 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202063 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202067 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202071 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202075 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202079 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202083 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202088 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 01:15:37.209466 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202092 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202096 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202100 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202104 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202108 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202112 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202116 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202121 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202125 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202130 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202134 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202138 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202143 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202147 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202150 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202156 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202162 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202167 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 01:15:37.210011 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:37.202170 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 01:15:37.210458 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.202178 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 01:15:37.210458 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.202372 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 01:15:37.210458 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.204882 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 01:15:37.210458 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.206496 2567 server.go:1019] "Starting client certificate rotation" Jun 09 01:15:37.210458 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.206601 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 01:15:37.210458 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.206638 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 01:15:37.210458 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.209506 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 01:15:37.214056 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.214033 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 01:15:37.223052 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.223036 2567 log.go:25] "Validated CRI v1 runtime API" Jun 09 01:15:37.225583 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.225567 2567 log.go:25] "Validated CRI v1 image API" Jun 09 01:15:37.227145 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.227131 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 01:15:37.229811 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.229788 2567 fs.go:135] Filesystem UUIDs: map[1dbfe68f-a874-43d0-ab2f-ebec425d5db2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d87de76f-7996-4b81-b88e-8d2d7871a0b6:/dev/nvme0n1p4] Jun 09 01:15:37.229880 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.229809 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 01:15:37.235179 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.235059 2567 manager.go:216] Machine: {Timestamp:2026-06-09 01:15:37.233725745 +0000 UTC m=+0.345725589 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200127 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec219b92db6ea33273a28829289a1e26 SystemUUID:ec219b92-db6e-a332-73a2-8829289a1e26 BootID:4eee7481-7981-462f-b7b4-dd5f2e81034b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:16:0b:19:18:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:16:0b:19:18:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:fa:83:ae:50:55 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 01:15:37.235179 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.235172 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 01:15:37.235307 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.235246 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 01:15:37.237943 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.237928 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 01:15:37.238383 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.238361 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 01:15:37.238506 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.238387 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-100.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 01:15:37.239159 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.239149 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 01:15:37.239192 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.239162 2567 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 01:15:37.239192 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.239169 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 01:15:37.239932 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.239921 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 01:15:37.240683 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.240673 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 01:15:37.243426 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.243414 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 09 01:15:37.243543 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.243534 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 01:15:37.243578 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.243564 2567 kubelet.go:486] "Attempting to sync node with API server" Jun 09 01:15:37.243578 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.243576 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 01:15:37.243631 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.243591 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 01:15:37.243631 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.243606 2567 kubelet.go:398] "Adding apiserver pod source" Jun 09 01:15:37.243631 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.243619 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 01:15:37.243965 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.243954 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 01:15:37.244016 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.243971 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 01:15:37.246939 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.246910 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 01:15:37.248376 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.248361 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 01:15:37.248438 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.248392 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 01:15:37.250318 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.250305 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 01:15:37.250357 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.250325 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 01:15:37.250357 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.250331 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 01:15:37.250357 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.250337 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 01:15:37.250357 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.250346 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 01:15:37.250357 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.250352 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 01:15:37.250486 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.250361 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 01:15:37.250486 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.250367 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 01:15:37.250486 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.250375 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 01:15:37.250486 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.250381 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 01:15:37.250486 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.250389 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 01:15:37.250486 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.250394 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 01:15:37.251261 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.251238 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 01:15:37.251305 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.251270 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 01:15:37.253495 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.253467 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 01:15:37.253495 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.253486 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 01:15:37.253639 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.253526 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-100.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 01:15:37.254760 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.254734 2567 server.go:1268] "Started kubelet" Jun 09 01:15:37.254968 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.254920 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 01:15:37.255186 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.254999 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 01:15:37.255436 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.255414 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 01:15:37.255746 ip-10-0-137-100 systemd[1]: Started Kubernetes Kubelet. Jun 09 01:15:37.257149 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.257106 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 01:15:37.257971 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.257955 2567 server.go:310] "Adding debug handlers to kubelet server" Jun 09 01:15:37.262187 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.262169 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 01:15:37.263223 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.263204 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 01:15:37.263325 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.263207 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 01:15:37.263731 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.263430 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jun 09 01:15:37.263891 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.263874 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 01:15:37.263954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.263897 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 01:15:37.263954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.263877 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 01:15:37.264052 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.263980 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 09 01:15:37.264052 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.264004 2567 reconciler.go:29] "Reconciler: start to sync state" Jun 09 01:15:37.264052 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.263994 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 01:15:37.264052 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.264023 2567 factory.go:55] Registering systemd factory Jun 09 01:15:37.264052 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.264034 2567 factory.go:223] Registration of the systemd container factory successfully Jun 09 01:15:37.264353 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.264335 2567 factory.go:153] Registering CRI-O factory Jun 09 01:15:37.264353 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.264355 2567 factory.go:223] Registration of the crio container factory successfully Jun 09 01:15:37.264462 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.264376 2567 factory.go:103] Registering Raw factory Jun 09 01:15:37.264462 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.264393 2567 manager.go:1196] Started watching for new ooms in manager Jun 09 01:15:37.265747 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.265732 2567 manager.go:349] Starting recovery of all containers Jun 09 01:15:37.271717 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.271688 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 01:15:37.271801 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.271747 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 01:15:37.273068 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.271869 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-100.ec2.internal.18b744b8977f810c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-100.ec2.internal,UID:ip-10-0-137-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-100.ec2.internal,},FirstTimestamp:2026-06-09 01:15:37.254707468 +0000 UTC m=+0.366707310,LastTimestamp:2026-06-09 01:15:37.254707468 +0000 UTC m=+0.366707310,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-100.ec2.internal,}" Jun 09 01:15:37.273795 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.273781 2567 manager.go:354] Recovery completed Jun 09 01:15:37.278740 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.278612 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 01:15:37.278804 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.278777 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c7bm6" Jun 09 01:15:37.280985 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.280970 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientMemory" Jun 09 01:15:37.281062 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.280998 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 01:15:37.281062 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.281008 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientPID" Jun 09 01:15:37.281493 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.281480 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 01:15:37.281493 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.281491 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 01:15:37.281599 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.281506 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 09 01:15:37.281599 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.281541 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 01:15:37.282231 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.282217 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientMemory" Jun 09 01:15:37.282302 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.282242 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 01:15:37.282302 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.282268 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientPID" Jun 09 01:15:37.282541 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.282475 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-100.ec2.internal.18b744b8991077d3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-100.ec2.internal,UID:ip-10-0-137-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-100.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-100.ec2.internal,},FirstTimestamp:2026-06-09 01:15:37.280985043 +0000 UTC m=+0.392984886,LastTimestamp:2026-06-09 01:15:37.280985043 +0000 UTC m=+0.392984886,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-100.ec2.internal,}" Jun 09 01:15:37.282613 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.282603 2567 policy_none.go:49] "None policy: Start" Jun 09 01:15:37.282675 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.282618 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 01:15:37.282675 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.282628 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 01:15:37.283600 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.283589 2567 policy_none.go:47] "Start" Jun 09 01:15:37.286210 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.286185 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c7bm6" Jun 09 01:15:37.325915 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.325901 2567 manager.go:337] "Starting Device Plugin manager" Jun 09 01:15:37.338851 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.325932 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 01:15:37.338851 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.325943 2567 server.go:87] "Starting device plugin registration server" Jun 09 01:15:37.338851 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.326221 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 01:15:37.338851 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.326235 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 01:15:37.338851 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.326317 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 01:15:37.338851 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.326403 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 01:15:37.338851 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.326411 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 01:15:37.338851 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.326907 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 01:15:37.338851 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.326961 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-100.ec2.internal\" not found" Jun 09 01:15:37.338851 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.335854 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 01:15:37.338851 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.336965 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 01:15:37.338851 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.337000 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 01:15:37.338851 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.337017 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 01:15:37.338851 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.337051 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 01:15:37.339344 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.339158 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 01:15:37.427317 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.427284 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 01:15:37.428195 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.428178 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientMemory" Jun 09 01:15:37.428308 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.428212 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 01:15:37.428308 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.428224 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientPID" Jun 09 01:15:37.428308 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.428272 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.436943 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.436896 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.436943 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.436921 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-100.ec2.internal\": node \"ip-10-0-137-100.ec2.internal\" not found" Jun 09 01:15:37.437166 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.437150 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal"] Jun 09 01:15:37.437221 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.437212 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 01:15:37.438588 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.438574 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientMemory" Jun 09 01:15:37.438654 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.438602 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 01:15:37.438654 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.438613 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientPID" Jun 09 01:15:37.439869 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.439853 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 01:15:37.439975 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.439961 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.440029 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.439997 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 01:15:37.440595 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.440578 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientMemory" Jun 09 01:15:37.440667 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.440605 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 01:15:37.440667 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.440619 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientPID" Jun 09 01:15:37.440667 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.440630 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientMemory" Jun 09 01:15:37.440667 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.440652 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 01:15:37.440667 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.440666 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientPID" Jun 09 01:15:37.441838 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.441823 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.441914 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.441850 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 01:15:37.442511 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.442495 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientMemory" Jun 09 01:15:37.442580 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.442528 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 01:15:37.442580 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.442541 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientPID" Jun 09 01:15:37.464879 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.464855 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-100.ec2.internal\" not found" node="ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.468875 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.468860 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-100.ec2.internal\" not found" node="ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.492927 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.492906 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jun 09 01:15:37.565048 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.565022 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/03e249ce48a71b0dbb1c60e5635f8c1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal\" (UID: \"03e249ce48a71b0dbb1c60e5635f8c1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.565159 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.565051 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03e249ce48a71b0dbb1c60e5635f8c1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal\" (UID: \"03e249ce48a71b0dbb1c60e5635f8c1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.565159 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.565068 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bd84badc95e7565ce7045e885393d462-config\") pod \"kube-apiserver-proxy-ip-10-0-137-100.ec2.internal\" (UID: \"bd84badc95e7565ce7045e885393d462\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.593512 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.593494 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jun 09 01:15:37.665893 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.665870 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bd84badc95e7565ce7045e885393d462-config\") pod \"kube-apiserver-proxy-ip-10-0-137-100.ec2.internal\" (UID: \"bd84badc95e7565ce7045e885393d462\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.665949 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.665898 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/03e249ce48a71b0dbb1c60e5635f8c1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal\" (UID: \"03e249ce48a71b0dbb1c60e5635f8c1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.665949 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.665914 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03e249ce48a71b0dbb1c60e5635f8c1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal\" (UID: \"03e249ce48a71b0dbb1c60e5635f8c1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.666036 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.665967 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03e249ce48a71b0dbb1c60e5635f8c1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal\" (UID: \"03e249ce48a71b0dbb1c60e5635f8c1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.666036 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.665968 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bd84badc95e7565ce7045e885393d462-config\") pod \"kube-apiserver-proxy-ip-10-0-137-100.ec2.internal\" (UID: \"bd84badc95e7565ce7045e885393d462\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.666036 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.665980 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/03e249ce48a71b0dbb1c60e5635f8c1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal\" (UID: \"03e249ce48a71b0dbb1c60e5635f8c1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.694013 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.693954 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jun 09 01:15:37.768659 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.768636 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.773023 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:37.773009 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" Jun 09 01:15:37.794672 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.794651 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jun 09 01:15:37.895164 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.895139 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jun 09 01:15:37.995615 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:37.995585 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jun 09 01:15:38.093398 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.093369 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 01:15:38.096593 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.096575 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jun 09 01:15:38.161180 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.161151 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 01:15:38.164023 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.164006 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jun 09 01:15:38.182030 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.182009 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 01:15:38.183108 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.183094 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" Jun 09 01:15:38.191094 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.191061 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 01:15:38.206108 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.206058 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 01:15:38.206191 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.206172 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 01:15:38.206242 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.206208 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 01:15:38.206242 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.206213 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 01:15:38.244394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.244372 2567 apiserver.go:52] "Watching apiserver" Jun 09 01:15:38.263395 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.263370 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 01:15:38.263522 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.263485 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 01:15:38.265407 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.265385 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-2rbzj","openshift-multus/multus-zwb2p","openshift-network-diagnostics/network-check-target-5knzh","openshift-ovn-kubernetes/ovnkube-node-67sfl","kube-system/konnectivity-agent-5fxhf","openshift-dns/node-resolver-nxwz8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal","openshift-multus/multus-additional-cni-plugins-tv9m6","openshift-multus/network-metrics-daemon-tkpd9","openshift-network-operator/iptables-alerter-mj825","kube-system/global-pull-secret-syncer-tg2cl","kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl","openshift-cluster-node-tuning-operator/tuned-j25rj"] Jun 09 01:15:38.267044 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.267028 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mj825" Jun 09 01:15:38.268225 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.268207 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.269287 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.269269 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:38.269381 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.269332 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:15:38.269381 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.269344 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 01:15:38.269491 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.269446 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 01:15:38.269534 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.269505 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 01:15:38.269577 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.269532 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gx2h9\"" Jun 09 01:15:38.270692 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.270671 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.271096 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.270840 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 01:15:38.271096 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.271048 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 01:15:38.271245 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.271116 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 01:15:38.271483 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.271464 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lw9cc\"" Jun 09 01:15:38.272440 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.272422 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5fxhf" Jun 09 01:15:38.272954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.272934 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 01:15:38.273043 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.272934 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dgg5w\"" Jun 09 01:15:38.273043 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.272956 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 01:15:38.273314 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.273297 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 01:15:38.273398 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.273340 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 01:15:38.273398 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.273371 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 01:15:38.273398 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.273391 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 01:15:38.273704 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.273690 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nxwz8" Jun 09 01:15:38.274483 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.274467 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 01:15:38.274604 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.274593 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 01:15:38.274760 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.274739 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wfwj6\"" Jun 09 01:15:38.274907 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.274892 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:38.274977 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.274959 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:15:38.276428 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.276407 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.276530 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.276443 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 01:15:38.276530 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.276497 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 01:15:38.276632 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.276616 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-stcvq\"" Jun 09 01:15:38.277370 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.277352 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 01:15:38.277653 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.277636 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.278713 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.278695 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 01:15:38.278794 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.278700 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-949d7\"" Jun 09 01:15:38.278885 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.278871 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2rbzj" Jun 09 01:15:38.279052 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.279035 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 01:15:38.280032 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.280005 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 01:15:38.280353 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.280333 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 01:15:38.280457 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.280392 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 01:15:38.280514 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.280333 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 01:15:38.280652 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.280611 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f9574\"" Jun 09 01:15:38.281509 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.281169 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:38.281509 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.281262 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:15:38.282694 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.282676 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 01:15:38.282776 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.282712 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 01:15:38.283053 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.283021 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 01:15:38.283128 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.283039 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b95r4\"" Jun 09 01:15:38.283604 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.283587 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.285532 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.285515 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 01:15:38.285532 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.285525 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mz8kl\"" Jun 09 01:15:38.285678 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.285608 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 01:15:38.289055 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.289020 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 01:10:37 +0000 UTC" deadline="2028-03-10 19:50:03.320981722 +0000 UTC" Jun 09 01:15:38.289055 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.289054 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15378h34m25.031930186s" Jun 09 01:15:38.296792 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.296778 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qmf8m" Jun 09 01:15:38.305315 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.305296 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qmf8m" Jun 09 01:15:38.331308 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:38.331266 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd84badc95e7565ce7045e885393d462.slice/crio-3d562c221638578d983a568e537523dd89a324e3d3c01a1c57710f0fdb30cfe9 WatchSource:0}: Error finding container 3d562c221638578d983a568e537523dd89a324e3d3c01a1c57710f0fdb30cfe9: Status 404 returned error can't find the container with id 3d562c221638578d983a568e537523dd89a324e3d3c01a1c57710f0fdb30cfe9 Jun 09 01:15:38.331559 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:38.331535 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e249ce48a71b0dbb1c60e5635f8c1f.slice/crio-d80dca6d565bc678452dcada4801973e5c998f7a2ce9396f9b53411dc821c8d9 WatchSource:0}: Error finding container d80dca6d565bc678452dcada4801973e5c998f7a2ce9396f9b53411dc821c8d9: Status 404 returned error can't find the container with id d80dca6d565bc678452dcada4801973e5c998f7a2ce9396f9b53411dc821c8d9 Jun 09 01:15:38.337402 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.337385 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 01:15:38.339756 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.339717 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" event={"ID":"bd84badc95e7565ce7045e885393d462","Type":"ContainerStarted","Data":"3d562c221638578d983a568e537523dd89a324e3d3c01a1c57710f0fdb30cfe9"} Jun 09 01:15:38.340967 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.340943 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" event={"ID":"03e249ce48a71b0dbb1c60e5635f8c1f","Type":"ContainerStarted","Data":"d80dca6d565bc678452dcada4801973e5c998f7a2ce9396f9b53411dc821c8d9"} Jun 09 01:15:38.365414 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.365388 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 01:15:38.368539 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368520 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-sysconfig\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.368623 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368552 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-sysctl-d\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.368623 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368567 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-sysctl-conf\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.368623 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368581 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-var-lib-kubelet\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.368623 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368595 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-hostroot\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.368623 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368610 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-run-systemd\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.368816 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368648 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c80624d4-fc4d-4c5c-88c9-1ddab7ec542d-agent-certs\") pod \"konnectivity-agent-5fxhf\" (UID: \"c80624d4-fc4d-4c5c-88c9-1ddab7ec542d\") " pod="kube-system/konnectivity-agent-5fxhf" Jun 09 01:15:38.368816 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-cnibin\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.368816 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368714 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttsx6\" (UniqueName: \"kubernetes.io/projected/80841e75-6aaa-4374-ad40-80e4e46e71f8-kube-api-access-ttsx6\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.368816 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368729 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-os-release\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.368816 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368743 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-kubelet\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.368816 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368764 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.368816 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368779 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cba164a9-697b-4cec-9ed7-8ca4efb6d492-serviceca\") pod \"node-ca-2rbzj\" (UID: \"cba164a9-697b-4cec-9ed7-8ca4efb6d492\") " pod="openshift-image-registry/node-ca-2rbzj" Jun 09 01:15:38.368816 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368810 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-cni-binary-copy\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.369071 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368855 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-multus-socket-dir-parent\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.369071 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b31c6811-7aca-474e-9b5e-e89eec2deff7-multus-daemon-config\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.369071 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368893 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 01:15:38.369071 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368904 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:38.369071 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368921 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-slash\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.369071 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368942 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a9587dd-afda-456c-8b3f-456328625388-ovnkube-config\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.369071 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368980 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a9587dd-afda-456c-8b3f-456328625388-ovn-node-metrics-cert\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.369071 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.368998 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c80624d4-fc4d-4c5c-88c9-1ddab7ec542d-konnectivity-ca\") pod \"konnectivity-agent-5fxhf\" (UID: \"c80624d4-fc4d-4c5c-88c9-1ddab7ec542d\") " pod="kube-system/konnectivity-agent-5fxhf" Jun 09 01:15:38.369071 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.369071 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369046 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-system-cni-dir\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.369354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369084 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-multus-conf-dir\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.369354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369101 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6rvb\" (UniqueName: \"kubernetes.io/projected/b31c6811-7aca-474e-9b5e-e89eec2deff7-kube-api-access-v6rvb\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.369354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-etc-selinux\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.369354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369157 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-system-cni-dir\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.369354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369184 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07dd722c-1675-4ad3-aead-5d03cd8cdaa4-iptables-alerter-script\") pod \"iptables-alerter-mj825\" (UID: \"07dd722c-1675-4ad3-aead-5d03cd8cdaa4\") " pod="openshift-network-operator/iptables-alerter-mj825" Jun 09 01:15:38.369354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369212 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07dd722c-1675-4ad3-aead-5d03cd8cdaa4-host-slash\") pod \"iptables-alerter-mj825\" (UID: \"07dd722c-1675-4ad3-aead-5d03cd8cdaa4\") " pod="openshift-network-operator/iptables-alerter-mj825" Jun 09 01:15:38.369354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369307 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-dbus\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:38.369354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369328 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-var-lib-openvswitch\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.369354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-cni-netd\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.369354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369355 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-kubernetes\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.369649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369372 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b31c6811-7aca-474e-9b5e-e89eec2deff7-cni-binary-copy\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.369649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369403 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-etc-kubernetes\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.369649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369427 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cba164a9-697b-4cec-9ed7-8ca4efb6d492-host\") pod \"node-ca-2rbzj\" (UID: \"cba164a9-697b-4cec-9ed7-8ca4efb6d492\") " pod="openshift-image-registry/node-ca-2rbzj" Jun 09 01:15:38.369649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369443 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrglg\" (UniqueName: \"kubernetes.io/projected/cba164a9-697b-4cec-9ed7-8ca4efb6d492-kube-api-access-xrglg\") pod \"node-ca-2rbzj\" (UID: \"cba164a9-697b-4cec-9ed7-8ca4efb6d492\") " pod="openshift-image-registry/node-ca-2rbzj" Jun 09 01:15:38.369649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369464 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-kubelet-config\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:38.369649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369492 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-node-log\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.369649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369524 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-cnibin\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.369649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369547 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-modprobe-d\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.369649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369563 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-lib-modules\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.369649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369575 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-host\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.369649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369589 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80841e75-6aaa-4374-ad40-80e4e46e71f8-tmp\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.369649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369631 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwmbp\" (UniqueName: \"kubernetes.io/projected/30850c0f-55f5-4170-9bd3-6e77beefb302-kube-api-access-bwmbp\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369659 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-systemd-units\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a9587dd-afda-456c-8b3f-456328625388-env-overrides\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369709 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k47z\" (UniqueName: \"kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z\") pod \"network-check-target-5knzh\" (UID: \"830c55c9-2790-4cc3-94ec-fb58798f257d\") " pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369733 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-run-k8s-cni-cncf-io\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369770 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-run-netns\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-log-socket\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369818 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369850 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfmb5\" (UniqueName: \"kubernetes.io/projected/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-kube-api-access-wfmb5\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369869 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzjtp\" (UniqueName: \"kubernetes.io/projected/07dd722c-1675-4ad3-aead-5d03cd8cdaa4-kube-api-access-jzjtp\") pod \"iptables-alerter-mj825\" (UID: \"07dd722c-1675-4ad3-aead-5d03cd8cdaa4\") " pod="openshift-network-operator/iptables-alerter-mj825" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369884 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/932b1521-314f-43d5-ba5a-1f0975868d6c-hosts-file\") pod \"node-resolver-nxwz8\" (UID: \"932b1521-314f-43d5-ba5a-1f0975868d6c\") " pod="openshift-dns/node-resolver-nxwz8" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-var-lib-kubelet\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369920 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-var-lib-cni-bin\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369939 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-run-multus-certs\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369953 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-registration-dir\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.370162 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.369989 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-device-dir\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370012 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-run-ovn-kubernetes\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370046 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm7v5\" (UniqueName: \"kubernetes.io/projected/932b1521-314f-43d5-ba5a-1f0975868d6c-kube-api-access-sm7v5\") pod \"node-resolver-nxwz8\" (UID: \"932b1521-314f-43d5-ba5a-1f0975868d6c\") " pod="openshift-dns/node-resolver-nxwz8" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-sys-fs\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370104 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh2td\" (UniqueName: \"kubernetes.io/projected/b149e648-ac8f-4faf-82f1-a48fcce0e32c-kube-api-access-fh2td\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370153 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/932b1521-314f-43d5-ba5a-1f0975868d6c-tmp-dir\") pod \"node-resolver-nxwz8\" (UID: \"932b1521-314f-43d5-ba5a-1f0975868d6c\") " pod="openshift-dns/node-resolver-nxwz8" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370188 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-var-lib-cni-multus\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370216 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-etc-openvswitch\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-run-openvswitch\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370285 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-run-ovn\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370327 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-cni-bin\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370406 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-os-release\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370428 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-systemd\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370472 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-multus-cni-dir\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.370820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370498 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-run-netns\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.371283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370524 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a9587dd-afda-456c-8b3f-456328625388-ovnkube-script-lib\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.371283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370586 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kvp8\" (UniqueName: \"kubernetes.io/projected/2a9587dd-afda-456c-8b3f-456328625388-kube-api-access-4kvp8\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.371283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370611 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-run\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.371283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370648 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-sys\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.371283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370681 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-tuned\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.371283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.370699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-socket-dir\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.471310 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471238 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-sys\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.471310 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471280 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-tuned\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.471310 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471297 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-socket-dir\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.471502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471360 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-sys\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.471502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471410 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-socket-dir\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.471502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471408 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-sysconfig\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.471502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-sysctl-d\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.471502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-sysctl-conf\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.471502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471464 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-sysconfig\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.471502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471474 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-var-lib-kubelet\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.471502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-hostroot\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.471502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-run-systemd\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471538 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c80624d4-fc4d-4c5c-88c9-1ddab7ec542d-agent-certs\") pod \"konnectivity-agent-5fxhf\" (UID: \"c80624d4-fc4d-4c5c-88c9-1ddab7ec542d\") " pod="kube-system/konnectivity-agent-5fxhf" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471554 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471596 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-cnibin\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471594 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-hostroot\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471598 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-sysctl-conf\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-cnibin\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471626 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-var-lib-kubelet\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471633 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-run-systemd\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471651 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttsx6\" (UniqueName: \"kubernetes.io/projected/80841e75-6aaa-4374-ad40-80e4e46e71f8-kube-api-access-ttsx6\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471671 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-os-release\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471794 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-os-release\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471828 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-kubelet\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471864 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471892 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-kubelet\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.471908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471897 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cba164a9-697b-4cec-9ed7-8ca4efb6d492-serviceca\") pod \"node-ca-2rbzj\" (UID: \"cba164a9-697b-4cec-9ed7-8ca4efb6d492\") " pod="openshift-image-registry/node-ca-2rbzj" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471925 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-cni-binary-copy\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471955 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-multus-socket-dir-parent\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471887 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-sysctl-d\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.471996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b31c6811-7aca-474e-9b5e-e89eec2deff7-multus-daemon-config\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472031 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472042 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-slash\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472064 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a9587dd-afda-456c-8b3f-456328625388-ovnkube-config\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472089 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a9587dd-afda-456c-8b3f-456328625388-ovn-node-metrics-cert\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472111 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c80624d4-fc4d-4c5c-88c9-1ddab7ec542d-konnectivity-ca\") pod \"konnectivity-agent-5fxhf\" (UID: \"c80624d4-fc4d-4c5c-88c9-1ddab7ec542d\") " pod="kube-system/konnectivity-agent-5fxhf" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472134 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472155 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-system-cni-dir\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472178 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-multus-conf-dir\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6rvb\" (UniqueName: \"kubernetes.io/projected/b31c6811-7aca-474e-9b5e-e89eec2deff7-kube-api-access-v6rvb\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472220 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-etc-selinux\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-system-cni-dir\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.472649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07dd722c-1675-4ad3-aead-5d03cd8cdaa4-iptables-alerter-script\") pod \"iptables-alerter-mj825\" (UID: \"07dd722c-1675-4ad3-aead-5d03cd8cdaa4\") " pod="openshift-network-operator/iptables-alerter-mj825" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472313 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07dd722c-1675-4ad3-aead-5d03cd8cdaa4-host-slash\") pod \"iptables-alerter-mj825\" (UID: \"07dd722c-1675-4ad3-aead-5d03cd8cdaa4\") " pod="openshift-network-operator/iptables-alerter-mj825" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472334 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-dbus\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472357 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-var-lib-openvswitch\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-cni-netd\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472388 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cba164a9-697b-4cec-9ed7-8ca4efb6d492-serviceca\") pod \"node-ca-2rbzj\" (UID: \"cba164a9-697b-4cec-9ed7-8ca4efb6d492\") " pod="openshift-image-registry/node-ca-2rbzj" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472402 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-kubernetes\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472408 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-multus-socket-dir-parent\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472428 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b31c6811-7aca-474e-9b5e-e89eec2deff7-cni-binary-copy\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-etc-kubernetes\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472475 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cba164a9-697b-4cec-9ed7-8ca4efb6d492-host\") pod \"node-ca-2rbzj\" (UID: \"cba164a9-697b-4cec-9ed7-8ca4efb6d492\") " pod="openshift-image-registry/node-ca-2rbzj" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472483 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07dd722c-1675-4ad3-aead-5d03cd8cdaa4-host-slash\") pod \"iptables-alerter-mj825\" (UID: \"07dd722c-1675-4ad3-aead-5d03cd8cdaa4\") " pod="openshift-network-operator/iptables-alerter-mj825" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472490 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-system-cni-dir\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472497 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrglg\" (UniqueName: \"kubernetes.io/projected/cba164a9-697b-4cec-9ed7-8ca4efb6d492-kube-api-access-xrglg\") pod \"node-ca-2rbzj\" (UID: \"cba164a9-697b-4cec-9ed7-8ca4efb6d492\") " pod="openshift-image-registry/node-ca-2rbzj" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472536 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-kubelet-config\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472549 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-var-lib-openvswitch\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472564 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-node-log\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472591 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-cnibin\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.473450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472599 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-cni-netd\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472614 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-modprobe-d\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472620 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-cni-binary-copy\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472639 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-etc-kubernetes\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-lib-modules\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472691 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-etc-selinux\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472734 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-kubernetes\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472739 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cba164a9-697b-4cec-9ed7-8ca4efb6d492-host\") pod \"node-ca-2rbzj\" (UID: \"cba164a9-697b-4cec-9ed7-8ca4efb6d492\") " pod="openshift-image-registry/node-ca-2rbzj" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472738 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-lib-modules\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.472880 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-dbus\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473173 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b31c6811-7aca-474e-9b5e-e89eec2deff7-cni-binary-copy\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473273 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07dd722c-1675-4ad3-aead-5d03cd8cdaa4-iptables-alerter-script\") pod \"iptables-alerter-mj825\" (UID: \"07dd722c-1675-4ad3-aead-5d03cd8cdaa4\") " pod="openshift-network-operator/iptables-alerter-mj825" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473280 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-modprobe-d\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473301 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c80624d4-fc4d-4c5c-88c9-1ddab7ec542d-konnectivity-ca\") pod \"konnectivity-agent-5fxhf\" (UID: \"c80624d4-fc4d-4c5c-88c9-1ddab7ec542d\") " pod="kube-system/konnectivity-agent-5fxhf" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473310 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-multus-conf-dir\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473338 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-cnibin\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-host\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473408 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80841e75-6aaa-4374-ad40-80e4e46e71f8-tmp\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.474342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473414 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-slash\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwmbp\" (UniqueName: \"kubernetes.io/projected/30850c0f-55f5-4170-9bd3-6e77beefb302-kube-api-access-bwmbp\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473440 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-system-cni-dir\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473459 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-systemd-units\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473463 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-node-log\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473482 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a9587dd-afda-456c-8b3f-456328625388-env-overrides\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473495 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-kubelet-config\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473506 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k47z\" (UniqueName: \"kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z\") pod \"network-check-target-5knzh\" (UID: \"830c55c9-2790-4cc3-94ec-fb58798f257d\") " pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.473560 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473578 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a9587dd-afda-456c-8b3f-456328625388-ovnkube-config\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.473651 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret podName:9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721 nodeName:}" failed. No retries permitted until 2026-06-09 01:15:38.973613892 +0000 UTC m=+2.085613734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret") pod "global-pull-secret-syncer-tg2cl" (UID: "9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721") : object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473659 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-systemd-units\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473692 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-host\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473716 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473719 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-run-k8s-cni-cncf-io\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473746 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-run-k8s-cni-cncf-io\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473759 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-run-netns\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.475303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473785 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-log-socket\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473810 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473836 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfmb5\" (UniqueName: \"kubernetes.io/projected/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-kube-api-access-wfmb5\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473863 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzjtp\" (UniqueName: \"kubernetes.io/projected/07dd722c-1675-4ad3-aead-5d03cd8cdaa4-kube-api-access-jzjtp\") pod \"iptables-alerter-mj825\" (UID: \"07dd722c-1675-4ad3-aead-5d03cd8cdaa4\") " pod="openshift-network-operator/iptables-alerter-mj825" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473884 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-log-socket\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473887 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/932b1521-314f-43d5-ba5a-1f0975868d6c-hosts-file\") pod \"node-resolver-nxwz8\" (UID: \"932b1521-314f-43d5-ba5a-1f0975868d6c\") " pod="openshift-dns/node-resolver-nxwz8" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473933 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-run-netns\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473938 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-var-lib-kubelet\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.473971 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-var-lib-cni-bin\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474001 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/932b1521-314f-43d5-ba5a-1f0975868d6c-hosts-file\") pod \"node-resolver-nxwz8\" (UID: \"932b1521-314f-43d5-ba5a-1f0975868d6c\") " pod="openshift-dns/node-resolver-nxwz8" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474000 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-run-multus-certs\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474031 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-run-multus-certs\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474075 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474083 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-var-lib-kubelet\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474122 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474122 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-var-lib-cni-bin\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.475868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474140 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a9587dd-afda-456c-8b3f-456328625388-env-overrides\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-registration-dir\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474191 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-device-dir\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474217 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-run-ovn-kubernetes\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474233 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-registration-dir\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474241 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm7v5\" (UniqueName: \"kubernetes.io/projected/932b1521-314f-43d5-ba5a-1f0975868d6c-kube-api-access-sm7v5\") pod \"node-resolver-nxwz8\" (UID: \"932b1521-314f-43d5-ba5a-1f0975868d6c\") " pod="openshift-dns/node-resolver-nxwz8" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474306 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-device-dir\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474308 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-run-ovn-kubernetes\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474349 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-sys-fs\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474364 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b31c6811-7aca-474e-9b5e-e89eec2deff7-multus-daemon-config\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh2td\" (UniqueName: \"kubernetes.io/projected/b149e648-ac8f-4faf-82f1-a48fcce0e32c-kube-api-access-fh2td\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474428 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474449 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30850c0f-55f5-4170-9bd3-6e77beefb302-sys-fs\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474461 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/932b1521-314f-43d5-ba5a-1f0975868d6c-tmp-dir\") pod \"node-resolver-nxwz8\" (UID: \"932b1521-314f-43d5-ba5a-1f0975868d6c\") " pod="openshift-dns/node-resolver-nxwz8" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474484 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-var-lib-cni-multus\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474512 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-etc-openvswitch\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474535 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-run-openvswitch\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.476394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474619 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-var-lib-cni-multus\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474874 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/932b1521-314f-43d5-ba5a-1f0975868d6c-tmp-dir\") pod \"node-resolver-nxwz8\" (UID: \"932b1521-314f-43d5-ba5a-1f0975868d6c\") " pod="openshift-dns/node-resolver-nxwz8" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.474958 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-etc-openvswitch\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475019 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-run-openvswitch\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475122 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-tuned\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475163 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c80624d4-fc4d-4c5c-88c9-1ddab7ec542d-agent-certs\") pod \"konnectivity-agent-5fxhf\" (UID: \"c80624d4-fc4d-4c5c-88c9-1ddab7ec542d\") " pod="kube-system/konnectivity-agent-5fxhf" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475182 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-run-ovn\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475213 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-cni-bin\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475237 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475239 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-run-ovn\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-os-release\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475298 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-systemd\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475301 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a9587dd-afda-456c-8b3f-456328625388-host-cni-bin\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475322 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-multus-cni-dir\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475345 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-run-netns\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475367 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a9587dd-afda-456c-8b3f-456328625388-ovnkube-script-lib\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475372 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-os-release\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475389 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kvp8\" (UniqueName: \"kubernetes.io/projected/2a9587dd-afda-456c-8b3f-456328625388-kube-api-access-4kvp8\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.476847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475412 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-run\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.477429 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.475443 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:38.477429 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475483 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-host-run-netns\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.477429 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.475493 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs podName:b149e648-ac8f-4faf-82f1-a48fcce0e32c nodeName:}" failed. No retries permitted until 2026-06-09 01:15:38.975477584 +0000 UTC m=+2.087477423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs") pod "network-metrics-daemon-tkpd9" (UID: "b149e648-ac8f-4faf-82f1-a48fcce0e32c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:38.477429 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475502 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.477429 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475518 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-run\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.477429 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475549 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80841e75-6aaa-4374-ad40-80e4e46e71f8-etc-systemd\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.477429 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475573 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b31c6811-7aca-474e-9b5e-e89eec2deff7-multus-cni-dir\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.477429 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475784 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a9587dd-afda-456c-8b3f-456328625388-ovn-node-metrics-cert\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.477429 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.475894 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a9587dd-afda-456c-8b3f-456328625388-ovnkube-script-lib\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.477429 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.476309 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80841e75-6aaa-4374-ad40-80e4e46e71f8-tmp\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.478785 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.478764 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 01:15:38.478887 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.478791 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 01:15:38.478887 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.478805 2567 projected.go:196] Error preparing data for projected volume kube-api-access-7k47z for pod openshift-network-diagnostics/network-check-target-5knzh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:38.478887 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.478869 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z podName:830c55c9-2790-4cc3-94ec-fb58798f257d nodeName:}" failed. No retries permitted until 2026-06-09 01:15:38.978851163 +0000 UTC m=+2.090851011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7k47z" (UniqueName: "kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z") pod "network-check-target-5knzh" (UID: "830c55c9-2790-4cc3-94ec-fb58798f257d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:38.479166 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.479146 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttsx6\" (UniqueName: \"kubernetes.io/projected/80841e75-6aaa-4374-ad40-80e4e46e71f8-kube-api-access-ttsx6\") pod \"tuned-j25rj\" (UID: \"80841e75-6aaa-4374-ad40-80e4e46e71f8\") " pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.479398 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.479382 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrglg\" (UniqueName: \"kubernetes.io/projected/cba164a9-697b-4cec-9ed7-8ca4efb6d492-kube-api-access-xrglg\") pod \"node-ca-2rbzj\" (UID: \"cba164a9-697b-4cec-9ed7-8ca4efb6d492\") " pod="openshift-image-registry/node-ca-2rbzj" Jun 09 01:15:38.479909 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.479888 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6rvb\" (UniqueName: \"kubernetes.io/projected/b31c6811-7aca-474e-9b5e-e89eec2deff7-kube-api-access-v6rvb\") pod \"multus-zwb2p\" (UID: \"b31c6811-7aca-474e-9b5e-e89eec2deff7\") " pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.483330 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.483308 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwmbp\" (UniqueName: \"kubernetes.io/projected/30850c0f-55f5-4170-9bd3-6e77beefb302-kube-api-access-bwmbp\") pod \"aws-ebs-csi-driver-node-dgqgl\" (UID: \"30850c0f-55f5-4170-9bd3-6e77beefb302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.484657 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.484634 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzjtp\" (UniqueName: \"kubernetes.io/projected/07dd722c-1675-4ad3-aead-5d03cd8cdaa4-kube-api-access-jzjtp\") pod \"iptables-alerter-mj825\" (UID: \"07dd722c-1675-4ad3-aead-5d03cd8cdaa4\") " pod="openshift-network-operator/iptables-alerter-mj825" Jun 09 01:15:38.484842 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.484825 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm7v5\" (UniqueName: \"kubernetes.io/projected/932b1521-314f-43d5-ba5a-1f0975868d6c-kube-api-access-sm7v5\") pod \"node-resolver-nxwz8\" (UID: \"932b1521-314f-43d5-ba5a-1f0975868d6c\") " pod="openshift-dns/node-resolver-nxwz8" Jun 09 01:15:38.484880 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.484830 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfmb5\" (UniqueName: \"kubernetes.io/projected/f0aa8715-5d8f-495e-a638-eeb6b312dfe1-kube-api-access-wfmb5\") pod \"multus-additional-cni-plugins-tv9m6\" (UID: \"f0aa8715-5d8f-495e-a638-eeb6b312dfe1\") " pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.485513 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.485499 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kvp8\" (UniqueName: \"kubernetes.io/projected/2a9587dd-afda-456c-8b3f-456328625388-kube-api-access-4kvp8\") pod \"ovnkube-node-67sfl\" (UID: \"2a9587dd-afda-456c-8b3f-456328625388\") " pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.490698 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.490680 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh2td\" (UniqueName: \"kubernetes.io/projected/b149e648-ac8f-4faf-82f1-a48fcce0e32c-kube-api-access-fh2td\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:38.597142 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.597108 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mj825" Jun 09 01:15:38.603148 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.603125 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zwb2p" Jun 09 01:15:38.606089 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:38.606066 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07dd722c_1675_4ad3_aead_5d03cd8cdaa4.slice/crio-c62ca14313abaf059ccecf3fdd28e7ced9da80a8fab84747f2198c7e3ebd4098 WatchSource:0}: Error finding container c62ca14313abaf059ccecf3fdd28e7ced9da80a8fab84747f2198c7e3ebd4098: Status 404 returned error can't find the container with id c62ca14313abaf059ccecf3fdd28e7ced9da80a8fab84747f2198c7e3ebd4098 Jun 09 01:15:38.610704 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:38.610679 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31c6811_7aca_474e_9b5e_e89eec2deff7.slice/crio-3646b5e84df08247373d6cd6356b64b5a0ea622ecf1803876a2fdcdfa4c3f2b5 WatchSource:0}: Error finding container 3646b5e84df08247373d6cd6356b64b5a0ea622ecf1803876a2fdcdfa4c3f2b5: Status 404 returned error can't find the container with id 3646b5e84df08247373d6cd6356b64b5a0ea622ecf1803876a2fdcdfa4c3f2b5 Jun 09 01:15:38.616406 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.616390 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" Jun 09 01:15:38.624148 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:38.624124 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30850c0f_55f5_4170_9bd3_6e77beefb302.slice/crio-3c440d2d451487cb4a86223839139f3bdd144981a58344ba21c63cd306d2606c WatchSource:0}: Error finding container 3c440d2d451487cb4a86223839139f3bdd144981a58344ba21c63cd306d2606c: Status 404 returned error can't find the container with id 3c440d2d451487cb4a86223839139f3bdd144981a58344ba21c63cd306d2606c Jun 09 01:15:38.635869 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.635847 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:15:38.641549 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.641533 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5fxhf" Jun 09 01:15:38.641886 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:38.641870 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a9587dd_afda_456c_8b3f_456328625388.slice/crio-cbe377d394e1e700644be2cdb72087077d5d4765fca8201dab6a8d9ebce6b5de WatchSource:0}: Error finding container cbe377d394e1e700644be2cdb72087077d5d4765fca8201dab6a8d9ebce6b5de: Status 404 returned error can't find the container with id cbe377d394e1e700644be2cdb72087077d5d4765fca8201dab6a8d9ebce6b5de Jun 09 01:15:38.646846 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.646831 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nxwz8" Jun 09 01:15:38.647964 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:38.647940 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80624d4_fc4d_4c5c_88c9_1ddab7ec542d.slice/crio-f1ca4080fa7a18542bf602b9aa058ec5397f9c9847ac98fa06e13f2ae817041a WatchSource:0}: Error finding container f1ca4080fa7a18542bf602b9aa058ec5397f9c9847ac98fa06e13f2ae817041a: Status 404 returned error can't find the container with id f1ca4080fa7a18542bf602b9aa058ec5397f9c9847ac98fa06e13f2ae817041a Jun 09 01:15:38.651966 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.651854 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j25rj" Jun 09 01:15:38.654241 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:38.654222 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932b1521_314f_43d5_ba5a_1f0975868d6c.slice/crio-1886aeb9ec6b2c2704a5d2afe6fc48fc41b9caf3154838c6d9e54692c2000b7b WatchSource:0}: Error finding container 1886aeb9ec6b2c2704a5d2afe6fc48fc41b9caf3154838c6d9e54692c2000b7b: Status 404 returned error can't find the container with id 1886aeb9ec6b2c2704a5d2afe6fc48fc41b9caf3154838c6d9e54692c2000b7b Jun 09 01:15:38.657482 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.657461 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2rbzj" Jun 09 01:15:38.658599 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.658579 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tv9m6" Jun 09 01:15:38.659177 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:38.659154 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80841e75_6aaa_4374_ad40_80e4e46e71f8.slice/crio-d984c5162eb137e8b8601861e827a01f4186dbcfeed9b8d14c02512dbffa0703 WatchSource:0}: Error finding container d984c5162eb137e8b8601861e827a01f4186dbcfeed9b8d14c02512dbffa0703: Status 404 returned error can't find the container with id d984c5162eb137e8b8601861e827a01f4186dbcfeed9b8d14c02512dbffa0703 Jun 09 01:15:38.665326 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:38.665305 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba164a9_697b_4cec_9ed7_8ca4efb6d492.slice/crio-4ce60e2284d15c2b5ddc5ca2f3b7308db9bc40db621330e77f45f68740cec8b0 WatchSource:0}: Error finding container 4ce60e2284d15c2b5ddc5ca2f3b7308db9bc40db621330e77f45f68740cec8b0: Status 404 returned error can't find the container with id 4ce60e2284d15c2b5ddc5ca2f3b7308db9bc40db621330e77f45f68740cec8b0 Jun 09 01:15:38.669226 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:15:38.669208 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0aa8715_5d8f_495e_a638_eeb6b312dfe1.slice/crio-e9cb4bb5488e0d32f0d893a4d1eea3ef3955c7a927ee7521a82248a6120bd117 WatchSource:0}: Error finding container e9cb4bb5488e0d32f0d893a4d1eea3ef3955c7a927ee7521a82248a6120bd117: Status 404 returned error can't find the container with id e9cb4bb5488e0d32f0d893a4d1eea3ef3955c7a927ee7521a82248a6120bd117 Jun 09 01:15:38.978459 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.978425 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:38.978639 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:38.978518 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:38.978709 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.978672 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:38.978760 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.978735 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs podName:b149e648-ac8f-4faf-82f1-a48fcce0e32c nodeName:}" failed. No retries permitted until 2026-06-09 01:15:39.978715795 +0000 UTC m=+3.090715628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs") pod "network-metrics-daemon-tkpd9" (UID: "b149e648-ac8f-4faf-82f1-a48fcce0e32c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:38.979177 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.979157 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:38.979285 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:38.979209 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret podName:9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721 nodeName:}" failed. No retries permitted until 2026-06-09 01:15:39.979196205 +0000 UTC m=+3.091196036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret") pod "global-pull-secret-syncer-tg2cl" (UID: "9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721") : object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:39.078926 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.078890 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k47z\" (UniqueName: \"kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z\") pod \"network-check-target-5knzh\" (UID: \"830c55c9-2790-4cc3-94ec-fb58798f257d\") " pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:39.079108 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:39.079065 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 01:15:39.079108 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:39.079082 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 01:15:39.079108 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:39.079095 2567 projected.go:196] Error preparing data for projected volume kube-api-access-7k47z for pod openshift-network-diagnostics/network-check-target-5knzh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:39.079326 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:39.079152 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z podName:830c55c9-2790-4cc3-94ec-fb58798f257d nodeName:}" failed. No retries permitted until 2026-06-09 01:15:40.079134646 +0000 UTC m=+3.191134480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k47z" (UniqueName: "kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z") pod "network-check-target-5knzh" (UID: "830c55c9-2790-4cc3-94ec-fb58798f257d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:39.307991 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.307872 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 01:10:38 +0000 UTC" deadline="2027-11-25 18:21:10.869442379 +0000 UTC" Jun 09 01:15:39.307991 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.307938 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12833h5m31.561509475s" Jun 09 01:15:39.313458 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.313431 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 01:15:39.356091 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.356021 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv9m6" event={"ID":"f0aa8715-5d8f-495e-a638-eeb6b312dfe1","Type":"ContainerStarted","Data":"e9cb4bb5488e0d32f0d893a4d1eea3ef3955c7a927ee7521a82248a6120bd117"} Jun 09 01:15:39.360266 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.360221 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2rbzj" event={"ID":"cba164a9-697b-4cec-9ed7-8ca4efb6d492","Type":"ContainerStarted","Data":"4ce60e2284d15c2b5ddc5ca2f3b7308db9bc40db621330e77f45f68740cec8b0"} Jun 09 01:15:39.366030 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.365930 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j25rj" event={"ID":"80841e75-6aaa-4374-ad40-80e4e46e71f8","Type":"ContainerStarted","Data":"d984c5162eb137e8b8601861e827a01f4186dbcfeed9b8d14c02512dbffa0703"} Jun 09 01:15:39.370313 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.370244 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5fxhf" event={"ID":"c80624d4-fc4d-4c5c-88c9-1ddab7ec542d","Type":"ContainerStarted","Data":"f1ca4080fa7a18542bf602b9aa058ec5397f9c9847ac98fa06e13f2ae817041a"} Jun 09 01:15:39.373452 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.373372 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" event={"ID":"30850c0f-55f5-4170-9bd3-6e77beefb302","Type":"ContainerStarted","Data":"3c440d2d451487cb4a86223839139f3bdd144981a58344ba21c63cd306d2606c"} Jun 09 01:15:39.378075 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.377982 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mj825" event={"ID":"07dd722c-1675-4ad3-aead-5d03cd8cdaa4","Type":"ContainerStarted","Data":"c62ca14313abaf059ccecf3fdd28e7ced9da80a8fab84747f2198c7e3ebd4098"} Jun 09 01:15:39.389316 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.389291 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nxwz8" event={"ID":"932b1521-314f-43d5-ba5a-1f0975868d6c","Type":"ContainerStarted","Data":"1886aeb9ec6b2c2704a5d2afe6fc48fc41b9caf3154838c6d9e54692c2000b7b"} Jun 09 01:15:39.393309 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.392419 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" event={"ID":"2a9587dd-afda-456c-8b3f-456328625388","Type":"ContainerStarted","Data":"cbe377d394e1e700644be2cdb72087077d5d4765fca8201dab6a8d9ebce6b5de"} Jun 09 01:15:39.394299 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.394216 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zwb2p" event={"ID":"b31c6811-7aca-474e-9b5e-e89eec2deff7","Type":"ContainerStarted","Data":"3646b5e84df08247373d6cd6356b64b5a0ea622ecf1803876a2fdcdfa4c3f2b5"} Jun 09 01:15:39.987770 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.986681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:39.987770 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:39.986739 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:39.987770 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:39.986872 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:39.987770 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:39.986944 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret podName:9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721 nodeName:}" failed. No retries permitted until 2026-06-09 01:15:41.986917012 +0000 UTC m=+5.098916841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret") pod "global-pull-secret-syncer-tg2cl" (UID: "9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721") : object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:39.987770 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:39.987340 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:39.987770 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:39.987397 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs podName:b149e648-ac8f-4faf-82f1-a48fcce0e32c nodeName:}" failed. No retries permitted until 2026-06-09 01:15:41.987378995 +0000 UTC m=+5.099378839 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs") pod "network-metrics-daemon-tkpd9" (UID: "b149e648-ac8f-4faf-82f1-a48fcce0e32c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:40.087796 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:40.087061 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k47z\" (UniqueName: \"kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z\") pod \"network-check-target-5knzh\" (UID: \"830c55c9-2790-4cc3-94ec-fb58798f257d\") " pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:40.087796 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:40.087264 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 01:15:40.087796 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:40.087285 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 01:15:40.087796 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:40.087298 2567 projected.go:196] Error preparing data for projected volume kube-api-access-7k47z for pod openshift-network-diagnostics/network-check-target-5knzh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:40.087796 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:40.087352 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z podName:830c55c9-2790-4cc3-94ec-fb58798f257d nodeName:}" failed. No retries permitted until 2026-06-09 01:15:42.087336162 +0000 UTC m=+5.199335993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k47z" (UniqueName: "kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z") pod "network-check-target-5knzh" (UID: "830c55c9-2790-4cc3-94ec-fb58798f257d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:40.236602 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:40.236391 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 01:15:40.308464 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:40.308313 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 01:10:38 +0000 UTC" deadline="2028-02-26 23:54:10.249817564 +0000 UTC" Jun 09 01:15:40.308464 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:40.308358 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15070h38m29.941464582s" Jun 09 01:15:40.337450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:40.337423 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:40.337607 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:40.337538 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:15:40.337938 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:40.337916 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:40.338043 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:40.338024 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:15:40.338114 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:40.338085 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:40.338167 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:40.338148 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:15:41.314896 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:41.314864 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 01:15:42.004714 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:42.004427 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:42.004714 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:42.004488 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:42.004714 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:42.004652 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:42.004714 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:42.004723 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret podName:9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721 nodeName:}" failed. No retries permitted until 2026-06-09 01:15:46.004701835 +0000 UTC m=+9.116701687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret") pod "global-pull-secret-syncer-tg2cl" (UID: "9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721") : object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:42.005052 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:42.004743 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:42.005052 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:42.004778 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs podName:b149e648-ac8f-4faf-82f1-a48fcce0e32c nodeName:}" failed. No retries permitted until 2026-06-09 01:15:46.004767006 +0000 UTC m=+9.116766838 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs") pod "network-metrics-daemon-tkpd9" (UID: "b149e648-ac8f-4faf-82f1-a48fcce0e32c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:42.105210 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:42.105166 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k47z\" (UniqueName: \"kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z\") pod \"network-check-target-5knzh\" (UID: \"830c55c9-2790-4cc3-94ec-fb58798f257d\") " pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:42.105413 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:42.105376 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 01:15:42.105413 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:42.105396 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 01:15:42.105413 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:42.105407 2567 projected.go:196] Error preparing data for projected volume kube-api-access-7k47z for pod openshift-network-diagnostics/network-check-target-5knzh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:42.105557 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:42.105470 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z podName:830c55c9-2790-4cc3-94ec-fb58798f257d nodeName:}" failed. No retries permitted until 2026-06-09 01:15:46.105451282 +0000 UTC m=+9.217451131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k47z" (UniqueName: "kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z") pod "network-check-target-5knzh" (UID: "830c55c9-2790-4cc3-94ec-fb58798f257d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:42.342027 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:42.338867 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:42.342027 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:42.339235 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:15:42.342027 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:42.341850 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:42.342027 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:42.341885 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:42.342627 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:42.342085 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:15:42.342627 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:42.342272 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:15:44.337878 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:44.337381 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:44.337878 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:44.337524 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:15:44.337878 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:44.337850 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:44.337878 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:44.337865 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:44.338569 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:44.337946 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:15:44.338569 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:44.338033 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:15:46.039237 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:46.039055 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:46.039237 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:46.039116 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:46.039749 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:46.039352 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:46.039749 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:46.039376 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:46.039749 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:46.039427 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs podName:b149e648-ac8f-4faf-82f1-a48fcce0e32c nodeName:}" failed. No retries permitted until 2026-06-09 01:15:54.039406586 +0000 UTC m=+17.151406419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs") pod "network-metrics-daemon-tkpd9" (UID: "b149e648-ac8f-4faf-82f1-a48fcce0e32c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:46.039749 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:46.039449 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret podName:9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721 nodeName:}" failed. No retries permitted until 2026-06-09 01:15:54.039438241 +0000 UTC m=+17.151438074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret") pod "global-pull-secret-syncer-tg2cl" (UID: "9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721") : object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:46.140506 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:46.140466 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k47z\" (UniqueName: \"kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z\") pod \"network-check-target-5knzh\" (UID: \"830c55c9-2790-4cc3-94ec-fb58798f257d\") " pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:46.140678 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:46.140643 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 01:15:46.140678 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:46.140666 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 01:15:46.140678 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:46.140678 2567 projected.go:196] Error preparing data for projected volume kube-api-access-7k47z for pod openshift-network-diagnostics/network-check-target-5knzh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:46.140821 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:46.140742 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z podName:830c55c9-2790-4cc3-94ec-fb58798f257d nodeName:}" failed. No retries permitted until 2026-06-09 01:15:54.140722728 +0000 UTC m=+17.252722559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k47z" (UniqueName: "kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z") pod "network-check-target-5knzh" (UID: "830c55c9-2790-4cc3-94ec-fb58798f257d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:46.337676 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:46.337616 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:46.337676 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:46.337644 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:46.337923 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:46.337743 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:15:46.338087 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:46.337616 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:46.338087 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:46.338067 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:15:46.338268 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:46.338151 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:15:48.337833 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:48.337798 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:48.338221 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:48.337906 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:48.338221 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:48.337916 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:15:48.338221 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:48.337933 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:48.338221 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:48.337996 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:15:48.338221 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:48.338093 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:15:50.337442 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:50.337406 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:50.337442 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:50.337424 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:50.337442 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:50.337416 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:50.337969 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:50.337567 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:15:50.337969 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:50.337622 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:15:50.337969 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:50.337731 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:15:52.338059 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:52.338023 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:52.338059 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:52.338039 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:52.338506 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:52.338031 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:52.338506 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:52.338127 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:15:52.338506 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:52.338218 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:15:52.338506 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:52.338296 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:15:54.103077 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:54.102894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:54.103594 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:54.103053 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:54.103594 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:54.103215 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:54.103594 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:54.103225 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret podName:9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:10.103201796 +0000 UTC m=+33.215201628 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret") pod "global-pull-secret-syncer-tg2cl" (UID: "9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721") : object "kube-system"/"original-pull-secret" not registered Jun 09 01:15:54.103594 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:54.103144 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:54.103594 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:54.103275 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs podName:b149e648-ac8f-4faf-82f1-a48fcce0e32c nodeName:}" failed. No retries permitted until 2026-06-09 01:16:10.103247016 +0000 UTC m=+33.215246844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs") pod "network-metrics-daemon-tkpd9" (UID: "b149e648-ac8f-4faf-82f1-a48fcce0e32c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:15:54.203748 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:54.203713 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k47z\" (UniqueName: \"kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z\") pod \"network-check-target-5knzh\" (UID: \"830c55c9-2790-4cc3-94ec-fb58798f257d\") " pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:54.203917 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:54.203896 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 01:15:54.203968 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:54.203925 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 01:15:54.203968 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:54.203936 2567 projected.go:196] Error preparing data for projected volume kube-api-access-7k47z for pod openshift-network-diagnostics/network-check-target-5knzh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:54.204047 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:54.203995 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z podName:830c55c9-2790-4cc3-94ec-fb58798f257d nodeName:}" failed. No retries permitted until 2026-06-09 01:16:10.203981507 +0000 UTC m=+33.315981335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k47z" (UniqueName: "kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z") pod "network-check-target-5knzh" (UID: "830c55c9-2790-4cc3-94ec-fb58798f257d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:15:54.337957 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:54.337926 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:54.338112 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:54.338046 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:54.338112 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:54.338056 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:15:54.338112 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:54.338082 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:54.338289 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:54.338182 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:15:54.338289 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:54.338247 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:15:56.337960 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:56.337915 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:56.338406 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:56.338028 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:56.338406 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:56.338039 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:15:56.338406 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:56.338058 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:56.338406 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:56.338135 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:15:56.338406 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:56.338205 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:15:58.337590 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:58.337566 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:15:58.338009 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:58.337598 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:15:58.338009 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:58.337673 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:15:58.338009 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:58.337703 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:15:58.338009 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:58.337753 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:15:58.338009 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:15:58.337842 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:15:58.457119 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:58.456894 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zwb2p" event={"ID":"b31c6811-7aca-474e-9b5e-e89eec2deff7","Type":"ContainerStarted","Data":"69e95140a8c94f41e487d70cbbf4f24553f0ac2e7121285b546ea327017acd7b"} Jun 09 01:15:58.459314 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:58.459286 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" event={"ID":"bd84badc95e7565ce7045e885393d462","Type":"ContainerStarted","Data":"f42aa300584a702450347820464b3e9e1d05c526620fc8bee36ddb7154f1fdf4"} Jun 09 01:15:58.463564 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:58.463498 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j25rj" event={"ID":"80841e75-6aaa-4374-ad40-80e4e46e71f8","Type":"ContainerStarted","Data":"1c9542b3db8bca06399b8526472fae6e940d9aaaab61ac26908f82c80abfead6"} Jun 09 01:15:58.493530 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:58.493473 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j25rj" podStartSLOduration=2.417882379 podStartE2EDuration="21.493453751s" totalImagesPullingTime="19.075571372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:15:58.492920416 +0000 UTC m=+21.604920267" watchObservedRunningTime="2026-06-09 01:15:58.493453751 +0000 UTC m=+21.605453601" Jun 09 01:15:58.493662 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:58.493634 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zwb2p" podStartSLOduration=2.139407761 podStartE2EDuration="21.49362575s" totalImagesPullingTime="19.354217989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:15:58.477381641 +0000 UTC m=+21.589381515" watchObservedRunningTime="2026-06-09 01:15:58.49362575 +0000 UTC m=+21.605625601" Jun 09 01:15:58.507761 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:58.507711 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" podStartSLOduration=20.507692529 podStartE2EDuration="20.507692529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:15:58.507300293 +0000 UTC m=+21.619300143" watchObservedRunningTime="2026-06-09 01:15:58.507692529 +0000 UTC m=+21.619692380" Jun 09 01:15:59.468940 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.468601 2567 generic.go:356] "Generic (PLEG): container finished" podID="03e249ce48a71b0dbb1c60e5635f8c1f" containerID="a8b6812671dd6c319a96703ba33c8f6576a4a40f2309071a80bd4ec69b4543b9" exitCode=0 Jun 09 01:15:59.468940 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.468680 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" event={"ID":"03e249ce48a71b0dbb1c60e5635f8c1f","Type":"ContainerDied","Data":"a8b6812671dd6c319a96703ba33c8f6576a4a40f2309071a80bd4ec69b4543b9"} Jun 09 01:15:59.470526 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.470501 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0aa8715-5d8f-495e-a638-eeb6b312dfe1" containerID="59f6d899ec25de11dfb90f918c4f67f481f69c511ea227a1f5f0dc13286725a1" exitCode=0 Jun 09 01:15:59.470649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.470571 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv9m6" event={"ID":"f0aa8715-5d8f-495e-a638-eeb6b312dfe1","Type":"ContainerDied","Data":"59f6d899ec25de11dfb90f918c4f67f481f69c511ea227a1f5f0dc13286725a1"} Jun 09 01:15:59.471984 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.471957 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2rbzj" event={"ID":"cba164a9-697b-4cec-9ed7-8ca4efb6d492","Type":"ContainerStarted","Data":"8907b009d070e563a72a45a2eb58587e8937a649892e3abda7220de76b31a246"} Jun 09 01:15:59.473420 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.473399 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5fxhf" event={"ID":"c80624d4-fc4d-4c5c-88c9-1ddab7ec542d","Type":"ContainerStarted","Data":"43dbf7861bac73294fd90aac8a49ac132bd84d3c45aaf87de2d578d91fbdb13f"} Jun 09 01:15:59.474645 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.474627 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" event={"ID":"30850c0f-55f5-4170-9bd3-6e77beefb302","Type":"ContainerStarted","Data":"aff8ee5bb06ac0036231c5a91a14f47ab96763f9e984a8b3f42c4c93df23bd9d"} Jun 09 01:15:59.475893 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.475871 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mj825" event={"ID":"07dd722c-1675-4ad3-aead-5d03cd8cdaa4","Type":"ContainerStarted","Data":"95a738fefe8fa78b25ae70c5045e9fbfab142e5bc25c2000ef5a97dd9e4889e1"} Jun 09 01:15:59.477083 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.477058 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nxwz8" event={"ID":"932b1521-314f-43d5-ba5a-1f0975868d6c","Type":"ContainerStarted","Data":"0852d8a015d8fa723a963036885d6667f0fb8d42ccce5d1766a83cbb888c1628"} Jun 09 01:15:59.480085 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.480071 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:15:59.480388 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.480366 2567 generic.go:356] "Generic (PLEG): container finished" podID="2a9587dd-afda-456c-8b3f-456328625388" containerID="ab9bf8091747456dab1ef432b8ba44fc70c145babc399df876521e5ffdfe1920" exitCode=1 Jun 09 01:15:59.480473 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.480406 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" event={"ID":"2a9587dd-afda-456c-8b3f-456328625388","Type":"ContainerStarted","Data":"2c43508859531cafaed85fe1b51361445ca9a257bb2cf01f53e6703faad8d905"} Jun 09 01:15:59.480473 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.480449 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" event={"ID":"2a9587dd-afda-456c-8b3f-456328625388","Type":"ContainerStarted","Data":"b5e0592d37b1ec5217dfd8f4be15493c6559fc6ffdf39942e88af4a0bd93f049"} Jun 09 01:15:59.480543 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.480477 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" event={"ID":"2a9587dd-afda-456c-8b3f-456328625388","Type":"ContainerStarted","Data":"b979877ff6e8d8ed8071cf835ce794602a792acb5b1c84315b747d3eac8dbf32"} Jun 09 01:15:59.480543 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.480503 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" event={"ID":"2a9587dd-afda-456c-8b3f-456328625388","Type":"ContainerStarted","Data":"3954e7d73615b7af6ac5e02534a16872fef7301c782dfbdf47b946a969c5f139"} Jun 09 01:15:59.480543 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.480530 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" event={"ID":"2a9587dd-afda-456c-8b3f-456328625388","Type":"ContainerDied","Data":"ab9bf8091747456dab1ef432b8ba44fc70c145babc399df876521e5ffdfe1920"} Jun 09 01:15:59.480624 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.480559 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" event={"ID":"2a9587dd-afda-456c-8b3f-456328625388","Type":"ContainerStarted","Data":"e5710e75c5a4e7aa442205ce0dd0f52e0032eb32c8dbebf69c3eb8ce0ab1c32d"} Jun 09 01:15:59.499026 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.498992 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5fxhf" podStartSLOduration=3.186521232 podStartE2EDuration="22.498978882s" totalImagesPullingTime="19.31245765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:15:59.498863265 +0000 UTC m=+22.610863116" watchObservedRunningTime="2026-06-09 01:15:59.498978882 +0000 UTC m=+22.610978731" Jun 09 01:15:59.513634 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.513599 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2rbzj" podStartSLOduration=3.414177455 podStartE2EDuration="22.513587769s" totalImagesPullingTime="19.099410314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:15:59.513214878 +0000 UTC m=+22.625214729" watchObservedRunningTime="2026-06-09 01:15:59.513587769 +0000 UTC m=+22.625587618" Jun 09 01:15:59.527375 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.527338 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nxwz8" podStartSLOduration=3.217263233 podStartE2EDuration="22.527325531s" totalImagesPullingTime="19.310062298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:15:59.526925239 +0000 UTC m=+22.638925087" watchObservedRunningTime="2026-06-09 01:15:59.527325531 +0000 UTC m=+22.639325380" Jun 09 01:15:59.562890 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:15:59.562856 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mj825" podStartSLOduration=3.402795267 podStartE2EDuration="22.562842746s" totalImagesPullingTime="19.160047479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:15:59.562532076 +0000 UTC m=+22.674531924" watchObservedRunningTime="2026-06-09 01:15:59.562842746 +0000 UTC m=+22.674842595" Jun 09 01:16:00.337641 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:00.337610 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:16:00.337870 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:00.337654 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:16:00.337870 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:00.337709 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:16:00.337870 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:00.337725 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:16:00.337870 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:00.337833 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:16:00.338035 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:00.337916 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:16:00.484128 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:00.484099 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" event={"ID":"03e249ce48a71b0dbb1c60e5635f8c1f","Type":"ContainerStarted","Data":"e0cac2fe97c8842af773330afeade4a2af1a55623efea9083637a6b79bbb37c5"} Jun 09 01:16:00.498452 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:00.498406 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" podStartSLOduration=22.498391287 podStartE2EDuration="22.498391287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:00.497940381 +0000 UTC m=+23.609940231" watchObservedRunningTime="2026-06-09 01:16:00.498391287 +0000 UTC m=+23.610391136" Jun 09 01:16:00.522547 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:00.522520 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 01:16:01.338589 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:01.338474 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T01:16:00.522546401Z","UUID":"85af05eb-5e30-4826-82f2-26869597bfea","Handler":null,"Name":"","Endpoint":""} Jun 09 01:16:01.340445 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:01.340376 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 01:16:01.340586 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:01.340480 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 01:16:01.489656 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:01.489539 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" event={"ID":"30850c0f-55f5-4170-9bd3-6e77beefb302","Type":"ContainerStarted","Data":"f7fe068d73100e2e2dba412443e768085fa0ad92f06635c5b2b76a1d3d448bf5"} Jun 09 01:16:01.493662 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:01.493638 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:16:01.494051 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:01.494021 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" event={"ID":"2a9587dd-afda-456c-8b3f-456328625388","Type":"ContainerStarted","Data":"9f4b48be7258a96f416109e9b024ddd7eb4a2f175e1cb007edc12f579d016996"} Jun 09 01:16:02.338201 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:02.338166 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:16:02.338431 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:02.338291 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:16:02.338431 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:02.338313 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:16:02.338431 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:02.338304 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:16:02.338431 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:02.338397 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:16:02.338635 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:02.338463 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:16:02.498534 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:02.498457 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" event={"ID":"30850c0f-55f5-4170-9bd3-6e77beefb302","Type":"ContainerStarted","Data":"89fe1e602a63c99f79333eb62f52395d890437c27e3423911370e5835ffbb283"} Jun 09 01:16:02.515071 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:02.515025 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgqgl" podStartSLOduration=3.480161243 podStartE2EDuration="25.515010712s" totalImagesPullingTime="22.034849469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:02.514639008 +0000 UTC m=+25.626638858" watchObservedRunningTime="2026-06-09 01:16:02.515010712 +0000 UTC m=+25.627010678" Jun 09 01:16:04.328659 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:04.328627 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5fxhf" Jun 09 01:16:04.329144 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:04.329127 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5fxhf" Jun 09 01:16:04.337686 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:04.337664 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:16:04.337686 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:04.337676 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:16:04.337813 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:04.337688 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:16:04.337813 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:04.337770 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:16:04.337908 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:04.337878 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:16:04.337961 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:04.337931 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:16:04.507649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:04.507472 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:16:04.508280 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:04.508018 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" event={"ID":"2a9587dd-afda-456c-8b3f-456328625388","Type":"ContainerStarted","Data":"9bdff7b7a23fe16e7c78a309fa8759c8fd8dfe797defda6b666e982bd1c408b0"} Jun 09 01:16:04.508508 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:04.508279 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5fxhf" Jun 09 01:16:04.508903 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:04.508784 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5fxhf" Jun 09 01:16:05.511100 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:05.511065 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0aa8715-5d8f-495e-a638-eeb6b312dfe1" containerID="540ec5ec164b3ec0132b7ad77c9fae32aa8f79a3ca1430268fa59a213d289580" exitCode=0 Jun 09 01:16:05.511920 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:05.511143 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv9m6" event={"ID":"f0aa8715-5d8f-495e-a638-eeb6b312dfe1","Type":"ContainerDied","Data":"540ec5ec164b3ec0132b7ad77c9fae32aa8f79a3ca1430268fa59a213d289580"} Jun 09 01:16:05.511920 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:05.511650 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:16:05.511920 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:05.511723 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:16:05.511920 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:05.511751 2567 scope.go:117] "RemoveContainer" containerID="ab9bf8091747456dab1ef432b8ba44fc70c145babc399df876521e5ffdfe1920" Jun 09 01:16:05.511920 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:05.511765 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:16:05.527699 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:05.527675 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:16:05.527982 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:05.527956 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:16:06.337972 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:06.337937 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:16:06.338106 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:06.338033 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:16:06.338106 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:06.338036 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:16:06.338106 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:06.338064 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:16:06.338276 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:06.338149 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:16:06.338276 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:06.338239 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:16:06.515498 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:06.515467 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0aa8715-5d8f-495e-a638-eeb6b312dfe1" containerID="c36ae142ce2fe5bdfb7d6a5d40e187cec66c6059d50be8355342243e4d61f716" exitCode=0 Jun 09 01:16:06.515874 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:06.515558 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv9m6" event={"ID":"f0aa8715-5d8f-495e-a638-eeb6b312dfe1","Type":"ContainerDied","Data":"c36ae142ce2fe5bdfb7d6a5d40e187cec66c6059d50be8355342243e4d61f716"} Jun 09 01:16:06.519327 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:06.519310 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:16:06.519682 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:06.519661 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" event={"ID":"2a9587dd-afda-456c-8b3f-456328625388","Type":"ContainerStarted","Data":"63daed9f8d546385b4fcd7ee4502ecd876112871a13ac6126fa7e1487f8789c6"} Jun 09 01:16:06.561541 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:06.561445 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" podStartSLOduration=9.794159555 podStartE2EDuration="29.561432478s" totalImagesPullingTime="19.767272923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:06.561140596 +0000 UTC m=+29.673140445" watchObservedRunningTime="2026-06-09 01:16:06.561432478 +0000 UTC m=+29.673432326" Jun 09 01:16:06.661201 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:06.661161 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tg2cl"] Jun 09 01:16:06.661470 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:06.661285 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:16:06.661470 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:06.661400 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:16:06.662884 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:06.662854 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tkpd9"] Jun 09 01:16:06.663036 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:06.662982 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:16:06.663114 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:06.663085 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:16:06.663498 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:06.663476 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5knzh"] Jun 09 01:16:06.663572 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:06.663560 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:16:06.663674 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:06.663652 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:16:08.337866 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:08.337837 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:16:08.337866 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:08.337859 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:16:08.338373 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:08.337945 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:16:08.338373 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:08.337950 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:16:08.338373 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:08.338010 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:16:08.338373 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:08.338105 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:16:08.527101 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:08.527064 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0aa8715-5d8f-495e-a638-eeb6b312dfe1" containerID="e8efc8a4c140f676658407e19f9b8daa6d8b4c460376ad589bfdc045625576eb" exitCode=0 Jun 09 01:16:08.527280 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:08.527131 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv9m6" event={"ID":"f0aa8715-5d8f-495e-a638-eeb6b312dfe1","Type":"ContainerDied","Data":"e8efc8a4c140f676658407e19f9b8daa6d8b4c460376ad589bfdc045625576eb"} Jun 09 01:16:10.122836 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:10.122796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:16:10.123275 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:10.122846 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:16:10.123275 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:10.122952 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 01:16:10.123275 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:10.123012 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret podName:9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:42.12299238 +0000 UTC m=+65.234992252 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret") pod "global-pull-secret-syncer-tg2cl" (UID: "9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721") : object "kube-system"/"original-pull-secret" not registered Jun 09 01:16:10.123275 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:10.122952 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:16:10.123275 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:10.123117 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs podName:b149e648-ac8f-4faf-82f1-a48fcce0e32c nodeName:}" failed. No retries permitted until 2026-06-09 01:16:42.123095329 +0000 UTC m=+65.235095167 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs") pod "network-metrics-daemon-tkpd9" (UID: "b149e648-ac8f-4faf-82f1-a48fcce0e32c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 01:16:10.223738 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:10.223705 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k47z\" (UniqueName: \"kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z\") pod \"network-check-target-5knzh\" (UID: \"830c55c9-2790-4cc3-94ec-fb58798f257d\") " pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:16:10.223905 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:10.223853 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 01:16:10.223905 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:10.223870 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 01:16:10.223905 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:10.223882 2567 projected.go:196] Error preparing data for projected volume kube-api-access-7k47z for pod openshift-network-diagnostics/network-check-target-5knzh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:16:10.224064 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:10.223943 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z podName:830c55c9-2790-4cc3-94ec-fb58798f257d nodeName:}" failed. No retries permitted until 2026-06-09 01:16:42.223930919 +0000 UTC m=+65.335930747 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k47z" (UniqueName: "kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z") pod "network-check-target-5knzh" (UID: "830c55c9-2790-4cc3-94ec-fb58798f257d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 01:16:10.337903 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:10.337868 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:16:10.337903 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:10.337899 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:16:10.338146 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:10.337885 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:16:10.338146 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:10.338002 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg2cl" podUID="9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721" Jun 09 01:16:10.338146 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:10.338089 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:16:10.338346 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:10.338166 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5knzh" podUID="830c55c9-2790-4cc3-94ec-fb58798f257d" Jun 09 01:16:11.189771 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.189744 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeReady" Jun 09 01:16:11.190146 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.189883 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 01:16:11.222218 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.222191 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d68fdfffc-zgxw4"] Jun 09 01:16:11.226920 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.226891 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.229090 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.229071 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 01:16:11.229196 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.229097 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8c589\"" Jun 09 01:16:11.229450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.229433 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 01:16:11.229595 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.229578 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 01:16:11.233649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.233631 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 01:16:11.235782 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.235762 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d68fdfffc-zgxw4"] Jun 09 01:16:11.239001 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.238942 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mg45n"] Jun 09 01:16:11.242602 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.242584 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qggcv"] Jun 09 01:16:11.242715 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.242696 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:11.245057 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.245037 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 01:16:11.245140 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.245073 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j9cpl\"" Jun 09 01:16:11.245140 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.245044 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 01:16:11.245742 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.245724 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qggcv" Jun 09 01:16:11.247826 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.247807 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 01:16:11.248038 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.247922 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 01:16:11.248192 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.248037 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7cpv6\"" Jun 09 01:16:11.248192 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.248122 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 01:16:11.250008 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.249989 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qggcv"] Jun 09 01:16:11.250822 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.250803 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mg45n"] Jun 09 01:16:11.331384 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.331325 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whqhl\" (UniqueName: \"kubernetes.io/projected/567d595f-9152-43ac-9850-1f7f4b48653e-kube-api-access-whqhl\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:11.331558 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.331393 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-ca-trust-extracted\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.331558 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.331470 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9227a10-ee0f-43f7-8b6a-b0106eb47e65-cert\") pod \"ingress-canary-qggcv\" (UID: \"f9227a10-ee0f-43f7-8b6a-b0106eb47e65\") " pod="openshift-ingress-canary/ingress-canary-qggcv" Jun 09 01:16:11.331558 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.331508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-certificates\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.331558 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.331530 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-installation-pull-secrets\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.331767 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.331585 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.331767 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.331612 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhsnz\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-kube-api-access-rhsnz\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.331767 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.331638 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/567d595f-9152-43ac-9850-1f7f4b48653e-tmp-dir\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:11.331767 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.331671 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbxdz\" (UniqueName: \"kubernetes.io/projected/f9227a10-ee0f-43f7-8b6a-b0106eb47e65-kube-api-access-rbxdz\") pod \"ingress-canary-qggcv\" (UID: \"f9227a10-ee0f-43f7-8b6a-b0106eb47e65\") " pod="openshift-ingress-canary/ingress-canary-qggcv" Jun 09 01:16:11.331767 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.331695 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-image-registry-private-configuration\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.331767 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.331721 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:11.331767 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.331765 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-trusted-ca\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.332066 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.331791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-bound-sa-token\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.332066 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.331818 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/567d595f-9152-43ac-9850-1f7f4b48653e-config-volume\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:11.352116 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.352082 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:11.432134 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432142 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhsnz\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-kube-api-access-rhsnz\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/567d595f-9152-43ac-9850-1f7f4b48653e-tmp-dir\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432206 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbxdz\" (UniqueName: \"kubernetes.io/projected/f9227a10-ee0f-43f7-8b6a-b0106eb47e65-kube-api-access-rbxdz\") pod \"ingress-canary-qggcv\" (UID: \"f9227a10-ee0f-43f7-8b6a-b0106eb47e65\") " pod="openshift-ingress-canary/ingress-canary-qggcv" Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432229 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-image-registry-private-configuration\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:11.432263 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:11.432285 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d68fdfffc-zgxw4: secret "image-registry-tls" not found Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:11.432347 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls podName:2e542323-8d7c-411f-b67f-d3ba3dfcdad8 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:11.932328928 +0000 UTC m=+35.044328756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls") pod "image-registry-6d68fdfffc-zgxw4" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8") : secret "image-registry-tls" not found Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432269 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432418 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-trusted-ca\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432448 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-bound-sa-token\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432478 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/567d595f-9152-43ac-9850-1f7f4b48653e-config-volume\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:11.432508 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432557 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/567d595f-9152-43ac-9850-1f7f4b48653e-tmp-dir\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:11.432575 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls podName:567d595f-9152-43ac-9850-1f7f4b48653e nodeName:}" failed. No retries permitted until 2026-06-09 01:16:11.932558117 +0000 UTC m=+35.044557953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls") pod "dns-default-mg45n" (UID: "567d595f-9152-43ac-9850-1f7f4b48653e") : secret "dns-default-metrics-tls" not found Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432509 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whqhl\" (UniqueName: \"kubernetes.io/projected/567d595f-9152-43ac-9850-1f7f4b48653e-kube-api-access-whqhl\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432641 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-ca-trust-extracted\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.433105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432677 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9227a10-ee0f-43f7-8b6a-b0106eb47e65-cert\") pod \"ingress-canary-qggcv\" (UID: \"f9227a10-ee0f-43f7-8b6a-b0106eb47e65\") " pod="openshift-ingress-canary/ingress-canary-qggcv" Jun 09 01:16:11.433926 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432706 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-certificates\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.433926 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.432733 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-installation-pull-secrets\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.433926 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.433331 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/567d595f-9152-43ac-9850-1f7f4b48653e-config-volume\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:11.433926 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.433360 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-ca-trust-extracted\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.433926 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.433513 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-certificates\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.433926 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.433522 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-trusted-ca\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.435098 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.435067 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:11.437219 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.437175 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-image-registry-private-configuration\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.437219 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.437197 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-installation-pull-secrets\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.437219 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.437212 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9227a10-ee0f-43f7-8b6a-b0106eb47e65-cert\") pod \"ingress-canary-qggcv\" (UID: \"f9227a10-ee0f-43f7-8b6a-b0106eb47e65\") " pod="openshift-ingress-canary/ingress-canary-qggcv" Jun 09 01:16:11.442824 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.442760 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbxdz\" (UniqueName: \"kubernetes.io/projected/f9227a10-ee0f-43f7-8b6a-b0106eb47e65-kube-api-access-rbxdz\") pod \"ingress-canary-qggcv\" (UID: \"f9227a10-ee0f-43f7-8b6a-b0106eb47e65\") " pod="openshift-ingress-canary/ingress-canary-qggcv" Jun 09 01:16:11.443453 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.443414 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whqhl\" (UniqueName: \"kubernetes.io/projected/567d595f-9152-43ac-9850-1f7f4b48653e-kube-api-access-whqhl\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:11.443793 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.443775 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-bound-sa-token\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.444002 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.443978 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhsnz\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-kube-api-access-rhsnz\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.560888 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.560856 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qggcv" Jun 09 01:16:11.936581 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.936546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:11.936756 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:11.936596 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:11.936756 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:11.936696 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:16:11.936756 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:11.936699 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 01:16:11.936756 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:11.936715 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d68fdfffc-zgxw4: secret "image-registry-tls" not found Jun 09 01:16:11.936756 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:11.936758 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls podName:567d595f-9152-43ac-9850-1f7f4b48653e nodeName:}" failed. No retries permitted until 2026-06-09 01:16:12.936739827 +0000 UTC m=+36.048739670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls") pod "dns-default-mg45n" (UID: "567d595f-9152-43ac-9850-1f7f4b48653e") : secret "dns-default-metrics-tls" not found Jun 09 01:16:11.936937 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:11.936776 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls podName:2e542323-8d7c-411f-b67f-d3ba3dfcdad8 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:12.936766794 +0000 UTC m=+36.048766622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls") pod "image-registry-6d68fdfffc-zgxw4" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8") : secret "image-registry-tls" not found Jun 09 01:16:12.338397 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:12.338232 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:16:12.338782 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:12.338276 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:16:12.338782 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:12.338289 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:16:12.341932 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:12.341910 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 01:16:12.341932 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:12.341929 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljzbq\"" Jun 09 01:16:12.342109 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:12.341961 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6pwvx\"" Jun 09 01:16:12.342109 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:12.342025 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 01:16:12.342109 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:12.341929 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 01:16:12.342230 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:12.342153 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 01:16:12.431659 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:12.431634 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qggcv"] Jun 09 01:16:12.440187 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:16:12.440159 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9227a10_ee0f_43f7_8b6a_b0106eb47e65.slice/crio-c0b6ce16a5b66219b3604237fdc54569abcbeea7ba612717563a689fd5d9688b WatchSource:0}: Error finding container c0b6ce16a5b66219b3604237fdc54569abcbeea7ba612717563a689fd5d9688b: Status 404 returned error can't find the container with id c0b6ce16a5b66219b3604237fdc54569abcbeea7ba612717563a689fd5d9688b Jun 09 01:16:12.539653 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:12.539619 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv9m6" event={"ID":"f0aa8715-5d8f-495e-a638-eeb6b312dfe1","Type":"ContainerStarted","Data":"cc6353bf5d5ad3fa1c893cff36be050ead6344dc31465d9363563d8b64f5965a"} Jun 09 01:16:12.540760 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:12.540728 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qggcv" event={"ID":"f9227a10-ee0f-43f7-8b6a-b0106eb47e65","Type":"ContainerStarted","Data":"c0b6ce16a5b66219b3604237fdc54569abcbeea7ba612717563a689fd5d9688b"} Jun 09 01:16:12.942969 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:12.942938 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:12.943127 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:12.943030 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:12.943127 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:12.943081 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:16:12.943127 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:12.943126 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 01:16:12.943219 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:12.943137 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d68fdfffc-zgxw4: secret "image-registry-tls" not found Jun 09 01:16:12.943219 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:12.943147 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls podName:567d595f-9152-43ac-9850-1f7f4b48653e nodeName:}" failed. No retries permitted until 2026-06-09 01:16:14.943129971 +0000 UTC m=+38.055129804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls") pod "dns-default-mg45n" (UID: "567d595f-9152-43ac-9850-1f7f4b48653e") : secret "dns-default-metrics-tls" not found Jun 09 01:16:12.943219 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:12.943169 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls podName:2e542323-8d7c-411f-b67f-d3ba3dfcdad8 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:14.943159117 +0000 UTC m=+38.055158947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls") pod "image-registry-6d68fdfffc-zgxw4" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8") : secret "image-registry-tls" not found Jun 09 01:16:13.545497 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:13.545468 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0aa8715-5d8f-495e-a638-eeb6b312dfe1" containerID="cc6353bf5d5ad3fa1c893cff36be050ead6344dc31465d9363563d8b64f5965a" exitCode=0 Jun 09 01:16:13.546128 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:13.545511 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv9m6" event={"ID":"f0aa8715-5d8f-495e-a638-eeb6b312dfe1","Type":"ContainerDied","Data":"cc6353bf5d5ad3fa1c893cff36be050ead6344dc31465d9363563d8b64f5965a"} Jun 09 01:16:14.551935 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:14.551901 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0aa8715-5d8f-495e-a638-eeb6b312dfe1" containerID="0a393ca3ce1807e9c8c950850ef1826433bbea374eaa2a76ca2e37dbaad60296" exitCode=0 Jun 09 01:16:14.552525 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:14.551944 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv9m6" event={"ID":"f0aa8715-5d8f-495e-a638-eeb6b312dfe1","Type":"ContainerDied","Data":"0a393ca3ce1807e9c8c950850ef1826433bbea374eaa2a76ca2e37dbaad60296"} Jun 09 01:16:14.957347 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:14.957125 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:14.957486 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:14.957379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:14.957486 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:14.957294 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 01:16:14.957486 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:14.957429 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d68fdfffc-zgxw4: secret "image-registry-tls" not found Jun 09 01:16:14.957486 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:14.957485 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls podName:2e542323-8d7c-411f-b67f-d3ba3dfcdad8 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:18.957468499 +0000 UTC m=+42.069468328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls") pod "image-registry-6d68fdfffc-zgxw4" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8") : secret "image-registry-tls" not found Jun 09 01:16:14.957610 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:14.957568 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:16:14.957638 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:14.957624 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls podName:567d595f-9152-43ac-9850-1f7f4b48653e nodeName:}" failed. No retries permitted until 2026-06-09 01:16:18.957607065 +0000 UTC m=+42.069606893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls") pod "dns-default-mg45n" (UID: "567d595f-9152-43ac-9850-1f7f4b48653e") : secret "dns-default-metrics-tls" not found Jun 09 01:16:14.980488 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:14.980467 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:15.081654 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:15.081622 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:15.557193 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:15.557114 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv9m6" event={"ID":"f0aa8715-5d8f-495e-a638-eeb6b312dfe1","Type":"ContainerStarted","Data":"aef6f872a71eabfe597c68849874442c9623a7844feadfd9b51ba6e62473d66b"} Jun 09 01:16:15.558537 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:15.558510 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qggcv" event={"ID":"f9227a10-ee0f-43f7-8b6a-b0106eb47e65","Type":"ContainerStarted","Data":"98baa0c32a7c1cc598269cfc2bbb384c68498c6b50b5cf090280023e37c0b558"} Jun 09 01:16:15.579679 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:15.579633 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tv9m6" podStartSLOduration=8.726196133 podStartE2EDuration="38.57962078s" totalImagesPullingTime="29.853424647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:15.578364752 +0000 UTC m=+38.690364602" watchObservedRunningTime="2026-06-09 01:16:15.57962078 +0000 UTC m=+38.691620627" Jun 09 01:16:15.592886 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:15.592854 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qggcv" podStartSLOduration=2.070883922 podStartE2EDuration="4.592844524s" totalImagesPullingTime="2.521960602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:15.592278787 +0000 UTC m=+38.704278637" watchObservedRunningTime="2026-06-09 01:16:15.592844524 +0000 UTC m=+38.704844353" Jun 09 01:16:15.807824 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:15.807751 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:15.857457 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:15.857433 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:16.151432 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:16.151404 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:16.196884 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:16.196861 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:18.984697 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:18.984664 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:18.984697 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:18.984705 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:18.985086 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:18.984806 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:16:18.985086 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:18.984813 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 01:16:18.985086 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:18.984832 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d68fdfffc-zgxw4: secret "image-registry-tls" not found Jun 09 01:16:18.985086 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:18.984857 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls podName:567d595f-9152-43ac-9850-1f7f4b48653e nodeName:}" failed. No retries permitted until 2026-06-09 01:16:26.984844663 +0000 UTC m=+50.096844491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls") pod "dns-default-mg45n" (UID: "567d595f-9152-43ac-9850-1f7f4b48653e") : secret "dns-default-metrics-tls" not found Jun 09 01:16:18.985086 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:18.984876 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls podName:2e542323-8d7c-411f-b67f-d3ba3dfcdad8 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:26.98486244 +0000 UTC m=+50.096862272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls") pod "image-registry-6d68fdfffc-zgxw4" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8") : secret "image-registry-tls" not found Jun 09 01:16:19.184809 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:19.184768 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:19.240020 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:19.239955 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:19.349601 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:19.349576 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:19.448721 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:19.448681 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:19.499785 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:19.499716 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:20.279318 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:20.279288 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:21.368987 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:21.368960 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:21.471801 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:21.471768 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:21.881447 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:21.881419 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:21.931303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:21.931277 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:23.257094 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:23.257056 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:23.304367 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:23.304340 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:27.041849 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:27.041818 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:27.042199 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:27.041861 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:27.042199 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:27.041982 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 01:16:27.042199 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:27.041990 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:16:27.042199 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:27.042000 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d68fdfffc-zgxw4: secret "image-registry-tls" not found Jun 09 01:16:27.042199 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:27.042067 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls podName:2e542323-8d7c-411f-b67f-d3ba3dfcdad8 nodeName:}" failed. No retries permitted until 2026-06-09 01:16:43.042050941 +0000 UTC m=+66.154050773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls") pod "image-registry-6d68fdfffc-zgxw4" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8") : secret "image-registry-tls" not found Jun 09 01:16:27.042199 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:27.042082 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls podName:567d595f-9152-43ac-9850-1f7f4b48653e nodeName:}" failed. No retries permitted until 2026-06-09 01:16:43.042076941 +0000 UTC m=+66.154076770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls") pod "dns-default-mg45n" (UID: "567d595f-9152-43ac-9850-1f7f4b48653e") : secret "dns-default-metrics-tls" not found Jun 09 01:16:31.623445 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:31.623412 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:31.670849 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:31.670818 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:35.430421 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:35.430385 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:35.479781 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:35.479753 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:35.972488 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:35.972459 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:36.073803 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:36.073767 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:37.531586 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:37.531561 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67sfl" Jun 09 01:16:37.684404 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:37.684375 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:37.737598 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:37.737572 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:40.865120 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:40.865076 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:40.914584 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:40.914556 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:42.143284 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.143236 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:16:42.143735 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.143305 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:16:42.145921 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.145899 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 01:16:42.145983 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.145927 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 01:16:42.154143 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:42.154125 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 01:16:42.154224 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:42.154187 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs podName:b149e648-ac8f-4faf-82f1-a48fcce0e32c nodeName:}" failed. No retries permitted until 2026-06-09 01:17:46.154166506 +0000 UTC m=+129.266166334 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs") pod "network-metrics-daemon-tkpd9" (UID: "b149e648-ac8f-4faf-82f1-a48fcce0e32c") : secret "metrics-daemon-secret" not found Jun 09 01:16:42.157264 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.157222 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721-original-pull-secret\") pod \"global-pull-secret-syncer-tg2cl\" (UID: \"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721\") " pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:16:42.243678 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.243653 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k47z\" (UniqueName: \"kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z\") pod \"network-check-target-5knzh\" (UID: \"830c55c9-2790-4cc3-94ec-fb58798f257d\") " pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:16:42.246670 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.246657 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 01:16:42.256322 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.256309 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 01:16:42.267516 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.267498 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k47z\" (UniqueName: \"kubernetes.io/projected/830c55c9-2790-4cc3-94ec-fb58798f257d-kube-api-access-7k47z\") pod \"network-check-target-5knzh\" (UID: \"830c55c9-2790-4cc3-94ec-fb58798f257d\") " pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:16:42.359119 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.359097 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljzbq\"" Jun 09 01:16:42.361888 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.361876 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg2cl" Jun 09 01:16:42.367090 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.367077 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:16:42.519639 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.519611 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tg2cl"] Jun 09 01:16:42.522770 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:16:42.522744 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e4e5081_32c3_4d3c_b0ad_4ca5d0e7c721.slice/crio-f24b3d9e0116c67fafededfa841a5802bd0489963458f20845c14f506ad2e924 WatchSource:0}: Error finding container f24b3d9e0116c67fafededfa841a5802bd0489963458f20845c14f506ad2e924: Status 404 returned error can't find the container with id f24b3d9e0116c67fafededfa841a5802bd0489963458f20845c14f506ad2e924 Jun 09 01:16:42.543061 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.542986 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5knzh"] Jun 09 01:16:42.546289 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:16:42.546265 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830c55c9_2790_4cc3_94ec_fb58798f257d.slice/crio-2ed306f03d25181d3cb4da82b01f29349f215f242d434416adb85a27b5c15471 WatchSource:0}: Error finding container 2ed306f03d25181d3cb4da82b01f29349f215f242d434416adb85a27b5c15471: Status 404 returned error can't find the container with id 2ed306f03d25181d3cb4da82b01f29349f215f242d434416adb85a27b5c15471 Jun 09 01:16:42.621060 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.621026 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tg2cl" event={"ID":"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721","Type":"ContainerStarted","Data":"f24b3d9e0116c67fafededfa841a5802bd0489963458f20845c14f506ad2e924"} Jun 09 01:16:42.622058 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:42.622039 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5knzh" event={"ID":"830c55c9-2790-4cc3-94ec-fb58798f257d","Type":"ContainerStarted","Data":"2ed306f03d25181d3cb4da82b01f29349f215f242d434416adb85a27b5c15471"} Jun 09 01:16:43.049227 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:43.049189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:16:43.049422 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:43.049239 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:16:43.049422 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:43.049359 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:16:43.049422 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:43.049362 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 01:16:43.049422 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:43.049387 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d68fdfffc-zgxw4: secret "image-registry-tls" not found Jun 09 01:16:43.049422 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:43.049423 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls podName:567d595f-9152-43ac-9850-1f7f4b48653e nodeName:}" failed. No retries permitted until 2026-06-09 01:17:15.049406794 +0000 UTC m=+98.161406626 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls") pod "dns-default-mg45n" (UID: "567d595f-9152-43ac-9850-1f7f4b48653e") : secret "dns-default-metrics-tls" not found Jun 09 01:16:43.049627 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:16:43.049440 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls podName:2e542323-8d7c-411f-b67f-d3ba3dfcdad8 nodeName:}" failed. No retries permitted until 2026-06-09 01:17:15.049431785 +0000 UTC m=+98.161431620 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls") pod "image-registry-6d68fdfffc-zgxw4" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8") : secret "image-registry-tls" not found Jun 09 01:16:45.631559 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:45.631526 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5knzh" event={"ID":"830c55c9-2790-4cc3-94ec-fb58798f257d","Type":"ContainerStarted","Data":"12660710a872dd103a72db1ddd2c1c18e765b3c3baf44a84ebb2356f1306e9ab"} Jun 09 01:16:45.631982 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:45.631717 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:16:45.646016 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:45.645965 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5knzh" podStartSLOduration=65.919102005 podStartE2EDuration="1m8.645946475s" totalImagesPullingTime="2.72684447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:45.645448922 +0000 UTC m=+68.757448773" watchObservedRunningTime="2026-06-09 01:16:45.645946475 +0000 UTC m=+68.757946324" Jun 09 01:16:47.638417 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:47.638380 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tg2cl" event={"ID":"9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721","Type":"ContainerStarted","Data":"b24c7a8a99a47e8591ef488cdbc4b05727cf66edbe0da2cfd10de4a655a71ac7"} Jun 09 01:16:47.652503 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:47.651918 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tg2cl" podStartSLOduration=65.646377593 podStartE2EDuration="1m10.651901396s" totalImagesPullingTime="5.005523803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:16:47.651712458 +0000 UTC m=+70.763712312" watchObservedRunningTime="2026-06-09 01:16:47.651901396 +0000 UTC m=+70.763901250" Jun 09 01:16:57.450142 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:57.450035 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:16:57.494820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:16:57.494787 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:17:15.069898 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:17:15.069860 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:17:15.070428 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:17:15.069910 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:17:15.070428 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:17:15.070011 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:17:15.070428 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:17:15.070071 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls podName:567d595f-9152-43ac-9850-1f7f4b48653e nodeName:}" failed. No retries permitted until 2026-06-09 01:18:19.07005717 +0000 UTC m=+162.182057001 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls") pod "dns-default-mg45n" (UID: "567d595f-9152-43ac-9850-1f7f4b48653e") : secret "dns-default-metrics-tls" not found Jun 09 01:17:15.070428 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:17:15.070014 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 01:17:15.070428 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:17:15.070103 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d68fdfffc-zgxw4: secret "image-registry-tls" not found Jun 09 01:17:15.070428 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:17:15.070155 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls podName:2e542323-8d7c-411f-b67f-d3ba3dfcdad8 nodeName:}" failed. No retries permitted until 2026-06-09 01:18:19.070142116 +0000 UTC m=+162.182141955 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls") pod "image-registry-6d68fdfffc-zgxw4" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8") : secret "image-registry-tls" not found Jun 09 01:17:16.637093 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:17:16.637066 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5knzh" Jun 09 01:17:46.180829 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:17:46.180786 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:17:46.181367 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:17:46.180929 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 01:17:46.181367 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:17:46.180998 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs podName:b149e648-ac8f-4faf-82f1-a48fcce0e32c nodeName:}" failed. No retries permitted until 2026-06-09 01:19:48.180983407 +0000 UTC m=+251.292983239 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs") pod "network-metrics-daemon-tkpd9" (UID: "b149e648-ac8f-4faf-82f1-a48fcce0e32c") : secret "metrics-daemon-secret" not found Jun 09 01:18:14.238473 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:14.238428 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" podUID="2e542323-8d7c-411f-b67f-d3ba3dfcdad8" Jun 09 01:18:14.254737 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:14.254700 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mg45n" podUID="567d595f-9152-43ac-9850-1f7f4b48653e" Jun 09 01:18:14.838498 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:14.838471 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:18:14.838668 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:14.838471 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mg45n" Jun 09 01:18:15.348776 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:15.348741 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tkpd9" podUID="b149e648-ac8f-4faf-82f1-a48fcce0e32c" Jun 09 01:18:15.548610 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:15.548580 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:19.121848 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:19.121804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:18:19.121848 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:19.121852 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:18:19.122296 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:19.121946 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 01:18:19.122296 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:19.121950 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 01:18:19.122296 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:19.121969 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d68fdfffc-zgxw4: secret "image-registry-tls" not found Jun 09 01:18:19.122296 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:19.122009 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls podName:567d595f-9152-43ac-9850-1f7f4b48653e nodeName:}" failed. No retries permitted until 2026-06-09 01:20:21.121995473 +0000 UTC m=+284.233995301 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls") pod "dns-default-mg45n" (UID: "567d595f-9152-43ac-9850-1f7f4b48653e") : secret "dns-default-metrics-tls" not found Jun 09 01:18:19.122296 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:19.122028 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls podName:2e542323-8d7c-411f-b67f-d3ba3dfcdad8 nodeName:}" failed. No retries permitted until 2026-06-09 01:20:21.122014894 +0000 UTC m=+284.234014722 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls") pod "image-registry-6d68fdfffc-zgxw4" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8") : secret "image-registry-tls" not found Jun 09 01:18:30.337863 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:30.337763 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:18:35.727971 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.727936 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-869b67fc67-xvnq5"] Jun 09 01:18:35.729704 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.729689 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:35.732180 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.732160 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 09 01:18:35.732326 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.732288 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 09 01:18:35.733152 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.733132 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 01:18:35.733240 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.733212 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 09 01:18:35.733316 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.733243 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 01:18:35.733394 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.733355 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5x7ph\"" Jun 09 01:18:35.733488 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.733473 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 09 01:18:35.745315 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.745297 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-869b67fc67-xvnq5"] Jun 09 01:18:35.833466 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.833438 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:35.833605 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.833474 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-default-certificate\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:35.833605 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.833497 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mhnn\" (UniqueName: \"kubernetes.io/projected/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-kube-api-access-5mhnn\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:35.833680 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.833605 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:35.833680 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.833627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-stats-auth\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:35.920427 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.920388 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n"] Jun 09 01:18:35.922318 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.922300 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh"] Jun 09 01:18:35.922469 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.922446 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" Jun 09 01:18:35.923966 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.923950 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:18:35.924967 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.924941 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 01:18:35.924967 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.924948 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xgqhx\"" Jun 09 01:18:35.925123 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.924980 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 01:18:35.925123 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.924987 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 01:18:35.926387 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.926366 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-sxqzg\"" Jun 09 01:18:35.926467 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.926370 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 01:18:35.926613 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.926597 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 01:18:35.926667 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.926602 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 01:18:35.927545 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.927530 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 01:18:35.930589 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.930569 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh"] Jun 09 01:18:35.931772 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.931752 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n"] Jun 09 01:18:35.933929 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.933906 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:18:35.934019 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.933948 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:35.934019 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.933973 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-stats-auth\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:35.934136 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.934020 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntjxb\" (UniqueName: \"kubernetes.io/projected/8be19231-6a85-4f7b-8154-0581fbe26cc3-kube-api-access-ntjxb\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:18:35.934136 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.934057 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fsr7n\" (UID: \"89bc3fe0-70f1-4d36-a72c-211ae8e327ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" Jun 09 01:18:35.934136 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.934104 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:35.934308 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:35.934146 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle podName:3d113498-e382-4fea-b9ea-f8ff5ce8c48c nodeName:}" failed. No retries permitted until 2026-06-09 01:18:36.434128626 +0000 UTC m=+179.546128455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle") pod "router-default-869b67fc67-xvnq5" (UID: "3d113498-e382-4fea-b9ea-f8ff5ce8c48c") : configmap references non-existent config key: service-ca.crt Jun 09 01:18:35.934308 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.934165 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8be19231-6a85-4f7b-8154-0581fbe26cc3-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:18:35.934308 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:35.934183 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 01:18:35.934308 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.934219 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-default-certificate\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:35.934308 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:35.934226 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs podName:3d113498-e382-4fea-b9ea-f8ff5ce8c48c nodeName:}" failed. No retries permitted until 2026-06-09 01:18:36.434213329 +0000 UTC m=+179.546213173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs") pod "router-default-869b67fc67-xvnq5" (UID: "3d113498-e382-4fea-b9ea-f8ff5ce8c48c") : secret "router-metrics-certs-default" not found Jun 09 01:18:35.934576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.934374 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mhnn\" (UniqueName: \"kubernetes.io/projected/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-kube-api-access-5mhnn\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:35.934576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.934412 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fr7w\" (UniqueName: \"kubernetes.io/projected/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-kube-api-access-2fr7w\") pod \"cluster-samples-operator-854f8b96b6-fsr7n\" (UID: \"89bc3fe0-70f1-4d36-a72c-211ae8e327ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" Jun 09 01:18:35.937129 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.937105 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-stats-auth\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:35.937221 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.937114 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-default-certificate\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:35.946544 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:35.946516 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mhnn\" (UniqueName: \"kubernetes.io/projected/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-kube-api-access-5mhnn\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:36.003863 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:36.003771 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:36.034924 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:36.034894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:18:36.035054 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:36.034947 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntjxb\" (UniqueName: \"kubernetes.io/projected/8be19231-6a85-4f7b-8154-0581fbe26cc3-kube-api-access-ntjxb\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:18:36.035054 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:36.034968 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fsr7n\" (UID: \"89bc3fe0-70f1-4d36-a72c-211ae8e327ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" Jun 09 01:18:36.035054 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:36.035012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8be19231-6a85-4f7b-8154-0581fbe26cc3-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:18:36.035054 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:36.035048 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fr7w\" (UniqueName: \"kubernetes.io/projected/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-kube-api-access-2fr7w\") pod \"cluster-samples-operator-854f8b96b6-fsr7n\" (UID: \"89bc3fe0-70f1-4d36-a72c-211ae8e327ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" Jun 09 01:18:36.035286 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:36.035135 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 01:18:36.035286 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:36.035196 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 01:18:36.035286 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:36.035227 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls podName:89bc3fe0-70f1-4d36-a72c-211ae8e327ae nodeName:}" failed. No retries permitted until 2026-06-09 01:18:36.535205798 +0000 UTC m=+179.647205648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-fsr7n" (UID: "89bc3fe0-70f1-4d36-a72c-211ae8e327ae") : secret "samples-operator-tls" not found Jun 09 01:18:36.035286 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:36.035245 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls podName:8be19231-6a85-4f7b-8154-0581fbe26cc3 nodeName:}" failed. No retries permitted until 2026-06-09 01:18:36.535235666 +0000 UTC m=+179.647235495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-lckmh" (UID: "8be19231-6a85-4f7b-8154-0581fbe26cc3") : secret "cluster-monitoring-operator-tls" not found Jun 09 01:18:36.035724 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:36.035705 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8be19231-6a85-4f7b-8154-0581fbe26cc3-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:18:36.043420 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:36.043387 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fr7w\" (UniqueName: \"kubernetes.io/projected/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-kube-api-access-2fr7w\") pod \"cluster-samples-operator-854f8b96b6-fsr7n\" (UID: \"89bc3fe0-70f1-4d36-a72c-211ae8e327ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" Jun 09 01:18:36.043532 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:36.043393 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntjxb\" (UniqueName: \"kubernetes.io/projected/8be19231-6a85-4f7b-8154-0581fbe26cc3-kube-api-access-ntjxb\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:18:36.105668 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:36.105629 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:36.437747 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:36.437695 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:36.437961 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:36.437804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:36.437961 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:36.437879 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 01:18:36.437961 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:36.437909 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle podName:3d113498-e382-4fea-b9ea-f8ff5ce8c48c nodeName:}" failed. No retries permitted until 2026-06-09 01:18:37.437895129 +0000 UTC m=+180.549894962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle") pod "router-default-869b67fc67-xvnq5" (UID: "3d113498-e382-4fea-b9ea-f8ff5ce8c48c") : configmap references non-existent config key: service-ca.crt Jun 09 01:18:36.437961 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:36.437948 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs podName:3d113498-e382-4fea-b9ea-f8ff5ce8c48c nodeName:}" failed. No retries permitted until 2026-06-09 01:18:37.437929294 +0000 UTC m=+180.549929140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs") pod "router-default-869b67fc67-xvnq5" (UID: "3d113498-e382-4fea-b9ea-f8ff5ce8c48c") : secret "router-metrics-certs-default" not found Jun 09 01:18:36.538184 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:36.538149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:18:36.538360 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:36.538198 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fsr7n\" (UID: \"89bc3fe0-70f1-4d36-a72c-211ae8e327ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" Jun 09 01:18:36.538360 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:36.538319 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 01:18:36.538450 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:36.538362 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 01:18:36.538450 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:36.538382 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls podName:8be19231-6a85-4f7b-8154-0581fbe26cc3 nodeName:}" failed. No retries permitted until 2026-06-09 01:18:37.53836816 +0000 UTC m=+180.650367993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-lckmh" (UID: "8be19231-6a85-4f7b-8154-0581fbe26cc3") : secret "cluster-monitoring-operator-tls" not found Jun 09 01:18:36.538450 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:36.538411 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls podName:89bc3fe0-70f1-4d36-a72c-211ae8e327ae nodeName:}" failed. No retries permitted until 2026-06-09 01:18:37.538397481 +0000 UTC m=+180.650397309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-fsr7n" (UID: "89bc3fe0-70f1-4d36-a72c-211ae8e327ae") : secret "samples-operator-tls" not found Jun 09 01:18:37.443847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:37.443809 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:37.444296 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:37.443864 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:37.444296 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:37.443959 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 01:18:37.444296 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:37.444023 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle podName:3d113498-e382-4fea-b9ea-f8ff5ce8c48c nodeName:}" failed. No retries permitted until 2026-06-09 01:18:39.443996828 +0000 UTC m=+182.555996674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle") pod "router-default-869b67fc67-xvnq5" (UID: "3d113498-e382-4fea-b9ea-f8ff5ce8c48c") : configmap references non-existent config key: service-ca.crt Jun 09 01:18:37.444296 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:37.444056 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs podName:3d113498-e382-4fea-b9ea-f8ff5ce8c48c nodeName:}" failed. No retries permitted until 2026-06-09 01:18:39.444044357 +0000 UTC m=+182.556044186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs") pod "router-default-869b67fc67-xvnq5" (UID: "3d113498-e382-4fea-b9ea-f8ff5ce8c48c") : secret "router-metrics-certs-default" not found Jun 09 01:18:37.544978 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:37.544948 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:18:37.545130 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:37.544991 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fsr7n\" (UID: \"89bc3fe0-70f1-4d36-a72c-211ae8e327ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" Jun 09 01:18:37.545130 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:37.545077 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 01:18:37.545130 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:37.545079 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 01:18:37.545294 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:37.545141 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls podName:8be19231-6a85-4f7b-8154-0581fbe26cc3 nodeName:}" failed. No retries permitted until 2026-06-09 01:18:39.545125061 +0000 UTC m=+182.657124889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-lckmh" (UID: "8be19231-6a85-4f7b-8154-0581fbe26cc3") : secret "cluster-monitoring-operator-tls" not found Jun 09 01:18:37.545294 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:37.545154 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls podName:89bc3fe0-70f1-4d36-a72c-211ae8e327ae nodeName:}" failed. No retries permitted until 2026-06-09 01:18:39.545148252 +0000 UTC m=+182.657148080 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-fsr7n" (UID: "89bc3fe0-70f1-4d36-a72c-211ae8e327ae") : secret "samples-operator-tls" not found Jun 09 01:18:38.155744 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:38.155712 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:38.205521 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:38.205480 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:39.457802 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:39.457769 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:39.458170 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:39.457826 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:39.458170 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:39.457933 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 01:18:39.458170 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:39.457959 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle podName:3d113498-e382-4fea-b9ea-f8ff5ce8c48c nodeName:}" failed. No retries permitted until 2026-06-09 01:18:43.457942088 +0000 UTC m=+186.569941916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle") pod "router-default-869b67fc67-xvnq5" (UID: "3d113498-e382-4fea-b9ea-f8ff5ce8c48c") : configmap references non-existent config key: service-ca.crt Jun 09 01:18:39.458170 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:39.457984 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs podName:3d113498-e382-4fea-b9ea-f8ff5ce8c48c nodeName:}" failed. No retries permitted until 2026-06-09 01:18:43.457976579 +0000 UTC m=+186.569976409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs") pod "router-default-869b67fc67-xvnq5" (UID: "3d113498-e382-4fea-b9ea-f8ff5ce8c48c") : secret "router-metrics-certs-default" not found Jun 09 01:18:39.558959 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:39.558919 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:18:39.559120 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:39.558988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fsr7n\" (UID: \"89bc3fe0-70f1-4d36-a72c-211ae8e327ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" Jun 09 01:18:39.559120 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:39.559082 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 01:18:39.559189 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:39.559149 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls podName:8be19231-6a85-4f7b-8154-0581fbe26cc3 nodeName:}" failed. No retries permitted until 2026-06-09 01:18:43.559135692 +0000 UTC m=+186.671135524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-lckmh" (UID: "8be19231-6a85-4f7b-8154-0581fbe26cc3") : secret "cluster-monitoring-operator-tls" not found Jun 09 01:18:39.559189 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:39.559082 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 01:18:39.559280 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:39.559211 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls podName:89bc3fe0-70f1-4d36-a72c-211ae8e327ae nodeName:}" failed. No retries permitted until 2026-06-09 01:18:43.5591974 +0000 UTC m=+186.671197228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-fsr7n" (UID: "89bc3fe0-70f1-4d36-a72c-211ae8e327ae") : secret "samples-operator-tls" not found Jun 09 01:18:40.916915 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:40.916876 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:40.965898 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:40.965873 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:41.282360 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.282212 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-xs5sz"] Jun 09 01:18:41.282360 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.282284 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:41.286242 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.286223 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xs5sz" Jun 09 01:18:41.288491 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.288473 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 01:18:41.288608 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.288572 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 01:18:41.289399 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.289384 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xfsm4\"" Jun 09 01:18:41.292194 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.292174 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-xs5sz"] Jun 09 01:18:41.371643 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.371616 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppzpf\" (UniqueName: \"kubernetes.io/projected/f6fab47f-fe88-4274-aa49-e90d32735eb8-kube-api-access-ppzpf\") pod \"migrator-955ffdf5f-xs5sz\" (UID: \"f6fab47f-fe88-4274-aa49-e90d32735eb8\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xs5sz" Jun 09 01:18:41.371643 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.371634 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:41.422513 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.422474 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:41.472466 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.472444 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppzpf\" (UniqueName: \"kubernetes.io/projected/f6fab47f-fe88-4274-aa49-e90d32735eb8-kube-api-access-ppzpf\") pod \"migrator-955ffdf5f-xs5sz\" (UID: \"f6fab47f-fe88-4274-aa49-e90d32735eb8\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xs5sz" Jun 09 01:18:41.480780 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.480748 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppzpf\" (UniqueName: \"kubernetes.io/projected/f6fab47f-fe88-4274-aa49-e90d32735eb8-kube-api-access-ppzpf\") pod \"migrator-955ffdf5f-xs5sz\" (UID: \"f6fab47f-fe88-4274-aa49-e90d32735eb8\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xs5sz" Jun 09 01:18:41.594980 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.594954 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xs5sz" Jun 09 01:18:41.714975 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.714952 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-xs5sz"] Jun 09 01:18:41.718710 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:18:41.718672 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6fab47f_fe88_4274_aa49_e90d32735eb8.slice/crio-0ddf77a3d3d37a88fff228f4ae9e9989c8a90e071101dba3cec854cc09e4aa08 WatchSource:0}: Error finding container 0ddf77a3d3d37a88fff228f4ae9e9989c8a90e071101dba3cec854cc09e4aa08: Status 404 returned error can't find the container with id 0ddf77a3d3d37a88fff228f4ae9e9989c8a90e071101dba3cec854cc09e4aa08 Jun 09 01:18:41.902929 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:41.902847 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xs5sz" event={"ID":"f6fab47f-fe88-4274-aa49-e90d32735eb8","Type":"ContainerStarted","Data":"0ddf77a3d3d37a88fff228f4ae9e9989c8a90e071101dba3cec854cc09e4aa08"} Jun 09 01:18:42.830981 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:42.827639 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nxwz8_932b1521-314f-43d5-ba5a-1f0975868d6c/dns-node-resolver/0.log" Jun 09 01:18:43.489042 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:43.489003 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:43.489182 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:43.489119 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:43.489182 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:43.489143 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 01:18:43.489265 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:43.489200 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs podName:3d113498-e382-4fea-b9ea-f8ff5ce8c48c nodeName:}" failed. No retries permitted until 2026-06-09 01:18:51.489185915 +0000 UTC m=+194.601185747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs") pod "router-default-869b67fc67-xvnq5" (UID: "3d113498-e382-4fea-b9ea-f8ff5ce8c48c") : secret "router-metrics-certs-default" not found Jun 09 01:18:43.489265 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:43.489223 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle podName:3d113498-e382-4fea-b9ea-f8ff5ce8c48c nodeName:}" failed. No retries permitted until 2026-06-09 01:18:51.489211809 +0000 UTC m=+194.601211637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle") pod "router-default-869b67fc67-xvnq5" (UID: "3d113498-e382-4fea-b9ea-f8ff5ce8c48c") : configmap references non-existent config key: service-ca.crt Jun 09 01:18:43.590191 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:43.590161 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:18:43.590356 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:43.590208 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fsr7n\" (UID: \"89bc3fe0-70f1-4d36-a72c-211ae8e327ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" Jun 09 01:18:43.590356 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:43.590339 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 01:18:43.590356 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:43.590337 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 01:18:43.590472 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:43.590390 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls podName:89bc3fe0-70f1-4d36-a72c-211ae8e327ae nodeName:}" failed. No retries permitted until 2026-06-09 01:18:51.590377966 +0000 UTC m=+194.702377801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-fsr7n" (UID: "89bc3fe0-70f1-4d36-a72c-211ae8e327ae") : secret "samples-operator-tls" not found Jun 09 01:18:43.590472 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:43.590404 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls podName:8be19231-6a85-4f7b-8154-0581fbe26cc3 nodeName:}" failed. No retries permitted until 2026-06-09 01:18:51.590398015 +0000 UTC m=+194.702397843 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-lckmh" (UID: "8be19231-6a85-4f7b-8154-0581fbe26cc3") : secret "cluster-monitoring-operator-tls" not found Jun 09 01:18:43.632815 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:43.632793 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2rbzj_cba164a9-697b-4cec-9ed7-8ca4efb6d492/node-ca/0.log" Jun 09 01:18:43.910862 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:43.910784 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xs5sz" event={"ID":"f6fab47f-fe88-4274-aa49-e90d32735eb8","Type":"ContainerStarted","Data":"cacf511cd1a83b7f31d46057f8ffe500501293e530d3548e3631534d0408e696"} Jun 09 01:18:43.910862 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:43.910851 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xs5sz" event={"ID":"f6fab47f-fe88-4274-aa49-e90d32735eb8","Type":"ContainerStarted","Data":"2867bb9232333d8dc377a28aa8af8cc5c24d6004f40931a8bbaa303120d5e44a"} Jun 09 01:18:43.929069 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:43.929026 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xs5sz" podStartSLOduration=1.356298447 podStartE2EDuration="2.929010322s" totalImagesPullingTime="1.572711875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:18:43.928183496 +0000 UTC m=+187.040183346" watchObservedRunningTime="2026-06-09 01:18:43.929010322 +0000 UTC m=+187.041010172" Jun 09 01:18:43.981679 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:43.981653 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:44.081897 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:44.081868 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:44.410137 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:44.410112 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:44.457669 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:44.457645 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:44.627284 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:44.627243 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qggcv_f9227a10-ee0f-43f7-8b6a-b0106eb47e65/serve-healthcheck-canary/0.log" Jun 09 01:18:44.687305 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:44.687226 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:44.788979 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:44.788950 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:46.308778 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:46.308746 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:46.356002 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:46.355972 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:47.113450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:47.113417 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:50.032161 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:50.032124 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:50.131556 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:50.131525 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:50.231731 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:50.231703 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:50.332142 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:50.332116 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:50.432127 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:50.432100 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:50.538058 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:50.538026 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:50.632384 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:50.632319 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:50.796770 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:50.796740 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:51.552852 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:51.552816 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:51.553442 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:51.552869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:18:51.553442 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:51.552988 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 01:18:51.553442 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:51.553019 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle podName:3d113498-e382-4fea-b9ea-f8ff5ce8c48c nodeName:}" failed. No retries permitted until 2026-06-09 01:19:07.552993664 +0000 UTC m=+210.664993506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle") pod "router-default-869b67fc67-xvnq5" (UID: "3d113498-e382-4fea-b9ea-f8ff5ce8c48c") : configmap references non-existent config key: service-ca.crt Jun 09 01:18:51.553442 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:51.553047 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs podName:3d113498-e382-4fea-b9ea-f8ff5ce8c48c nodeName:}" failed. No retries permitted until 2026-06-09 01:19:07.55303711 +0000 UTC m=+210.665036939 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs") pod "router-default-869b67fc67-xvnq5" (UID: "3d113498-e382-4fea-b9ea-f8ff5ce8c48c") : secret "router-metrics-certs-default" not found Jun 09 01:18:51.653755 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:51.653718 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fsr7n\" (UID: \"89bc3fe0-70f1-4d36-a72c-211ae8e327ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" Jun 09 01:18:51.653942 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:51.653851 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:18:51.654016 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:51.653960 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 01:18:51.654068 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:18:51.654028 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls podName:8be19231-6a85-4f7b-8154-0581fbe26cc3 nodeName:}" failed. No retries permitted until 2026-06-09 01:19:07.654010242 +0000 UTC m=+210.766010086 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-lckmh" (UID: "8be19231-6a85-4f7b-8154-0581fbe26cc3") : secret "cluster-monitoring-operator-tls" not found Jun 09 01:18:51.656244 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:51.656221 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89bc3fe0-70f1-4d36-a72c-211ae8e327ae-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fsr7n\" (UID: \"89bc3fe0-70f1-4d36-a72c-211ae8e327ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" Jun 09 01:18:51.835456 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:51.835423 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xgqhx\"" Jun 09 01:18:51.843184 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:51.843161 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" Jun 09 01:18:51.959663 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:51.959631 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n"] Jun 09 01:18:51.989021 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:51.988984 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:52.200466 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:52.200364 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:52.391892 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:52.391860 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:52.587227 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:52.587196 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:52.785640 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:52.785606 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:52.938449 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:52.938369 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" event={"ID":"89bc3fe0-70f1-4d36-a72c-211ae8e327ae","Type":"ContainerStarted","Data":"ca99227b8345f9d0b54c6b0772a53d2ae8e61daca5715a937cef1080bde9780e"} Jun 09 01:18:53.347658 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:53.347631 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:53.787222 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:53.787134 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:53.889604 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:53.889545 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:53.989629 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:53.989582 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:54.090150 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:54.090116 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:54.190267 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:54.190227 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:54.387721 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:54.387681 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:54.589478 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:54.589446 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:54.946526 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:54.946494 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" event={"ID":"89bc3fe0-70f1-4d36-a72c-211ae8e327ae","Type":"ContainerStarted","Data":"8538ea5f737ffc166b9c3a8de6fec9b17d0aa194ba19948863b8fd1e177140b9"} Jun 09 01:18:54.946929 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:54.946574 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" event={"ID":"89bc3fe0-70f1-4d36-a72c-211ae8e327ae","Type":"ContainerStarted","Data":"1eb2fc7cd313cee019b0065cc6c63beeb9d0d266aaa632ed9389aa9e462f5a97"} Jun 09 01:18:54.962636 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:54.962587 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fsr7n" podStartSLOduration=17.695877864 podStartE2EDuration="19.962575063s" totalImagesPullingTime="2.266697199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:18:54.962048815 +0000 UTC m=+198.074048665" watchObservedRunningTime="2026-06-09 01:18:54.962575063 +0000 UTC m=+198.074574951" Jun 09 01:18:54.989550 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:54.989529 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:55.785611 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:55.785566 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:56.188031 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:56.187995 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:56.389575 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:56.389543 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:56.587525 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:56.587487 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:56.687556 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:56.687534 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:56.789654 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:56.789631 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:57.988159 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:57.988128 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:58.190225 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:58.190197 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:58.383750 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:58.383724 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:58.593491 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:58.593453 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:58.785999 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:58.785922 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:59.585411 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:59.585381 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:18:59.986231 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:18:59.986142 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:00.190953 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:00.188110 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:00.585747 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:00.585716 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:00.787865 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:00.787834 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:06.544108 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.544076 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f5szf"] Jun 09 01:19:06.547443 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.547424 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.551128 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.551107 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 01:19:06.551263 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.551110 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 01:19:06.551263 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.551108 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-knzt7\"" Jun 09 01:19:06.551263 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.551113 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 01:19:06.551426 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.551116 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 01:19:06.559329 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.559308 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f5szf"] Jun 09 01:19:06.670137 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.670104 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:06.678157 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.678130 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9231f26-1e00-420f-864b-2ee278d8e23b-data-volume\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.678243 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.678171 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj92w\" (UniqueName: \"kubernetes.io/projected/a9231f26-1e00-420f-864b-2ee278d8e23b-kube-api-access-xj92w\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.678243 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.678223 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9231f26-1e00-420f-864b-2ee278d8e23b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.678344 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.678269 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a9231f26-1e00-420f-864b-2ee278d8e23b-crio-socket\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.678387 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.678372 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9231f26-1e00-420f-864b-2ee278d8e23b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.731970 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.731944 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:06.779262 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.779235 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj92w\" (UniqueName: \"kubernetes.io/projected/a9231f26-1e00-420f-864b-2ee278d8e23b-kube-api-access-xj92w\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.779329 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.779314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9231f26-1e00-420f-864b-2ee278d8e23b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.779383 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.779369 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a9231f26-1e00-420f-864b-2ee278d8e23b-crio-socket\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.779450 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.779433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9231f26-1e00-420f-864b-2ee278d8e23b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.779505 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.779488 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9231f26-1e00-420f-864b-2ee278d8e23b-data-volume\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.779805 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.779522 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a9231f26-1e00-420f-864b-2ee278d8e23b-crio-socket\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.780129 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.780104 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9231f26-1e00-420f-864b-2ee278d8e23b-data-volume\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.780300 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.780280 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9231f26-1e00-420f-864b-2ee278d8e23b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.782824 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.782791 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9231f26-1e00-420f-864b-2ee278d8e23b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.788813 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.788792 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj92w\" (UniqueName: \"kubernetes.io/projected/a9231f26-1e00-420f-864b-2ee278d8e23b-kube-api-access-xj92w\") pod \"insights-runtime-extractor-f5szf\" (UID: \"a9231f26-1e00-420f-864b-2ee278d8e23b\") " pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.856489 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.856468 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f5szf" Jun 09 01:19:06.976502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.976473 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f5szf"] Jun 09 01:19:06.979507 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:19:06.979473 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9231f26_1e00_420f_864b_2ee278d8e23b.slice/crio-50a08aba085b47bc558096066c41962606bc59067599a7ae61dfd2357194a97d WatchSource:0}: Error finding container 50a08aba085b47bc558096066c41962606bc59067599a7ae61dfd2357194a97d: Status 404 returned error can't find the container with id 50a08aba085b47bc558096066c41962606bc59067599a7ae61dfd2357194a97d Jun 09 01:19:06.984379 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:06.984353 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f5szf" event={"ID":"a9231f26-1e00-420f-864b-2ee278d8e23b","Type":"ContainerStarted","Data":"50a08aba085b47bc558096066c41962606bc59067599a7ae61dfd2357194a97d"} Jun 09 01:19:07.586325 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.586294 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:19:07.586325 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.586327 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:19:07.586866 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.586849 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-service-ca-bundle\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:19:07.588393 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.588377 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d113498-e382-4fea-b9ea-f8ff5ce8c48c-metrics-certs\") pod \"router-default-869b67fc67-xvnq5\" (UID: \"3d113498-e382-4fea-b9ea-f8ff5ce8c48c\") " pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:19:07.686718 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.686687 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:19:07.688819 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.688799 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8be19231-6a85-4f7b-8154-0581fbe26cc3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-lckmh\" (UID: \"8be19231-6a85-4f7b-8154-0581fbe26cc3\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:19:07.747131 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.747106 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-sxqzg\"" Jun 09 01:19:07.755215 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.755192 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" Jun 09 01:19:07.840964 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.840914 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5x7ph\"" Jun 09 01:19:07.849060 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.849035 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:19:07.879480 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.879447 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh"] Jun 09 01:19:07.884406 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:19:07.884356 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be19231_6a85_4f7b_8154_0581fbe26cc3.slice/crio-9ea5129359deb6d506535051d894787d38478edf609f2cc3894272e1855d21b0 WatchSource:0}: Error finding container 9ea5129359deb6d506535051d894787d38478edf609f2cc3894272e1855d21b0: Status 404 returned error can't find the container with id 9ea5129359deb6d506535051d894787d38478edf609f2cc3894272e1855d21b0 Jun 09 01:19:07.974434 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.974306 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-869b67fc67-xvnq5"] Jun 09 01:19:07.976188 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:19:07.976165 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d113498_e382_4fea_b9ea_f8ff5ce8c48c.slice/crio-a84a9d9974eabe70bef0165246268ae5710b7c7f750a725b890010857b534d70 WatchSource:0}: Error finding container a84a9d9974eabe70bef0165246268ae5710b7c7f750a725b890010857b534d70: Status 404 returned error can't find the container with id a84a9d9974eabe70bef0165246268ae5710b7c7f750a725b890010857b534d70 Jun 09 01:19:07.988148 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.988120 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" event={"ID":"8be19231-6a85-4f7b-8154-0581fbe26cc3","Type":"ContainerStarted","Data":"9ea5129359deb6d506535051d894787d38478edf609f2cc3894272e1855d21b0"} Jun 09 01:19:07.989268 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.989222 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-869b67fc67-xvnq5" event={"ID":"3d113498-e382-4fea-b9ea-f8ff5ce8c48c","Type":"ContainerStarted","Data":"a84a9d9974eabe70bef0165246268ae5710b7c7f750a725b890010857b534d70"} Jun 09 01:19:07.990899 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.990878 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f5szf" event={"ID":"a9231f26-1e00-420f-864b-2ee278d8e23b","Type":"ContainerStarted","Data":"926b3a2a5143ba187d206807e6c79f18335f9dc9e6336d120900a9acba60e2f0"} Jun 09 01:19:07.990987 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:07.990924 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f5szf" event={"ID":"a9231f26-1e00-420f-864b-2ee278d8e23b","Type":"ContainerStarted","Data":"6c7f95a5df0170c78792fc35ae6802f7cb4e7008817a77839bdae98d5c857a5f"} Jun 09 01:19:08.260792 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:08.260708 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:08.306874 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:08.306834 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:08.996105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:08.996069 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-869b67fc67-xvnq5" event={"ID":"3d113498-e382-4fea-b9ea-f8ff5ce8c48c","Type":"ContainerStarted","Data":"4dfbbde734647f03831744dab2653a0d363c30b1cce6b06dc6202c111c53d351"} Jun 09 01:19:09.014898 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:09.014846 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-869b67fc67-xvnq5" podStartSLOduration=34.014831339 podStartE2EDuration="34.014831339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:19:09.014583992 +0000 UTC m=+212.126583843" watchObservedRunningTime="2026-06-09 01:19:09.014831339 +0000 UTC m=+212.126831196" Jun 09 01:19:09.850020 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:09.849987 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:19:09.852620 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:09.852597 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:19:10.000873 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.000841 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" event={"ID":"8be19231-6a85-4f7b-8154-0581fbe26cc3","Type":"ContainerStarted","Data":"4b85ffc305c59f3808cbe6ac64fd4f0022b478898b71a0be8a4b557a2b3400cd"} Jun 09 01:19:10.003570 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.003543 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f5szf" event={"ID":"a9231f26-1e00-420f-864b-2ee278d8e23b","Type":"ContainerStarted","Data":"c41444eb5f66fa8f8bfbf48c40caa67254298eaf99ceb919f799915cec34b873"} Jun 09 01:19:10.005719 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.004348 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:19:10.009133 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.009113 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-869b67fc67-xvnq5" Jun 09 01:19:10.016563 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.016515 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-lckmh" podStartSLOduration=32.995121377 podStartE2EDuration="35.016502651s" totalImagesPullingTime="2.021381274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:19:10.016116189 +0000 UTC m=+213.128116064" watchObservedRunningTime="2026-06-09 01:19:10.016502651 +0000 UTC m=+213.128502503" Jun 09 01:19:10.034744 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.034702 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f5szf" podStartSLOduration=1.2271401530000001 podStartE2EDuration="4.034688127s" totalImagesPullingTime="2.807547974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:19:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:19:10.034024344 +0000 UTC m=+213.146024217" watchObservedRunningTime="2026-06-09 01:19:10.034688127 +0000 UTC m=+213.146687978" Jun 09 01:19:10.238620 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.238586 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:10.338702 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.338662 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:10.403883 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.403788 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:10.404037 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.404009 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6hd76"] Jun 09 01:19:10.407082 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.407064 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6hd76" Jun 09 01:19:10.409457 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.409434 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9vrmk\"" Jun 09 01:19:10.409567 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.409433 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 01:19:10.414325 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.414302 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6hd76"] Jun 09 01:19:10.513580 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.513536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/35ccd0af-e016-4b21-96ad-64f26efd2e2c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-6hd76\" (UID: \"35ccd0af-e016-4b21-96ad-64f26efd2e2c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6hd76" Jun 09 01:19:10.566800 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.566770 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:10.614908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.614882 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/35ccd0af-e016-4b21-96ad-64f26efd2e2c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-6hd76\" (UID: \"35ccd0af-e016-4b21-96ad-64f26efd2e2c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6hd76" Jun 09 01:19:10.617224 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.617200 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/35ccd0af-e016-4b21-96ad-64f26efd2e2c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-6hd76\" (UID: \"35ccd0af-e016-4b21-96ad-64f26efd2e2c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6hd76" Jun 09 01:19:10.716185 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.716101 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6hd76" Jun 09 01:19:10.834480 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:10.834450 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6hd76"] Jun 09 01:19:10.838716 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:19:10.838688 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35ccd0af_e016_4b21_96ad_64f26efd2e2c.slice/crio-6984113cb24511812bcc2662838ca6b8c463a88ef370f9d2786a2c9ab0ecec59 WatchSource:0}: Error finding container 6984113cb24511812bcc2662838ca6b8c463a88ef370f9d2786a2c9ab0ecec59: Status 404 returned error can't find the container with id 6984113cb24511812bcc2662838ca6b8c463a88ef370f9d2786a2c9ab0ecec59 Jun 09 01:19:11.008017 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:11.007945 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6hd76" event={"ID":"35ccd0af-e016-4b21-96ad-64f26efd2e2c","Type":"ContainerStarted","Data":"6984113cb24511812bcc2662838ca6b8c463a88ef370f9d2786a2c9ab0ecec59"} Jun 09 01:19:13.015793 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:13.015754 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6hd76" event={"ID":"35ccd0af-e016-4b21-96ad-64f26efd2e2c","Type":"ContainerStarted","Data":"f4b6dac908a560f16d7e33e247c115018dc6b539550d38baaee243f358b11c59"} Jun 09 01:19:13.016290 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:13.015957 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6hd76" Jun 09 01:19:13.020722 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:13.020701 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6hd76" Jun 09 01:19:13.031430 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:13.031381 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-6hd76" podStartSLOduration=1.849783942 podStartE2EDuration="3.031362865s" totalImagesPullingTime="1.181578923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:19:13.030396954 +0000 UTC m=+216.142396806" watchObservedRunningTime="2026-06-09 01:19:13.031362865 +0000 UTC m=+216.143362717" Jun 09 01:19:13.425283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:13.425237 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:13.491898 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:13.491867 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:13.697921 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:13.697837 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:15.609731 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:15.609692 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:17.560900 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.560866 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:17.653493 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.653465 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:17.772174 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.772142 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:17.814182 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.814158 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-scvp5"] Jun 09 01:19:17.817478 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.817462 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:17.819662 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.819641 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 01:19:17.819787 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.819724 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ngzk6\"" Jun 09 01:19:17.820610 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.820591 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 01:19:17.820715 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.820611 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 01:19:17.820715 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.820598 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 01:19:17.846527 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.846504 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:17.903343 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.903315 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:17.967412 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.967384 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-tls\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:17.967576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.967419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-wtmp\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:17.967576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.967459 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89e36459-f8c2-4aad-83e3-0ff8418874d7-metrics-client-ca\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:17.967576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.967499 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-textfile\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:17.967576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.967565 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89e36459-f8c2-4aad-83e3-0ff8418874d7-sys\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:17.967766 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.967581 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89e36459-f8c2-4aad-83e3-0ff8418874d7-root\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:17.967766 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.967612 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzv2c\" (UniqueName: \"kubernetes.io/projected/89e36459-f8c2-4aad-83e3-0ff8418874d7-kube-api-access-mzv2c\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:17.967766 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.967658 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:17.967766 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:17.967703 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.049575 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.049549 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:18.068711 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.068653 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89e36459-f8c2-4aad-83e3-0ff8418874d7-sys\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.068711 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.068681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89e36459-f8c2-4aad-83e3-0ff8418874d7-root\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.068847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.068711 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzv2c\" (UniqueName: \"kubernetes.io/projected/89e36459-f8c2-4aad-83e3-0ff8418874d7-kube-api-access-mzv2c\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.068847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.068736 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.068847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.068763 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89e36459-f8c2-4aad-83e3-0ff8418874d7-sys\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.068847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.068764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.068847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.068820 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-tls\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.068847 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.068846 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-wtmp\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.069359 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.068771 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89e36459-f8c2-4aad-83e3-0ff8418874d7-root\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.069359 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.068896 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89e36459-f8c2-4aad-83e3-0ff8418874d7-metrics-client-ca\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.069359 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.068934 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-textfile\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.069359 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.069117 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-wtmp\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.069359 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.069219 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-textfile\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.069359 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.069342 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.069554 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.069433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89e36459-f8c2-4aad-83e3-0ff8418874d7-metrics-client-ca\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.071044 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.071023 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-tls\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.071123 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.071077 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89e36459-f8c2-4aad-83e3-0ff8418874d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.077060 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.077032 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzv2c\" (UniqueName: \"kubernetes.io/projected/89e36459-f8c2-4aad-83e3-0ff8418874d7-kube-api-access-mzv2c\") pod \"node-exporter-scvp5\" (UID: \"89e36459-f8c2-4aad-83e3-0ff8418874d7\") " pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.127133 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.127108 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-scvp5" Jun 09 01:19:18.140391 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:19:18.140367 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e36459_f8c2_4aad_83e3_0ff8418874d7.slice/crio-8a6a2f499947d315dfbeffb93a92995c08b46e6a6ef3fc7123bd67674463212b WatchSource:0}: Error finding container 8a6a2f499947d315dfbeffb93a92995c08b46e6a6ef3fc7123bd67674463212b: Status 404 returned error can't find the container with id 8a6a2f499947d315dfbeffb93a92995c08b46e6a6ef3fc7123bd67674463212b Jun 09 01:19:18.150114 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.150087 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:18.456309 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.456220 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:18.557668 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.557637 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:18.772356 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.772276 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:18.872304 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:18.872243 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:19.041755 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.041665 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scvp5" event={"ID":"89e36459-f8c2-4aad-83e3-0ff8418874d7","Type":"ContainerStarted","Data":"8a6a2f499947d315dfbeffb93a92995c08b46e6a6ef3fc7123bd67674463212b"} Jun 09 01:19:19.274804 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.274742 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:19.796476 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.796392 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7d77d55c84-ltwgx"] Jun 09 01:19:19.799779 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.799763 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.803137 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.803112 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 01:19:19.803405 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.803388 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 01:19:19.803507 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.803409 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 01:19:19.803507 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.803390 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 01:19:19.803937 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.803920 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9ah579c9ghobg\"" Jun 09 01:19:19.804211 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.804194 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nx6bv\"" Jun 09 01:19:19.804372 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.804355 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 01:19:19.829338 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.829317 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d77d55c84-ltwgx"] Jun 09 01:19:19.882985 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.882962 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-grpc-tls\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.883106 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.883004 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.883106 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.883041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvmll\" (UniqueName: \"kubernetes.io/projected/398bc3a8-352c-4016-a226-45f16699cb3a-kube-api-access-fvmll\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.883106 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.883099 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.883231 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.883122 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/398bc3a8-352c-4016-a226-45f16699cb3a-metrics-client-ca\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.883231 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.883151 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-tls\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.883231 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.883170 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.883231 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.883208 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.984095 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.984050 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-grpc-tls\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.984311 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.984108 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.984311 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.984137 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvmll\" (UniqueName: \"kubernetes.io/projected/398bc3a8-352c-4016-a226-45f16699cb3a-kube-api-access-fvmll\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.984311 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.984174 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.984488 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.984393 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/398bc3a8-352c-4016-a226-45f16699cb3a-metrics-client-ca\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.984488 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.984456 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-tls\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.984488 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.984481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.984649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.984503 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.985171 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.985122 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/398bc3a8-352c-4016-a226-45f16699cb3a-metrics-client-ca\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.986813 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.986780 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.986949 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.986924 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-tls\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.987079 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.987061 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.987202 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.987183 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.987303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.987287 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-grpc-tls\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.987362 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.987290 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/398bc3a8-352c-4016-a226-45f16699cb3a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:19.991400 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:19.991384 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvmll\" (UniqueName: \"kubernetes.io/projected/398bc3a8-352c-4016-a226-45f16699cb3a-kube-api-access-fvmll\") pod \"thanos-querier-7d77d55c84-ltwgx\" (UID: \"398bc3a8-352c-4016-a226-45f16699cb3a\") " pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:20.046232 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:20.046206 2567 generic.go:356] "Generic (PLEG): container finished" podID="89e36459-f8c2-4aad-83e3-0ff8418874d7" containerID="1a8cde371250a22f62305cb4351cd407e1fe612a5ff9f568d4e60820f6f0a1f7" exitCode=0 Jun 09 01:19:20.046390 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:20.046298 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scvp5" event={"ID":"89e36459-f8c2-4aad-83e3-0ff8418874d7","Type":"ContainerDied","Data":"1a8cde371250a22f62305cb4351cd407e1fe612a5ff9f568d4e60820f6f0a1f7"} Jun 09 01:19:20.108493 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:20.108469 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:20.242741 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:20.242716 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d77d55c84-ltwgx"] Jun 09 01:19:20.244427 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:19:20.244391 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398bc3a8_352c_4016_a226_45f16699cb3a.slice/crio-bed1fe4b82217c3bd1089f14b56255a8dce542ecbf7d4fc42f56f57832183244 WatchSource:0}: Error finding container bed1fe4b82217c3bd1089f14b56255a8dce542ecbf7d4fc42f56f57832183244: Status 404 returned error can't find the container with id bed1fe4b82217c3bd1089f14b56255a8dce542ecbf7d4fc42f56f57832183244 Jun 09 01:19:20.744723 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:20.744683 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:20.845087 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:20.845050 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:20.898767 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:20.898725 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:21.052417 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:21.052333 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scvp5" event={"ID":"89e36459-f8c2-4aad-83e3-0ff8418874d7","Type":"ContainerStarted","Data":"a3eb36469bb60f64f9c0b347d1c113b817f20bcc4910005beef948ccd9ed6634"} Jun 09 01:19:21.052417 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:21.052392 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scvp5" event={"ID":"89e36459-f8c2-4aad-83e3-0ff8418874d7","Type":"ContainerStarted","Data":"6be956408f73f5f287b058e7ce2083622760a3608b759dda826e2b8f04176177"} Jun 09 01:19:21.053530 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:21.053510 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" event={"ID":"398bc3a8-352c-4016-a226-45f16699cb3a","Type":"ContainerStarted","Data":"bed1fe4b82217c3bd1089f14b56255a8dce542ecbf7d4fc42f56f57832183244"} Jun 09 01:19:21.071768 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:21.071736 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:21.072526 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:21.072486 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-scvp5" podStartSLOduration=2.961692188 podStartE2EDuration="4.072469741s" totalImagesPullingTime="1.046304998s" totalInitContainerRuntime="64.472555ms" isStatefulPod=true podCreationTimestamp="2026-06-09 01:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:19:21.070103519 +0000 UTC m=+224.182103370" watchObservedRunningTime="2026-06-09 01:19:21.072469741 +0000 UTC m=+224.184469595" Jun 09 01:19:22.110298 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.110260 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-57bd4f5c75-kdpd8"] Jun 09 01:19:22.113787 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.113765 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.116301 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.116273 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 01:19:22.116427 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.116384 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fbt1segc91f8t\"" Jun 09 01:19:22.117328 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.117127 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6k6gt\"" Jun 09 01:19:22.117328 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.117151 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 01:19:22.117328 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.117170 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 01:19:22.117328 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.117178 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 01:19:22.123109 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.123087 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57bd4f5c75-kdpd8"] Jun 09 01:19:22.205059 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.205026 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/39582a5d-5d18-4856-972a-2542fd4312cf-audit-log\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.205242 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.205085 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/39582a5d-5d18-4856-972a-2542fd4312cf-secret-metrics-server-tls\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.205333 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.205237 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/39582a5d-5d18-4856-972a-2542fd4312cf-secret-metrics-server-client-certs\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.205493 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.205467 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39582a5d-5d18-4856-972a-2542fd4312cf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.205563 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.205542 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/39582a5d-5d18-4856-972a-2542fd4312cf-metrics-server-audit-profiles\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.205623 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.205572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39582a5d-5d18-4856-972a-2542fd4312cf-client-ca-bundle\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.205623 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.205600 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj5c8\" (UniqueName: \"kubernetes.io/projected/39582a5d-5d18-4856-972a-2542fd4312cf-kube-api-access-nj5c8\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.306717 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.306674 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/39582a5d-5d18-4856-972a-2542fd4312cf-audit-log\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.306717 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.306710 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/39582a5d-5d18-4856-972a-2542fd4312cf-secret-metrics-server-tls\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.306944 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.306741 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/39582a5d-5d18-4856-972a-2542fd4312cf-secret-metrics-server-client-certs\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.306944 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.306807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39582a5d-5d18-4856-972a-2542fd4312cf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.306944 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.306849 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/39582a5d-5d18-4856-972a-2542fd4312cf-metrics-server-audit-profiles\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.306944 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.306869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39582a5d-5d18-4856-972a-2542fd4312cf-client-ca-bundle\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.306944 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.306899 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj5c8\" (UniqueName: \"kubernetes.io/projected/39582a5d-5d18-4856-972a-2542fd4312cf-kube-api-access-nj5c8\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.307359 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.307336 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/39582a5d-5d18-4856-972a-2542fd4312cf-audit-log\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.307553 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.307534 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39582a5d-5d18-4856-972a-2542fd4312cf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.307995 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.307970 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/39582a5d-5d18-4856-972a-2542fd4312cf-metrics-server-audit-profiles\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.309334 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.309308 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/39582a5d-5d18-4856-972a-2542fd4312cf-secret-metrics-server-tls\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.309569 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.309555 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39582a5d-5d18-4856-972a-2542fd4312cf-client-ca-bundle\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.309688 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.309672 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/39582a5d-5d18-4856-972a-2542fd4312cf-secret-metrics-server-client-certs\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.314170 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.314147 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj5c8\" (UniqueName: \"kubernetes.io/projected/39582a5d-5d18-4856-972a-2542fd4312cf-kube-api-access-nj5c8\") pod \"metrics-server-57bd4f5c75-kdpd8\" (UID: \"39582a5d-5d18-4856-972a-2542fd4312cf\") " pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.425013 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.424984 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:22.565366 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.565300 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:22.570848 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.570820 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-d88lz"] Jun 09 01:19:22.574174 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.574103 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57bd4f5c75-kdpd8"] Jun 09 01:19:22.574232 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.574195 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-d88lz" Jun 09 01:19:22.576507 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.576483 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-z5fsl\"" Jun 09 01:19:22.576634 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.576483 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 01:19:22.577419 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:19:22.577392 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39582a5d_5d18_4856_972a_2542fd4312cf.slice/crio-2077d35934edd4c33282def5a38df11deefc0a31618534566bbd550c3f06323f WatchSource:0}: Error finding container 2077d35934edd4c33282def5a38df11deefc0a31618534566bbd550c3f06323f: Status 404 returned error can't find the container with id 2077d35934edd4c33282def5a38df11deefc0a31618534566bbd550c3f06323f Jun 09 01:19:22.583499 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.583471 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-d88lz"] Jun 09 01:19:22.710455 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.710374 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnkht\" (UniqueName: \"kubernetes.io/projected/6c24c8a8-0959-4392-94da-56359f317adf-kube-api-access-qnkht\") pod \"monitoring-plugin-76b68cc874-d88lz\" (UID: \"6c24c8a8-0959-4392-94da-56359f317adf\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-d88lz" Jun 09 01:19:22.710604 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.710482 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c24c8a8-0959-4392-94da-56359f317adf-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-d88lz\" (UID: \"6c24c8a8-0959-4392-94da-56359f317adf\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-d88lz" Jun 09 01:19:22.785967 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.785932 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:22.811177 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.811146 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c24c8a8-0959-4392-94da-56359f317adf-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-d88lz\" (UID: \"6c24c8a8-0959-4392-94da-56359f317adf\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-d88lz" Jun 09 01:19:22.811343 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.811218 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnkht\" (UniqueName: \"kubernetes.io/projected/6c24c8a8-0959-4392-94da-56359f317adf-kube-api-access-qnkht\") pod \"monitoring-plugin-76b68cc874-d88lz\" (UID: \"6c24c8a8-0959-4392-94da-56359f317adf\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-d88lz" Jun 09 01:19:22.813524 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.813506 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c24c8a8-0959-4392-94da-56359f317adf-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-d88lz\" (UID: \"6c24c8a8-0959-4392-94da-56359f317adf\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-d88lz" Jun 09 01:19:22.821022 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.821004 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnkht\" (UniqueName: \"kubernetes.io/projected/6c24c8a8-0959-4392-94da-56359f317adf-kube-api-access-qnkht\") pod \"monitoring-plugin-76b68cc874-d88lz\" (UID: \"6c24c8a8-0959-4392-94da-56359f317adf\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-d88lz" Jun 09 01:19:22.886321 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.886290 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-d88lz" Jun 09 01:19:22.978564 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.978536 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-594566b867-mwrx8"] Jun 09 01:19:22.982904 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.982880 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:22.986999 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.986966 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 01:19:22.987146 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.987013 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 01:19:22.987146 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.987100 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 01:19:22.987318 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.987297 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 01:19:22.987318 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.987300 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 01:19:22.987502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.987376 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mpzfm\"" Jun 09 01:19:22.992755 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:22.992736 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 01:19:23.001287 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.001242 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-594566b867-mwrx8"] Jun 09 01:19:23.014592 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.014572 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-d88lz"] Jun 09 01:19:23.016790 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:19:23.016763 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c24c8a8_0959_4392_94da_56359f317adf.slice/crio-217189732c7e92caee9202513af5dce79287cb0549f841e8f6a4fec3c08b5479 WatchSource:0}: Error finding container 217189732c7e92caee9202513af5dce79287cb0549f841e8f6a4fec3c08b5479: Status 404 returned error can't find the container with id 217189732c7e92caee9202513af5dce79287cb0549f841e8f6a4fec3c08b5479 Jun 09 01:19:23.061517 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.061482 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" event={"ID":"398bc3a8-352c-4016-a226-45f16699cb3a","Type":"ContainerStarted","Data":"4793d306cb71c03f976dfb6ccc637705a1fdbec3f2549732cee410a6ea6fb04e"} Jun 09 01:19:23.061658 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.061553 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" event={"ID":"398bc3a8-352c-4016-a226-45f16699cb3a","Type":"ContainerStarted","Data":"edc26673bfbe2cbb8bfd395b0dd2cfecc08baade0bb824fa8f2d02857fde6b2c"} Jun 09 01:19:23.061658 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.061583 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" event={"ID":"398bc3a8-352c-4016-a226-45f16699cb3a","Type":"ContainerStarted","Data":"83b474c11b594cce740fa0ebf614dac43465b14d9b8c0ec0039c61541668fe2c"} Jun 09 01:19:23.062618 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.062596 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-d88lz" event={"ID":"6c24c8a8-0959-4392-94da-56359f317adf","Type":"ContainerStarted","Data":"217189732c7e92caee9202513af5dce79287cb0549f841e8f6a4fec3c08b5479"} Jun 09 01:19:23.063647 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.063625 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" event={"ID":"39582a5d-5d18-4856-972a-2542fd4312cf","Type":"ContainerStarted","Data":"2077d35934edd4c33282def5a38df11deefc0a31618534566bbd550c3f06323f"} Jun 09 01:19:23.114675 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.114642 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cd3479eb-3b38-4555-8838-b4e045775022-secret-telemeter-client\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.115062 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.114693 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd3479eb-3b38-4555-8838-b4e045775022-serving-certs-ca-bundle\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.115062 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.114774 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cd3479eb-3b38-4555-8838-b4e045775022-federate-client-tls\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.115062 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.114841 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cd3479eb-3b38-4555-8838-b4e045775022-telemeter-client-tls\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.115062 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.114876 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd3479eb-3b38-4555-8838-b4e045775022-metrics-client-ca\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.115062 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.114903 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd3479eb-3b38-4555-8838-b4e045775022-telemeter-trusted-ca-bundle\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.115062 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.114931 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2mdh\" (UniqueName: \"kubernetes.io/projected/cd3479eb-3b38-4555-8838-b4e045775022-kube-api-access-p2mdh\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.115062 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.115042 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd3479eb-3b38-4555-8838-b4e045775022-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.216555 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.216515 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cd3479eb-3b38-4555-8838-b4e045775022-federate-client-tls\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.216720 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.216570 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cd3479eb-3b38-4555-8838-b4e045775022-telemeter-client-tls\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.216720 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.216597 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd3479eb-3b38-4555-8838-b4e045775022-metrics-client-ca\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.216720 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.216621 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd3479eb-3b38-4555-8838-b4e045775022-telemeter-trusted-ca-bundle\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.216720 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.216640 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2mdh\" (UniqueName: \"kubernetes.io/projected/cd3479eb-3b38-4555-8838-b4e045775022-kube-api-access-p2mdh\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.216720 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.216699 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd3479eb-3b38-4555-8838-b4e045775022-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.216990 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.216750 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cd3479eb-3b38-4555-8838-b4e045775022-secret-telemeter-client\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.216990 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.216781 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd3479eb-3b38-4555-8838-b4e045775022-serving-certs-ca-bundle\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.217634 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.217605 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd3479eb-3b38-4555-8838-b4e045775022-serving-certs-ca-bundle\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.218017 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.217991 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd3479eb-3b38-4555-8838-b4e045775022-telemeter-trusted-ca-bundle\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.218187 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.218136 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd3479eb-3b38-4555-8838-b4e045775022-metrics-client-ca\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.220384 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.220114 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cd3479eb-3b38-4555-8838-b4e045775022-federate-client-tls\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.220384 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.220342 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd3479eb-3b38-4555-8838-b4e045775022-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.220669 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.220649 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cd3479eb-3b38-4555-8838-b4e045775022-secret-telemeter-client\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.221319 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.221299 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cd3479eb-3b38-4555-8838-b4e045775022-telemeter-client-tls\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.225175 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.225151 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2mdh\" (UniqueName: \"kubernetes.io/projected/cd3479eb-3b38-4555-8838-b4e045775022-kube-api-access-p2mdh\") pod \"telemeter-client-594566b867-mwrx8\" (UID: \"cd3479eb-3b38-4555-8838-b4e045775022\") " pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.294241 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.294204 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" Jun 09 01:19:23.554613 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:23.554434 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-594566b867-mwrx8"] Jun 09 01:19:23.557669 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:19:23.557639 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3479eb_3b38_4555_8838_b4e045775022.slice/crio-b6f6ecd53af9ce184528742ef6b75b1097540afa47062abb3b12c9bdddecc671 WatchSource:0}: Error finding container b6f6ecd53af9ce184528742ef6b75b1097540afa47062abb3b12c9bdddecc671: Status 404 returned error can't find the container with id b6f6ecd53af9ce184528742ef6b75b1097540afa47062abb3b12c9bdddecc671 Jun 09 01:19:24.011625 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.011597 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 01:19:24.013652 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.013628 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:24.015709 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.015688 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.018429 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.018405 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 01:19:24.018539 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.018406 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sfc4d\"" Jun 09 01:19:24.018539 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.018409 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 01:19:24.018539 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.018419 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 01:19:24.018901 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.018883 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 01:19:24.019002 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.018921 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 01:19:24.019002 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.018928 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 01:19:24.019118 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.018924 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 01:19:24.019118 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.018922 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 01:19:24.019566 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.019529 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 01:19:24.019665 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.019635 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bi0rf21h3t8h6\"" Jun 09 01:19:24.019877 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.019852 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 01:19:24.020035 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.019946 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 01:19:24.020035 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.019968 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 01:19:24.020035 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.019946 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 01:19:24.021967 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.021841 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 01:19:24.037265 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.037212 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 01:19:24.072181 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.072146 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" event={"ID":"398bc3a8-352c-4016-a226-45f16699cb3a","Type":"ContainerStarted","Data":"3fd2ce9b9e82ee65b2d580f0e3c297427e61112181fb245f461cd7c5987fae4f"} Jun 09 01:19:24.072346 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.072227 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" event={"ID":"398bc3a8-352c-4016-a226-45f16699cb3a","Type":"ContainerStarted","Data":"9ee0ead69db61d577a89b39591ce0e5acd2f46c919a6d4a54fa96847da5cb3a7"} Jun 09 01:19:24.072346 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.072287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" event={"ID":"398bc3a8-352c-4016-a226-45f16699cb3a","Type":"ContainerStarted","Data":"7236c3db8ef2edb50ab0733be1b08bb8a779e09e7636bde7177948e31cf749f2"} Jun 09 01:19:24.072346 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.072332 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:24.073819 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.073782 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" event={"ID":"cd3479eb-3b38-4555-8838-b4e045775022","Type":"ContainerStarted","Data":"b6f6ecd53af9ce184528742ef6b75b1097540afa47062abb3b12c9bdddecc671"} Jun 09 01:19:24.092583 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.092485 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" podStartSLOduration=2.093280332 podStartE2EDuration="5.092471036s" totalImagesPullingTime="2.999190704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:19:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:19:24.091558904 +0000 UTC m=+227.203558758" watchObservedRunningTime="2026-06-09 01:19:24.092471036 +0000 UTC m=+227.204470886" Jun 09 01:19:24.124867 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.124837 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.124867 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.124869 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.124893 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-config\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.124916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.124931 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.124945 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.124965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.124979 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.125004 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e969780-301c-4d8b-8d33-f3f4e9073309-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.125018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e969780-301c-4d8b-8d33-f3f4e9073309-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.125037 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.125054 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.125069 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.125093 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.125111 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.125139 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.125153 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.125217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.125177 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.126000 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.125231 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.126000 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.125263 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6llmv\" (UniqueName: \"kubernetes.io/projected/0e969780-301c-4d8b-8d33-f3f4e9073309-kube-api-access-6llmv\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.225898 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.225861 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226088 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.225942 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226088 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.225966 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6llmv\" (UniqueName: \"kubernetes.io/projected/0e969780-301c-4d8b-8d33-f3f4e9073309-kube-api-access-6llmv\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226088 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226038 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226088 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226060 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226330 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226095 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-config\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226330 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226147 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226330 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226173 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226330 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226200 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226330 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226236 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226330 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226283 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226609 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226361 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e969780-301c-4d8b-8d33-f3f4e9073309-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226609 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226384 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e969780-301c-4d8b-8d33-f3f4e9073309-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226609 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226421 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226609 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226473 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226609 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.226609 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.227598 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226634 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.227598 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226642 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.227598 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226928 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.227598 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.226956 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.227598 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.227329 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.228606 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.228197 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.228732 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.228632 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.228800 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.228742 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.229524 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.229500 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.232123 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.232094 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.232738 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.232537 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.232738 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.232706 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.232908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.232807 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.233088 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.233067 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.233212 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.233071 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.233318 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.233084 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.233433 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.233386 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.233900 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.233878 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-config\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.235820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.235765 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.235820 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.235790 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.236192 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.236170 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e969780-301c-4d8b-8d33-f3f4e9073309-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.236376 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.236360 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6llmv\" (UniqueName: \"kubernetes.io/projected/0e969780-301c-4d8b-8d33-f3f4e9073309-kube-api-access-6llmv\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.237667 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.237647 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e969780-301c-4d8b-8d33-f3f4e9073309-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.325945 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.325912 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:24.485690 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:24.485664 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 01:19:24.487274 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:19:24.487198 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e969780_301c_4d8b_8d33_f3f4e9073309.slice/crio-8e745e02e96ca27f2be4bad951e4700927b9b71c07effdf2a963d9f700f627a9 WatchSource:0}: Error finding container 8e745e02e96ca27f2be4bad951e4700927b9b71c07effdf2a963d9f700f627a9: Status 404 returned error can't find the container with id 8e745e02e96ca27f2be4bad951e4700927b9b71c07effdf2a963d9f700f627a9 Jun 09 01:19:25.079986 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:25.079947 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-d88lz" event={"ID":"6c24c8a8-0959-4392-94da-56359f317adf","Type":"ContainerStarted","Data":"3be8510689cc9abbad8077a32d12045970d4cb5bc3834088fc6f7699ccf747e8"} Jun 09 01:19:25.080374 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:25.080169 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-d88lz" Jun 09 01:19:25.082340 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:25.082311 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" event={"ID":"39582a5d-5d18-4856-972a-2542fd4312cf","Type":"ContainerStarted","Data":"c869890815430c8ba7db0cb99585a0fdf0e0cf1a4fee0b0daf2ad44aadbeea08"} Jun 09 01:19:25.084131 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:25.084104 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerStarted","Data":"8e745e02e96ca27f2be4bad951e4700927b9b71c07effdf2a963d9f700f627a9"} Jun 09 01:19:25.086220 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:25.086200 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-d88lz" Jun 09 01:19:25.095791 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:25.095740 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-d88lz" podStartSLOduration=1.183836149 podStartE2EDuration="3.095723711s" totalImagesPullingTime="1.911887562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:19:25.094489426 +0000 UTC m=+228.206489291" watchObservedRunningTime="2026-06-09 01:19:25.095723711 +0000 UTC m=+228.207723562" Jun 09 01:19:25.127106 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:25.127058 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" podStartSLOduration=1.672276047 podStartE2EDuration="3.127038397s" totalImagesPullingTime="1.45476235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:19:25.126599435 +0000 UTC m=+228.238599285" watchObservedRunningTime="2026-06-09 01:19:25.127038397 +0000 UTC m=+228.239038250" Jun 09 01:19:27.093389 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:27.093352 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" event={"ID":"cd3479eb-3b38-4555-8838-b4e045775022","Type":"ContainerStarted","Data":"99e5566fa84d4dce5d76ded024f4d1722b8f99fe2f8609dfcb7d7f31a1bcea0d"} Jun 09 01:19:27.093781 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:27.093458 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" event={"ID":"cd3479eb-3b38-4555-8838-b4e045775022","Type":"ContainerStarted","Data":"6f3e617a68b2fcb0591f2b337f71cea564e70889d06e145d77b24285c17279d4"} Jun 09 01:19:27.093781 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:27.093494 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" event={"ID":"cd3479eb-3b38-4555-8838-b4e045775022","Type":"ContainerStarted","Data":"9d15f05ca7a66a42b2d2d4ada32a6fc96cb58ee7d6d1d7c971e204d08c2e7275"} Jun 09 01:19:27.094952 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:27.094931 2567 generic.go:356] "Generic (PLEG): container finished" podID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerID="af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6" exitCode=0 Jun 09 01:19:27.095048 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:27.095024 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerDied","Data":"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6"} Jun 09 01:19:27.114647 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:27.114605 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-594566b867-mwrx8" podStartSLOduration=2.613509476 podStartE2EDuration="5.114592302s" totalImagesPullingTime="2.501082826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:19:27.114026568 +0000 UTC m=+230.226026420" watchObservedRunningTime="2026-06-09 01:19:27.114592302 +0000 UTC m=+230.226592153" Jun 09 01:19:30.090545 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:30.090518 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d77d55c84-ltwgx" Jun 09 01:19:31.114140 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:31.114105 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerStarted","Data":"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6"} Jun 09 01:19:31.114524 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:31.114174 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerStarted","Data":"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578"} Jun 09 01:19:31.114524 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:31.114200 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerStarted","Data":"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5"} Jun 09 01:19:31.114524 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:31.114225 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerStarted","Data":"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e"} Jun 09 01:19:31.114524 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:31.114269 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerStarted","Data":"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7"} Jun 09 01:19:31.114524 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:31.114310 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerStarted","Data":"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d"} Jun 09 01:19:31.139892 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:31.139845 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.542336904 podStartE2EDuration="8.139829042s" totalImagesPullingTime="4.578661333s" totalInitContainerRuntime="18.830805ms" isStatefulPod=false podCreationTimestamp="2026-06-09 01:19:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:19:31.137750447 +0000 UTC m=+234.249750298" watchObservedRunningTime="2026-06-09 01:19:31.139829042 +0000 UTC m=+234.251828892" Jun 09 01:19:33.533020 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:33.532988 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:33.628894 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:33.628853 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:33.681901 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:33.681873 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:33.812673 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:33.812647 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:33.993395 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:33.993357 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:34.095093 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:34.095012 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:34.326554 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:34.326527 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:19:34.396951 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:34.396875 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:34.497770 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:34.497741 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:34.598207 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:34.598180 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:35.200389 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:35.200359 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:35.404815 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:35.404787 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:35.656161 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:35.656127 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:36.218292 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:36.218240 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:36.268064 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:36.268037 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:40.099984 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:40.099946 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:40.146381 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:40.146349 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:42.425290 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:42.425245 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:42.425753 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:42.425327 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:19:46.622438 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:46.622398 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:46.672074 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:46.672043 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:48.244967 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:48.244934 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:19:48.247174 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:48.247148 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b149e648-ac8f-4faf-82f1-a48fcce0e32c-metrics-certs\") pod \"network-metrics-daemon-tkpd9\" (UID: \"b149e648-ac8f-4faf-82f1-a48fcce0e32c\") " pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:19:48.340532 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:48.340509 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6pwvx\"" Jun 09 01:19:48.348506 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:48.348488 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkpd9" Jun 09 01:19:48.471113 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:48.471025 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tkpd9"] Jun 09 01:19:48.473677 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:19:48.473652 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb149e648_ac8f_4faf_82f1_a48fcce0e32c.slice/crio-3bb78595b1b48cd18075a0888a013ef4294248655bdf730be645d4e209f99daf WatchSource:0}: Error finding container 3bb78595b1b48cd18075a0888a013ef4294248655bdf730be645d4e209f99daf: Status 404 returned error can't find the container with id 3bb78595b1b48cd18075a0888a013ef4294248655bdf730be645d4e209f99daf Jun 09 01:19:49.181842 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:49.181808 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tkpd9" event={"ID":"b149e648-ac8f-4faf-82f1-a48fcce0e32c","Type":"ContainerStarted","Data":"3bb78595b1b48cd18075a0888a013ef4294248655bdf730be645d4e209f99daf"} Jun 09 01:19:49.624152 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:49.623998 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:49.671151 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:49.671125 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:50.187163 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:50.187131 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tkpd9" event={"ID":"b149e648-ac8f-4faf-82f1-a48fcce0e32c","Type":"ContainerStarted","Data":"e13ee23611f1f194747f216311d15246eac889231af1babb2e309f3017b0b2a8"} Jun 09 01:19:50.187368 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:50.187218 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tkpd9" event={"ID":"b149e648-ac8f-4faf-82f1-a48fcce0e32c","Type":"ContainerStarted","Data":"337d4fa348a68e5847de5a0ec4d04d536d66b29297f6dd6fc66b91ebd7374b2f"} Jun 09 01:19:50.203954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:50.203904 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tkpd9" podStartSLOduration=252.233743739 podStartE2EDuration="4m13.203864871s" totalImagesPullingTime="970.121132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:19:50.202472368 +0000 UTC m=+253.314472220" watchObservedRunningTime="2026-06-09 01:19:50.203864871 +0000 UTC m=+253.315864723" Jun 09 01:19:50.278133 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:50.278105 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:50.381205 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:50.381171 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:52.429586 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:52.429554 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:52.537564 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:52.537531 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:52.590763 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:52.590731 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:52.646142 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:52.646116 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:53.254845 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:53.254809 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:53.300220 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:53.300191 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:59.919542 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:59.919465 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:19:59.971524 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:19:59.971487 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:02.431045 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:02.431013 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:20:02.434773 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:02.434750 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-57bd4f5c75-kdpd8" Jun 09 01:20:09.370122 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:09.370079 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:09.470719 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:09.470683 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:10.993308 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:10.993271 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:11.050697 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:11.050664 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:17.839539 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:20:17.839493 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" podUID="2e542323-8d7c-411f-b67f-d3ba3dfcdad8" Jun 09 01:20:17.839539 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:20:17.839493 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mg45n" podUID="567d595f-9152-43ac-9850-1f7f4b48653e" Jun 09 01:20:18.286630 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:18.286547 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:20:18.286804 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:18.286547 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mg45n" Jun 09 01:20:18.991366 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:18.991328 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:19.035798 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:19.035763 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:21.128415 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:21.128376 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:20:21.128817 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:21.128436 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:20:21.130796 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:21.130766 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls\") pod \"image-registry-6d68fdfffc-zgxw4\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:20:21.130905 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:21.130771 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/567d595f-9152-43ac-9850-1f7f4b48653e-metrics-tls\") pod \"dns-default-mg45n\" (UID: \"567d595f-9152-43ac-9850-1f7f4b48653e\") " pod="openshift-dns/dns-default-mg45n" Jun 09 01:20:21.291262 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:21.291229 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8c589\"" Jun 09 01:20:21.291409 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:21.291229 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j9cpl\"" Jun 09 01:20:21.298195 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:21.298176 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:20:21.298326 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:21.298297 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mg45n" Jun 09 01:20:21.439172 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:21.439148 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d68fdfffc-zgxw4"] Jun 09 01:20:21.441352 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:20:21.441311 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e542323_8d7c_411f_b67f_d3ba3dfcdad8.slice/crio-fef9e06b27b3e0e9c6ea6fba924c6def9ed475d258c8ad83e7f22fa96ad6553d WatchSource:0}: Error finding container fef9e06b27b3e0e9c6ea6fba924c6def9ed475d258c8ad83e7f22fa96ad6553d: Status 404 returned error can't find the container with id fef9e06b27b3e0e9c6ea6fba924c6def9ed475d258c8ad83e7f22fa96ad6553d Jun 09 01:20:21.450219 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:21.450196 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mg45n"] Jun 09 01:20:21.453285 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:20:21.453260 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod567d595f_9152_43ac_9850_1f7f4b48653e.slice/crio-08c4c5e26a6088b274bde6e70e159fa3d3440dd40ee74274763c3cd2e7e010c8 WatchSource:0}: Error finding container 08c4c5e26a6088b274bde6e70e159fa3d3440dd40ee74274763c3cd2e7e010c8: Status 404 returned error can't find the container with id 08c4c5e26a6088b274bde6e70e159fa3d3440dd40ee74274763c3cd2e7e010c8 Jun 09 01:20:22.303808 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:22.303736 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mg45n" event={"ID":"567d595f-9152-43ac-9850-1f7f4b48653e","Type":"ContainerStarted","Data":"08c4c5e26a6088b274bde6e70e159fa3d3440dd40ee74274763c3cd2e7e010c8"} Jun 09 01:20:22.305483 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:22.305440 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" event={"ID":"2e542323-8d7c-411f-b67f-d3ba3dfcdad8","Type":"ContainerStarted","Data":"7ddec368c0dd47f8f5f71a3cfcd15b4bdd90d9da96d0cdce19e634a03c91ac4d"} Jun 09 01:20:22.305626 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:22.305488 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" event={"ID":"2e542323-8d7c-411f-b67f-d3ba3dfcdad8","Type":"ContainerStarted","Data":"fef9e06b27b3e0e9c6ea6fba924c6def9ed475d258c8ad83e7f22fa96ad6553d"} Jun 09 01:20:22.305626 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:22.305577 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:20:22.327025 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:22.326961 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" podStartSLOduration=285.326941867 podStartE2EDuration="4m45.326941867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:15:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:20:22.324860866 +0000 UTC m=+285.436860744" watchObservedRunningTime="2026-06-09 01:20:22.326941867 +0000 UTC m=+285.438941719" Jun 09 01:20:23.311563 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:23.311459 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mg45n" event={"ID":"567d595f-9152-43ac-9850-1f7f4b48653e","Type":"ContainerStarted","Data":"38d6b1c40781b42ca043261e82577803f49aebc536d4ace3b06dc3b1915f256a"} Jun 09 01:20:23.311563 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:23.311559 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mg45n" event={"ID":"567d595f-9152-43ac-9850-1f7f4b48653e","Type":"ContainerStarted","Data":"104aea9b190851c2cf5afc61843b7dfefdc1a79b842492cc6ae14c30cad4acf6"} Jun 09 01:20:23.330263 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:23.330206 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mg45n" podStartSLOduration=250.768223684 podStartE2EDuration="4m12.330191189s" totalImagesPullingTime="1.561967505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:20:23.328014373 +0000 UTC m=+286.440014225" watchObservedRunningTime="2026-06-09 01:20:23.330191189 +0000 UTC m=+286.442191038" Jun 09 01:20:24.316736 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:24.316705 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mg45n" Jun 09 01:20:24.326996 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:24.326968 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:24.343266 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:24.343224 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:25.335867 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:25.335835 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:28.553032 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:28.552992 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:28.653954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:28.653921 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:33.884840 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:33.884806 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:33.945965 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:33.945914 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:34.322247 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:34.322216 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mg45n" Jun 09 01:20:37.292692 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:37.292668 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:20:37.293512 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:37.293493 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:20:37.296607 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:37.296589 2567 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 01:20:37.517597 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:37.517464 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:37.565569 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:37.565539 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:37.677456 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:37.677430 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:37.725844 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:37.725819 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:38.051306 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:38.051217 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:38.153948 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:38.153917 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:38.659147 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:38.659114 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:39.906606 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:39.906575 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:41.303392 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:41.303353 2567 patch_prober.go:28] interesting pod/image-registry-6d68fdfffc-zgxw4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 01:20:41.303851 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:41.303423 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" podUID="2e542323-8d7c-411f-b67f-d3ba3dfcdad8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 01:20:42.446387 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.446353 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 01:20:42.446783 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.446636 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="prometheus" containerID="cri-o://6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d" gracePeriod=600 Jun 09 01:20:42.446783 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.446657 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="kube-rbac-proxy" containerID="cri-o://7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578" gracePeriod=600 Jun 09 01:20:42.446783 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.446682 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="thanos-sidecar" containerID="cri-o://acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e" gracePeriod=600 Jun 09 01:20:42.446783 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.446701 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="kube-rbac-proxy-web" containerID="cri-o://160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5" gracePeriod=600 Jun 09 01:20:42.446783 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.446692 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6" gracePeriod=600 Jun 09 01:20:42.447053 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.446760 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="config-reloader" containerID="cri-o://5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7" gracePeriod=600 Jun 09 01:20:42.676900 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.676878 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:42.802022 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.801960 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-kube-rbac-proxy\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802022 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.801995 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-config\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802022 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802012 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802269 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802041 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e969780-301c-4d8b-8d33-f3f4e9073309-config-out\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802269 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802073 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-db\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802269 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802112 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-metrics-client-ca\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802269 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802136 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-serving-certs-ca-bundle\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802269 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802161 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-0\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802269 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802205 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-trusted-ca-bundle\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802269 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802231 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e969780-301c-4d8b-8d33-f3f4e9073309-tls-assets\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802681 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802278 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-metrics-client-certs\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802681 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802313 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-1\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802681 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802355 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-tls\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802681 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802383 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-thanos-prometheus-http-client-file\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802681 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802414 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6llmv\" (UniqueName: \"kubernetes.io/projected/0e969780-301c-4d8b-8d33-f3f4e9073309-kube-api-access-6llmv\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802681 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802444 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-kubelet-serving-ca-bundle\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802681 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802469 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-grpc-tls\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802681 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802506 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-2\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802681 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802533 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.802681 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802534 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 01:20:42.802681 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802560 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-web-config\") pod \"0e969780-301c-4d8b-8d33-f3f4e9073309\" (UID: \"0e969780-301c-4d8b-8d33-f3f4e9073309\") " Jun 09 01:20:42.803232 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.802901 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-metrics-client-ca\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.803308 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.803221 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:20:42.803966 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.803904 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 01:20:42.804329 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.804046 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 01:20:42.804878 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.804770 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 01:20:42.804878 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.804810 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 01:20:42.804878 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.804817 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 01:20:42.805329 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.805294 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 01:20:42.805424 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.805338 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 01:20:42.805725 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.805673 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-config" (OuterVolumeSpecName: "config") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 01:20:42.805821 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.805775 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e969780-301c-4d8b-8d33-f3f4e9073309-config-out" (OuterVolumeSpecName: "config-out") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:20:42.806036 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.806004 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 01:20:42.806388 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.806357 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e969780-301c-4d8b-8d33-f3f4e9073309-kube-api-access-6llmv" (OuterVolumeSpecName: "kube-api-access-6llmv") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "kube-api-access-6llmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:20:42.806666 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.806640 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 01:20:42.806971 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.806946 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 01:20:42.807095 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.807079 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e969780-301c-4d8b-8d33-f3f4e9073309-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:20:42.807287 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.807269 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 01:20:42.807799 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.807781 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 01:20:42.807968 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.807952 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 01:20:42.816192 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.816165 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-web-config" (OuterVolumeSpecName: "web-config") pod "0e969780-301c-4d8b-8d33-f3f4e9073309" (UID: "0e969780-301c-4d8b-8d33-f3f4e9073309"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 01:20:42.903836 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903814 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903836 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903834 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903844 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903852 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e969780-301c-4d8b-8d33-f3f4e9073309-tls-assets\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903861 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-metrics-client-certs\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903869 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903878 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903886 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903894 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6llmv\" (UniqueName: \"kubernetes.io/projected/0e969780-301c-4d8b-8d33-f3f4e9073309-kube-api-access-6llmv\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903903 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903911 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-grpc-tls\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903919 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903927 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903935 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-web-config\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903944 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-kube-rbac-proxy\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903951 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-config\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.903954 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903960 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e969780-301c-4d8b-8d33-f3f4e9073309-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.904443 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903968 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e969780-301c-4d8b-8d33-f3f4e9073309-config-out\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:42.904443 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:42.903976 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e969780-301c-4d8b-8d33-f3f4e9073309-prometheus-k8s-db\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:20:43.315784 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.315758 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:20:43.392402 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392374 2567 generic.go:356] "Generic (PLEG): container finished" podID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerID="f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6" exitCode=0 Jun 09 01:20:43.392402 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392395 2567 generic.go:356] "Generic (PLEG): container finished" podID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerID="7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578" exitCode=0 Jun 09 01:20:43.392402 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392401 2567 generic.go:356] "Generic (PLEG): container finished" podID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerID="160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5" exitCode=0 Jun 09 01:20:43.392402 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392407 2567 generic.go:356] "Generic (PLEG): container finished" podID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerID="acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e" exitCode=0 Jun 09 01:20:43.392695 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392413 2567 generic.go:356] "Generic (PLEG): container finished" podID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerID="5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7" exitCode=0 Jun 09 01:20:43.392695 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392418 2567 generic.go:356] "Generic (PLEG): container finished" podID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerID="6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d" exitCode=0 Jun 09 01:20:43.392695 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392441 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.392695 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392443 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerDied","Data":"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6"} Jun 09 01:20:43.392695 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392526 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerDied","Data":"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578"} Jun 09 01:20:43.392695 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392569 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerDied","Data":"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5"} Jun 09 01:20:43.392695 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392592 2567 scope.go:117] "RemoveContainer" containerID="f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6" Jun 09 01:20:43.392695 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392611 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerDied","Data":"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e"} Jun 09 01:20:43.392695 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392653 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerDied","Data":"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7"} Jun 09 01:20:43.392695 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392694 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerDied","Data":"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d"} Jun 09 01:20:43.393093 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.392736 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e969780-301c-4d8b-8d33-f3f4e9073309","Type":"ContainerDied","Data":"8e745e02e96ca27f2be4bad951e4700927b9b71c07effdf2a963d9f700f627a9"} Jun 09 01:20:43.400625 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.400610 2567 scope.go:117] "RemoveContainer" containerID="7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578" Jun 09 01:20:43.407625 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.407607 2567 scope.go:117] "RemoveContainer" containerID="160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5" Jun 09 01:20:43.411732 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.411711 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 01:20:43.414400 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.414380 2567 scope.go:117] "RemoveContainer" containerID="acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e" Jun 09 01:20:43.418711 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.418695 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 01:20:43.421463 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.421447 2567 scope.go:117] "RemoveContainer" containerID="5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7" Jun 09 01:20:43.427617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.427600 2567 scope.go:117] "RemoveContainer" containerID="6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d" Jun 09 01:20:43.434545 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.434530 2567 scope.go:117] "RemoveContainer" containerID="af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6" Jun 09 01:20:43.438935 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.438917 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:43.441153 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.441138 2567 scope.go:117] "RemoveContainer" containerID="f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6" Jun 09 01:20:43.441420 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:20:43.441400 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6\": container with ID starting with f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6 not found: ID does not exist" containerID="f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6" Jun 09 01:20:43.441483 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.441428 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6"} err="failed to get container status \"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6\": rpc error: code = NotFound desc = could not find container \"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6\": container with ID starting with f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6 not found: ID does not exist" Jun 09 01:20:43.441523 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.441485 2567 scope.go:117] "RemoveContainer" containerID="7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578" Jun 09 01:20:43.441768 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:20:43.441753 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578\": container with ID starting with 7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578 not found: ID does not exist" containerID="7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578" Jun 09 01:20:43.441828 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.441774 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578"} err="failed to get container status \"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578\": rpc error: code = NotFound desc = could not find container \"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578\": container with ID starting with 7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578 not found: ID does not exist" Jun 09 01:20:43.441828 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.441788 2567 scope.go:117] "RemoveContainer" containerID="160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5" Jun 09 01:20:43.442001 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:20:43.441984 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5\": container with ID starting with 160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5 not found: ID does not exist" containerID="160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5" Jun 09 01:20:43.442039 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.442005 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5"} err="failed to get container status \"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5\": rpc error: code = NotFound desc = could not find container \"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5\": container with ID starting with 160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5 not found: ID does not exist" Jun 09 01:20:43.442039 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.442020 2567 scope.go:117] "RemoveContainer" containerID="acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e" Jun 09 01:20:43.442206 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:20:43.442191 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e\": container with ID starting with acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e not found: ID does not exist" containerID="acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e" Jun 09 01:20:43.442315 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.442209 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e"} err="failed to get container status \"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e\": rpc error: code = NotFound desc = could not find container \"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e\": container with ID starting with acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e not found: ID does not exist" Jun 09 01:20:43.442315 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.442222 2567 scope.go:117] "RemoveContainer" containerID="5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7" Jun 09 01:20:43.442440 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:20:43.442423 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7\": container with ID starting with 5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7 not found: ID does not exist" containerID="5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7" Jun 09 01:20:43.442478 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.442444 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7"} err="failed to get container status \"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7\": rpc error: code = NotFound desc = could not find container \"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7\": container with ID starting with 5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7 not found: ID does not exist" Jun 09 01:20:43.442478 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.442458 2567 scope.go:117] "RemoveContainer" containerID="6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d" Jun 09 01:20:43.442660 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:20:43.442645 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d\": container with ID starting with 6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d not found: ID does not exist" containerID="6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d" Jun 09 01:20:43.442706 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.442662 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d"} err="failed to get container status \"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d\": rpc error: code = NotFound desc = could not find container \"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d\": container with ID starting with 6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d not found: ID does not exist" Jun 09 01:20:43.442706 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.442674 2567 scope.go:117] "RemoveContainer" containerID="af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6" Jun 09 01:20:43.442928 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:20:43.442901 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6\": container with ID starting with af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6 not found: ID does not exist" containerID="af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6" Jun 09 01:20:43.442928 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.442921 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6"} err="failed to get container status \"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6\": rpc error: code = NotFound desc = could not find container \"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6\": container with ID starting with af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6 not found: ID does not exist" Jun 09 01:20:43.443036 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.442933 2567 scope.go:117] "RemoveContainer" containerID="f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6" Jun 09 01:20:43.443161 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.443146 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6"} err="failed to get container status \"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6\": rpc error: code = NotFound desc = could not find container \"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6\": container with ID starting with f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6 not found: ID does not exist" Jun 09 01:20:43.443202 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.443162 2567 scope.go:117] "RemoveContainer" containerID="7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578" Jun 09 01:20:43.443425 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.443409 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578"} err="failed to get container status \"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578\": rpc error: code = NotFound desc = could not find container \"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578\": container with ID starting with 7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578 not found: ID does not exist" Jun 09 01:20:43.443425 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.443425 2567 scope.go:117] "RemoveContainer" containerID="160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5" Jun 09 01:20:43.443650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.443634 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5"} err="failed to get container status \"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5\": rpc error: code = NotFound desc = could not find container \"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5\": container with ID starting with 160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5 not found: ID does not exist" Jun 09 01:20:43.443650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.443649 2567 scope.go:117] "RemoveContainer" containerID="acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e" Jun 09 01:20:43.443885 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.443856 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e"} err="failed to get container status \"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e\": rpc error: code = NotFound desc = could not find container \"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e\": container with ID starting with acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e not found: ID does not exist" Jun 09 01:20:43.443885 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.443885 2567 scope.go:117] "RemoveContainer" containerID="5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7" Jun 09 01:20:43.444113 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.444092 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7"} err="failed to get container status \"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7\": rpc error: code = NotFound desc = could not find container \"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7\": container with ID starting with 5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7 not found: ID does not exist" Jun 09 01:20:43.444175 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.444115 2567 scope.go:117] "RemoveContainer" containerID="6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d" Jun 09 01:20:43.444393 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.444370 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d"} err="failed to get container status \"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d\": rpc error: code = NotFound desc = could not find container \"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d\": container with ID starting with 6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d not found: ID does not exist" Jun 09 01:20:43.444474 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.444394 2567 scope.go:117] "RemoveContainer" containerID="af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6" Jun 09 01:20:43.444615 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.444599 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6"} err="failed to get container status \"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6\": rpc error: code = NotFound desc = could not find container \"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6\": container with ID starting with af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6 not found: ID does not exist" Jun 09 01:20:43.444660 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.444615 2567 scope.go:117] "RemoveContainer" containerID="f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6" Jun 09 01:20:43.444809 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.444790 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6"} err="failed to get container status \"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6\": rpc error: code = NotFound desc = could not find container \"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6\": container with ID starting with f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6 not found: ID does not exist" Jun 09 01:20:43.444876 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.444810 2567 scope.go:117] "RemoveContainer" containerID="7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578" Jun 09 01:20:43.445009 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.444994 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578"} err="failed to get container status \"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578\": rpc error: code = NotFound desc = could not find container \"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578\": container with ID starting with 7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578 not found: ID does not exist" Jun 09 01:20:43.445053 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.445009 2567 scope.go:117] "RemoveContainer" containerID="160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5" Jun 09 01:20:43.445197 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.445177 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5"} err="failed to get container status \"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5\": rpc error: code = NotFound desc = could not find container \"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5\": container with ID starting with 160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5 not found: ID does not exist" Jun 09 01:20:43.445197 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.445197 2567 scope.go:117] "RemoveContainer" containerID="acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e" Jun 09 01:20:43.445438 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.445423 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e"} err="failed to get container status \"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e\": rpc error: code = NotFound desc = could not find container \"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e\": container with ID starting with acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e not found: ID does not exist" Jun 09 01:20:43.445438 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.445438 2567 scope.go:117] "RemoveContainer" containerID="5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7" Jun 09 01:20:43.445623 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.445609 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7"} err="failed to get container status \"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7\": rpc error: code = NotFound desc = could not find container \"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7\": container with ID starting with 5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7 not found: ID does not exist" Jun 09 01:20:43.445623 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.445622 2567 scope.go:117] "RemoveContainer" containerID="6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d" Jun 09 01:20:43.445788 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.445773 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d"} err="failed to get container status \"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d\": rpc error: code = NotFound desc = could not find container \"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d\": container with ID starting with 6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d not found: ID does not exist" Jun 09 01:20:43.445830 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.445789 2567 scope.go:117] "RemoveContainer" containerID="af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6" Jun 09 01:20:43.445991 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.445965 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6"} err="failed to get container status \"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6\": rpc error: code = NotFound desc = could not find container \"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6\": container with ID starting with af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6 not found: ID does not exist" Jun 09 01:20:43.446117 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.445991 2567 scope.go:117] "RemoveContainer" containerID="f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6" Jun 09 01:20:43.446550 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.446440 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6"} err="failed to get container status \"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6\": rpc error: code = NotFound desc = could not find container \"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6\": container with ID starting with f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6 not found: ID does not exist" Jun 09 01:20:43.446550 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.446465 2567 scope.go:117] "RemoveContainer" containerID="7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578" Jun 09 01:20:43.446912 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.446783 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578"} err="failed to get container status \"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578\": rpc error: code = NotFound desc = could not find container \"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578\": container with ID starting with 7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578 not found: ID does not exist" Jun 09 01:20:43.446912 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.446806 2567 scope.go:117] "RemoveContainer" containerID="160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5" Jun 09 01:20:43.447099 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.447078 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5"} err="failed to get container status \"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5\": rpc error: code = NotFound desc = could not find container \"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5\": container with ID starting with 160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5 not found: ID does not exist" Jun 09 01:20:43.447151 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.447100 2567 scope.go:117] "RemoveContainer" containerID="acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e" Jun 09 01:20:43.447383 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.447363 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e"} err="failed to get container status \"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e\": rpc error: code = NotFound desc = could not find container \"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e\": container with ID starting with acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e not found: ID does not exist" Jun 09 01:20:43.447436 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.447384 2567 scope.go:117] "RemoveContainer" containerID="5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7" Jun 09 01:20:43.447643 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.447627 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7"} err="failed to get container status \"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7\": rpc error: code = NotFound desc = could not find container \"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7\": container with ID starting with 5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7 not found: ID does not exist" Jun 09 01:20:43.447702 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.447642 2567 scope.go:117] "RemoveContainer" containerID="6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d" Jun 09 01:20:43.447853 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.447837 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d"} err="failed to get container status \"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d\": rpc error: code = NotFound desc = could not find container \"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d\": container with ID starting with 6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d not found: ID does not exist" Jun 09 01:20:43.447900 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.447853 2567 scope.go:117] "RemoveContainer" containerID="af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6" Jun 09 01:20:43.448061 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448041 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6"} err="failed to get container status \"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6\": rpc error: code = NotFound desc = could not find container \"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6\": container with ID starting with af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6 not found: ID does not exist" Jun 09 01:20:43.448114 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448062 2567 scope.go:117] "RemoveContainer" containerID="f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6" Jun 09 01:20:43.448150 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448113 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 01:20:43.448299 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448283 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6"} err="failed to get container status \"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6\": rpc error: code = NotFound desc = could not find container \"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6\": container with ID starting with f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6 not found: ID does not exist" Jun 09 01:20:43.448360 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448300 2567 scope.go:117] "RemoveContainer" containerID="7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578" Jun 09 01:20:43.448444 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448429 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="kube-rbac-proxy-web" Jun 09 01:20:43.448486 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448446 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="kube-rbac-proxy-web" Jun 09 01:20:43.448486 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448466 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="thanos-sidecar" Jun 09 01:20:43.448486 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448474 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="thanos-sidecar" Jun 09 01:20:43.448486 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448486 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="kube-rbac-proxy-thanos" Jun 09 01:20:43.448617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448493 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="kube-rbac-proxy-thanos" Jun 09 01:20:43.448617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448499 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="init-config-reloader" Jun 09 01:20:43.448617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448505 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="init-config-reloader" Jun 09 01:20:43.448617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448512 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="config-reloader" Jun 09 01:20:43.448617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448517 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="config-reloader" Jun 09 01:20:43.448617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448524 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="prometheus" Jun 09 01:20:43.448617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448529 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="prometheus" Jun 09 01:20:43.448617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448529 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578"} err="failed to get container status \"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578\": rpc error: code = NotFound desc = could not find container \"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578\": container with ID starting with 7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578 not found: ID does not exist" Jun 09 01:20:43.448617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448542 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="kube-rbac-proxy" Jun 09 01:20:43.448617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448545 2567 scope.go:117] "RemoveContainer" containerID="160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5" Jun 09 01:20:43.448617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448548 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="kube-rbac-proxy" Jun 09 01:20:43.448617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448606 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="config-reloader" Jun 09 01:20:43.448617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448616 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="thanos-sidecar" Jun 09 01:20:43.449040 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448625 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="kube-rbac-proxy" Jun 09 01:20:43.449040 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448634 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="kube-rbac-proxy-thanos" Jun 09 01:20:43.449040 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448644 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="kube-rbac-proxy-web" Jun 09 01:20:43.449040 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448652 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" containerName="prometheus" Jun 09 01:20:43.449040 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448780 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5"} err="failed to get container status \"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5\": rpc error: code = NotFound desc = could not find container \"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5\": container with ID starting with 160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5 not found: ID does not exist" Jun 09 01:20:43.449040 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.448795 2567 scope.go:117] "RemoveContainer" containerID="acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e" Jun 09 01:20:43.449040 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.449020 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e"} err="failed to get container status \"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e\": rpc error: code = NotFound desc = could not find container \"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e\": container with ID starting with acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e not found: ID does not exist" Jun 09 01:20:43.449040 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.449035 2567 scope.go:117] "RemoveContainer" containerID="5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7" Jun 09 01:20:43.449460 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.449282 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7"} err="failed to get container status \"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7\": rpc error: code = NotFound desc = could not find container \"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7\": container with ID starting with 5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7 not found: ID does not exist" Jun 09 01:20:43.449460 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.449303 2567 scope.go:117] "RemoveContainer" containerID="6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d" Jun 09 01:20:43.449553 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.449537 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d"} err="failed to get container status \"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d\": rpc error: code = NotFound desc = could not find container \"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d\": container with ID starting with 6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d not found: ID does not exist" Jun 09 01:20:43.449595 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.449553 2567 scope.go:117] "RemoveContainer" containerID="af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6" Jun 09 01:20:43.449766 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.449752 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6"} err="failed to get container status \"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6\": rpc error: code = NotFound desc = could not find container \"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6\": container with ID starting with af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6 not found: ID does not exist" Jun 09 01:20:43.449806 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.449766 2567 scope.go:117] "RemoveContainer" containerID="f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6" Jun 09 01:20:43.449972 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.449956 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6"} err="failed to get container status \"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6\": rpc error: code = NotFound desc = could not find container \"f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6\": container with ID starting with f9885314303eaebaa6ae70257be53314b4f8ebdc47b45ab5f03bf5bad5496df6 not found: ID does not exist" Jun 09 01:20:43.450013 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.449981 2567 scope.go:117] "RemoveContainer" containerID="7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578" Jun 09 01:20:43.450193 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.450178 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578"} err="failed to get container status \"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578\": rpc error: code = NotFound desc = could not find container \"7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578\": container with ID starting with 7341a3bee14572e9821c3e76ac7e6ee1bf381bd0e7876f04d88661ffb2d93578 not found: ID does not exist" Jun 09 01:20:43.450193 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.450193 2567 scope.go:117] "RemoveContainer" containerID="160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5" Jun 09 01:20:43.450470 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.450450 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5"} err="failed to get container status \"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5\": rpc error: code = NotFound desc = could not find container \"160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5\": container with ID starting with 160b40daf8c7788dc8fc61901e8a62672d318895d699c2041a3704086cc098a5 not found: ID does not exist" Jun 09 01:20:43.450549 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.450471 2567 scope.go:117] "RemoveContainer" containerID="acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e" Jun 09 01:20:43.450729 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.450710 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e"} err="failed to get container status \"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e\": rpc error: code = NotFound desc = could not find container \"acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e\": container with ID starting with acd569e30df572883b4c4234b3f5a4dbb3d7b9aa4e6cbb2e5616a75aec0dc25e not found: ID does not exist" Jun 09 01:20:43.450778 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.450731 2567 scope.go:117] "RemoveContainer" containerID="5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7" Jun 09 01:20:43.450957 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.450938 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7"} err="failed to get container status \"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7\": rpc error: code = NotFound desc = could not find container \"5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7\": container with ID starting with 5cb5599a9ae103704133cae3c1513de52f2de654a6d0fe96296a4999d4e100e7 not found: ID does not exist" Jun 09 01:20:43.450957 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.450956 2567 scope.go:117] "RemoveContainer" containerID="6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d" Jun 09 01:20:43.451195 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.451178 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d"} err="failed to get container status \"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d\": rpc error: code = NotFound desc = could not find container \"6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d\": container with ID starting with 6f9a69e962da836226c97c356b2228089f25b3976d1495e1755e9a5c55f7727d not found: ID does not exist" Jun 09 01:20:43.451303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.451198 2567 scope.go:117] "RemoveContainer" containerID="af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6" Jun 09 01:20:43.451457 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.451438 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6"} err="failed to get container status \"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6\": rpc error: code = NotFound desc = could not find container \"af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6\": container with ID starting with af67f43e6f3a9ddebca04bb33397b4bc0a5c5ce2e6a94f55fe43c38a1aa31ca6 not found: ID does not exist" Jun 09 01:20:43.452370 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.452356 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.454996 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.454970 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 01:20:43.455145 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.455007 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 01:20:43.455145 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.454976 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 01:20:43.455414 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.455346 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sfc4d\"" Jun 09 01:20:43.455498 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.455415 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 01:20:43.455605 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.455562 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 01:20:43.455706 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.455689 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 01:20:43.455752 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.455566 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 01:20:43.455851 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.455831 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bi0rf21h3t8h6\"" Jun 09 01:20:43.455998 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.455984 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 01:20:43.456060 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.456046 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 01:20:43.456196 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.456180 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 01:20:43.456304 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.456234 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 01:20:43.456403 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.456382 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 01:20:43.459195 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.459154 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 01:20:43.466896 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.466692 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 01:20:43.474046 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.474026 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 01:20:43.507552 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507528 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.507663 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507560 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.507663 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507577 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.507663 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507591 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.507663 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507612 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.507860 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507715 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3796e0c-9b63-4555-bf0e-ac6064b8c425-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.507860 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.507860 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507786 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.507860 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507813 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.507986 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.507986 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507907 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-config\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.507986 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507922 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3796e0c-9b63-4555-bf0e-ac6064b8c425-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.507986 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507947 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.507986 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507964 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.507986 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.507983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.508185 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.508001 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v54l6\" (UniqueName: \"kubernetes.io/projected/f3796e0c-9b63-4555-bf0e-ac6064b8c425-kube-api-access-v54l6\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.508185 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.508018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.508185 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.508031 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.508185 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.508066 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.508185 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.508086 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.538659 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.538632 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:43.609029 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.608965 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609029 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.608996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609029 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609015 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609287 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609033 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609287 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609164 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609287 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609212 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3796e0c-9b63-4555-bf0e-ac6064b8c425-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609287 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609270 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609491 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609310 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609491 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609338 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609491 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609491 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609421 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-config\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609491 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609446 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3796e0c-9b63-4555-bf0e-ac6064b8c425-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609732 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609492 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609732 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609520 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609732 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609547 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609732 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609581 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v54l6\" (UniqueName: \"kubernetes.io/projected/f3796e0c-9b63-4555-bf0e-ac6064b8c425-kube-api-access-v54l6\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609732 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609616 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609732 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609641 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609732 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609688 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.609732 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609716 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.610110 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.609731 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.610725 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.610345 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.610725 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.610468 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.612337 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.612308 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.612452 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.612375 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.612928 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.612903 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.613154 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.613128 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.613245 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.613224 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3796e0c-9b63-4555-bf0e-ac6064b8c425-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.613342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.613324 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.613756 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.613664 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3796e0c-9b63-4555-bf0e-ac6064b8c425-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.614304 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.614281 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.614399 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.614367 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.614575 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.614553 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.614855 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.614834 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.615030 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.615006 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.615113 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.615050 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.615157 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.615113 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.615467 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.615450 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3796e0c-9b63-4555-bf0e-ac6064b8c425-config\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.615672 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.615651 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3796e0c-9b63-4555-bf0e-ac6064b8c425-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.624418 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.624397 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v54l6\" (UniqueName: \"kubernetes.io/projected/f3796e0c-9b63-4555-bf0e-ac6064b8c425-kube-api-access-v54l6\") pod \"prometheus-k8s-0\" (UID: \"f3796e0c-9b63-4555-bf0e-ac6064b8c425\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.652825 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.652795 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:43.751783 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.751756 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:43.780338 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.780310 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:43.925206 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:43.925179 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 01:20:43.927112 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:20:43.927087 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3796e0c_9b63_4555_bf0e_ac6064b8c425.slice/crio-b7173ecdad8a51b2d04e4067f08ee4396350fb1bfb0b6d68588fa3aa7634237f WatchSource:0}: Error finding container b7173ecdad8a51b2d04e4067f08ee4396350fb1bfb0b6d68588fa3aa7634237f: Status 404 returned error can't find the container with id b7173ecdad8a51b2d04e4067f08ee4396350fb1bfb0b6d68588fa3aa7634237f Jun 09 01:20:44.398216 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:44.398181 2567 generic.go:356] "Generic (PLEG): container finished" podID="f3796e0c-9b63-4555-bf0e-ac6064b8c425" containerID="5a9d6af5a59ac2ffe6a248d45320bac95ec11b723f1ba08de25309846fc5266c" exitCode=0 Jun 09 01:20:44.398423 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:44.398265 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3796e0c-9b63-4555-bf0e-ac6064b8c425","Type":"ContainerDied","Data":"5a9d6af5a59ac2ffe6a248d45320bac95ec11b723f1ba08de25309846fc5266c"} Jun 09 01:20:44.398423 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:44.398321 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3796e0c-9b63-4555-bf0e-ac6064b8c425","Type":"ContainerStarted","Data":"b7173ecdad8a51b2d04e4067f08ee4396350fb1bfb0b6d68588fa3aa7634237f"} Jun 09 01:20:44.572290 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:44.572243 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d68fdfffc-zgxw4"] Jun 09 01:20:44.644102 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:44.644067 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:44.754047 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:44.753974 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:44.847509 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:44.847483 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:44.944431 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:44.944366 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:45.343213 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:45.343178 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e969780-301c-4d8b-8d33-f3f4e9073309" path="/var/lib/kubelet/pods/0e969780-301c-4d8b-8d33-f3f4e9073309/volumes" Jun 09 01:20:45.405417 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:45.405381 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3796e0c-9b63-4555-bf0e-ac6064b8c425","Type":"ContainerStarted","Data":"685c7f1001d3e6084ad81805859e44c36fabd8bc701592ee9fd724a1fc483ed3"} Jun 09 01:20:45.405548 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:45.405465 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3796e0c-9b63-4555-bf0e-ac6064b8c425","Type":"ContainerStarted","Data":"612a8e5f525a519ce83be8ca19aa7e3b7e0df59a8a85ded8be75a73e5815cc84"} Jun 09 01:20:45.405548 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:45.405510 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3796e0c-9b63-4555-bf0e-ac6064b8c425","Type":"ContainerStarted","Data":"f383c1dcd2931db1cd5cfe6de8a0130bfe03da74ac77f132b12983af7bcd87c1"} Jun 09 01:20:45.405609 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:45.405548 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3796e0c-9b63-4555-bf0e-ac6064b8c425","Type":"ContainerStarted","Data":"73283ffdca90d5ea660424665eb1fa7e3646b823674738881d5f5ae55b976a32"} Jun 09 01:20:45.405609 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:45.405583 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3796e0c-9b63-4555-bf0e-ac6064b8c425","Type":"ContainerStarted","Data":"8bd3acf2c1a35086a7d46b5bca42849fc3da189cb4fa885f19a22e6b5e645fd0"} Jun 09 01:20:45.405679 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:45.405620 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3796e0c-9b63-4555-bf0e-ac6064b8c425","Type":"ContainerStarted","Data":"e27a02693047adf32700ccd011894a2dd2fb215d424fd08a0b9513a450cb8815"} Jun 09 01:20:45.433420 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:45.433370 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.415855145 podStartE2EDuration="2.433350741s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.495596ms" isStatefulPod=false podCreationTimestamp="2026-06-09 01:20:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:20:45.431523516 +0000 UTC m=+308.543523368" watchObservedRunningTime="2026-06-09 01:20:45.433350741 +0000 UTC m=+308.545350594" Jun 09 01:20:45.741892 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:45.741821 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:45.793747 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:45.793718 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:46.755570 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:46.755534 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:46.857498 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:46.857464 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:48.781341 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:48.781310 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:20:48.831893 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:48.831856 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:48.883240 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:48.883210 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:48.962126 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:48.962097 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:52.438215 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:52.438184 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:52.486788 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:52.486755 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:53.253475 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:53.253440 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:20:53.303086 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:20:53.303040 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:21:03.134235 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:03.134191 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:21:08.269912 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:08.269877 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:21:08.372736 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:08.372705 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:21:09.607996 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:09.607937 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" podUID="2e542323-8d7c-411f-b67f-d3ba3dfcdad8" containerName="registry" containerID="cri-o://7ddec368c0dd47f8f5f71a3cfcd15b4bdd90d9da96d0cdce19e634a03c91ac4d" gracePeriod=30 Jun 09 01:21:09.848956 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:09.848934 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:21:10.030805 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.030739 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-trusted-ca\") pod \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " Jun 09 01:21:10.030805 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.030779 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-bound-sa-token\") pod \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " Jun 09 01:21:10.030805 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.030806 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls\") pod \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " Jun 09 01:21:10.031059 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.030922 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-ca-trust-extracted\") pod \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " Jun 09 01:21:10.031059 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.030957 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-certificates\") pod \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " Jun 09 01:21:10.031059 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.030986 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhsnz\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-kube-api-access-rhsnz\") pod \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " Jun 09 01:21:10.031059 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.031039 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-installation-pull-secrets\") pod \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " Jun 09 01:21:10.031300 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.031078 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-image-registry-private-configuration\") pod \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\" (UID: \"2e542323-8d7c-411f-b67f-d3ba3dfcdad8\") " Jun 09 01:21:10.031300 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.031146 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2e542323-8d7c-411f-b67f-d3ba3dfcdad8" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 01:21:10.031418 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.031360 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-trusted-ca\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:21:10.031418 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.031397 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2e542323-8d7c-411f-b67f-d3ba3dfcdad8" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 01:21:10.033584 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.033554 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2e542323-8d7c-411f-b67f-d3ba3dfcdad8" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 01:21:10.033584 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.033559 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-kube-api-access-rhsnz" (OuterVolumeSpecName: "kube-api-access-rhsnz") pod "2e542323-8d7c-411f-b67f-d3ba3dfcdad8" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8"). InnerVolumeSpecName "kube-api-access-rhsnz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:21:10.033814 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.033612 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2e542323-8d7c-411f-b67f-d3ba3dfcdad8" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:21:10.033814 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.033724 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2e542323-8d7c-411f-b67f-d3ba3dfcdad8" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:21:10.033814 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.033760 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2e542323-8d7c-411f-b67f-d3ba3dfcdad8" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 01:21:10.040138 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.040109 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2e542323-8d7c-411f-b67f-d3ba3dfcdad8" (UID: "2e542323-8d7c-411f-b67f-d3ba3dfcdad8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:21:10.132110 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.132084 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-bound-sa-token\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:21:10.132110 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.132107 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-tls\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:21:10.132283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.132119 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-ca-trust-extracted\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:21:10.132283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.132133 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-registry-certificates\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:21:10.132283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.132146 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhsnz\" (UniqueName: \"kubernetes.io/projected/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-kube-api-access-rhsnz\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:21:10.132283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.132158 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-installation-pull-secrets\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:21:10.132283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.132171 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e542323-8d7c-411f-b67f-d3ba3dfcdad8-image-registry-private-configuration\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:21:10.503982 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.503948 2567 generic.go:356] "Generic (PLEG): container finished" podID="2e542323-8d7c-411f-b67f-d3ba3dfcdad8" containerID="7ddec368c0dd47f8f5f71a3cfcd15b4bdd90d9da96d0cdce19e634a03c91ac4d" exitCode=0 Jun 09 01:21:10.504169 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.503988 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" Jun 09 01:21:10.504169 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.504005 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" event={"ID":"2e542323-8d7c-411f-b67f-d3ba3dfcdad8","Type":"ContainerDied","Data":"7ddec368c0dd47f8f5f71a3cfcd15b4bdd90d9da96d0cdce19e634a03c91ac4d"} Jun 09 01:21:10.504169 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.504054 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d68fdfffc-zgxw4" event={"ID":"2e542323-8d7c-411f-b67f-d3ba3dfcdad8","Type":"ContainerDied","Data":"fef9e06b27b3e0e9c6ea6fba924c6def9ed475d258c8ad83e7f22fa96ad6553d"} Jun 09 01:21:10.504169 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.504081 2567 scope.go:117] "RemoveContainer" containerID="7ddec368c0dd47f8f5f71a3cfcd15b4bdd90d9da96d0cdce19e634a03c91ac4d" Jun 09 01:21:10.514500 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.514473 2567 scope.go:117] "RemoveContainer" containerID="7ddec368c0dd47f8f5f71a3cfcd15b4bdd90d9da96d0cdce19e634a03c91ac4d" Jun 09 01:21:10.515177 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:21:10.515145 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ddec368c0dd47f8f5f71a3cfcd15b4bdd90d9da96d0cdce19e634a03c91ac4d\": container with ID starting with 7ddec368c0dd47f8f5f71a3cfcd15b4bdd90d9da96d0cdce19e634a03c91ac4d not found: ID does not exist" containerID="7ddec368c0dd47f8f5f71a3cfcd15b4bdd90d9da96d0cdce19e634a03c91ac4d" Jun 09 01:21:10.515297 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.515182 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ddec368c0dd47f8f5f71a3cfcd15b4bdd90d9da96d0cdce19e634a03c91ac4d"} err="failed to get container status \"7ddec368c0dd47f8f5f71a3cfcd15b4bdd90d9da96d0cdce19e634a03c91ac4d\": rpc error: code = NotFound desc = could not find container \"7ddec368c0dd47f8f5f71a3cfcd15b4bdd90d9da96d0cdce19e634a03c91ac4d\": container with ID starting with 7ddec368c0dd47f8f5f71a3cfcd15b4bdd90d9da96d0cdce19e634a03c91ac4d not found: ID does not exist" Jun 09 01:21:10.529003 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.528979 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d68fdfffc-zgxw4"] Jun 09 01:21:10.531696 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:10.531676 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d68fdfffc-zgxw4"] Jun 09 01:21:11.342863 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:11.342829 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e542323-8d7c-411f-b67f-d3ba3dfcdad8" path="/var/lib/kubelet/pods/2e542323-8d7c-411f-b67f-d3ba3dfcdad8/volumes" Jun 09 01:21:32.256402 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:32.256327 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:21:32.348943 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:32.348914 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:21:41.765451 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:41.765426 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:21:43.780850 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:43.780818 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:21:43.795552 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:43.795528 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:21:44.654467 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:21:44.654441 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 01:22:12.630697 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:12.630664 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:14.792958 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:14.792918 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:16.628347 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:16.628303 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:16.678203 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:16.678166 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:18.136956 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:18.136907 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:18.238092 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:18.238058 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:18.457930 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:18.457846 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:18.564540 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:18.564507 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:21.436022 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.435977 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:21.517430 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.517401 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-kqw5w"] Jun 09 01:22:21.517704 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.517693 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e542323-8d7c-411f-b67f-d3ba3dfcdad8" containerName="registry" Jun 09 01:22:21.517746 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.517706 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e542323-8d7c-411f-b67f-d3ba3dfcdad8" containerName="registry" Jun 09 01:22:21.517781 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.517776 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e542323-8d7c-411f-b67f-d3ba3dfcdad8" containerName="registry" Jun 09 01:22:21.519690 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.519675 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kqw5w" Jun 09 01:22:21.521979 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.521960 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 01:22:21.521979 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.521971 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 01:22:21.522831 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.522815 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-f5hkf\"" Jun 09 01:22:21.528292 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.528271 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-kqw5w"] Jun 09 01:22:21.582585 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.582564 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74d02af5-f3cc-470b-b3c7-486cc27e87a1-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-kqw5w\" (UID: \"74d02af5-f3cc-470b-b3c7-486cc27e87a1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kqw5w" Jun 09 01:22:21.582693 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.582592 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlmjn\" (UniqueName: \"kubernetes.io/projected/74d02af5-f3cc-470b-b3c7-486cc27e87a1-kube-api-access-nlmjn\") pod \"cert-manager-cainjector-5d99449ffd-kqw5w\" (UID: \"74d02af5-f3cc-470b-b3c7-486cc27e87a1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kqw5w" Jun 09 01:22:21.683883 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.683854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74d02af5-f3cc-470b-b3c7-486cc27e87a1-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-kqw5w\" (UID: \"74d02af5-f3cc-470b-b3c7-486cc27e87a1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kqw5w" Jun 09 01:22:21.683987 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.683883 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlmjn\" (UniqueName: \"kubernetes.io/projected/74d02af5-f3cc-470b-b3c7-486cc27e87a1-kube-api-access-nlmjn\") pod \"cert-manager-cainjector-5d99449ffd-kqw5w\" (UID: \"74d02af5-f3cc-470b-b3c7-486cc27e87a1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kqw5w" Jun 09 01:22:21.693213 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.693161 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlmjn\" (UniqueName: \"kubernetes.io/projected/74d02af5-f3cc-470b-b3c7-486cc27e87a1-kube-api-access-nlmjn\") pod \"cert-manager-cainjector-5d99449ffd-kqw5w\" (UID: \"74d02af5-f3cc-470b-b3c7-486cc27e87a1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kqw5w" Jun 09 01:22:21.693213 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.693172 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74d02af5-f3cc-470b-b3c7-486cc27e87a1-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-kqw5w\" (UID: \"74d02af5-f3cc-470b-b3c7-486cc27e87a1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kqw5w" Jun 09 01:22:21.836769 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.836738 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kqw5w" Jun 09 01:22:21.958112 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.957920 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-kqw5w"] Jun 09 01:22:21.961738 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:22:21.961711 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74d02af5_f3cc_470b_b3c7_486cc27e87a1.slice/crio-8c2c10f5c603cc96fe9e032ebfaa7db51984473ec4dc007d29fb3d6186953bda WatchSource:0}: Error finding container 8c2c10f5c603cc96fe9e032ebfaa7db51984473ec4dc007d29fb3d6186953bda: Status 404 returned error can't find the container with id 8c2c10f5c603cc96fe9e032ebfaa7db51984473ec4dc007d29fb3d6186953bda Jun 09 01:22:21.964021 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:21.964003 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 01:22:22.028924 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:22.028856 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:22.781232 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:22.781195 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kqw5w" event={"ID":"74d02af5-f3cc-470b-b3c7-486cc27e87a1","Type":"ContainerStarted","Data":"8c2c10f5c603cc96fe9e032ebfaa7db51984473ec4dc007d29fb3d6186953bda"} Jun 09 01:22:23.425438 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:23.425400 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:23.475720 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:23.475679 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:25.794888 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:25.794851 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kqw5w" event={"ID":"74d02af5-f3cc-470b-b3c7-486cc27e87a1","Type":"ContainerStarted","Data":"7ef722f90185b00cebd9b2fe46801d25406ba4ecb48f5af14bc6f0a608b3e3b7"} Jun 09 01:22:25.811655 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:25.811608 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kqw5w" podStartSLOduration=1.9428355800000001 podStartE2EDuration="4.811593378s" totalImagesPullingTime="2.868757798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:22:25.810638101 +0000 UTC m=+408.922637952" watchObservedRunningTime="2026-06-09 01:22:25.811593378 +0000 UTC m=+408.923593228" Jun 09 01:22:28.099224 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:28.099186 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:28.200530 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:28.200499 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:30.038424 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:30.038393 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:35.032195 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:35.032162 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:35.132596 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:35.132562 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:41.609594 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:41.609562 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:42.945647 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:42.945617 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:43.048305 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:43.048274 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:45.147914 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:45.147885 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:56.454408 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:56.454330 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:56.562047 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:56.562013 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:57.076775 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.076736 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:57.237939 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.237906 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:57.356973 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.356898 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:57.417346 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.417320 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp"] Jun 09 01:22:57.419551 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.419520 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.422984 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.422953 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 01:22:57.423885 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.423866 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 01:22:57.424001 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.423945 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 01:22:57.424399 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.424382 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sf295\"" Jun 09 01:22:57.424504 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.424384 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 01:22:57.437512 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.437488 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp"] Jun 09 01:22:57.543139 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.543102 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:57.588419 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.588378 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.588581 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.588426 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljf7f\" (UniqueName: \"kubernetes.io/projected/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-kube-api-access-ljf7f\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.588581 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.588453 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-tmp\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.588581 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.588521 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.588581 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.588548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-manifests\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.644511 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.644425 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:57.689720 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.689687 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljf7f\" (UniqueName: \"kubernetes.io/projected/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-kube-api-access-ljf7f\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.689868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.689728 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-tmp\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.689868 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.689854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.689973 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.689902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-manifests\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.690042 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.690017 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.690309 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.690285 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-manifests\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.691907 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.691888 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-tmp\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.692301 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.692284 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.692367 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.692287 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.707114 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.702183 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljf7f\" (UniqueName: \"kubernetes.io/projected/4ac092af-bc80-4ed7-8311-9c65e03cc6e4-kube-api-access-ljf7f\") pod \"opendatahub-operator-controller-manager-7c5668658c-zmgwp\" (UID: \"4ac092af-bc80-4ed7-8311-9c65e03cc6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.730682 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.730653 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:22:57.744685 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.744659 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:57.846411 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.846368 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:22:57.859433 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.859399 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp"] Jun 09 01:22:57.862572 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:22:57.862548 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac092af_bc80_4ed7_8311_9c65e03cc6e4.slice/crio-d0827b343d2c29098352640c199b77d2924794b7b23e8aaa1c9a6d9644343c33 WatchSource:0}: Error finding container d0827b343d2c29098352640c199b77d2924794b7b23e8aaa1c9a6d9644343c33: Status 404 returned error can't find the container with id d0827b343d2c29098352640c199b77d2924794b7b23e8aaa1c9a6d9644343c33 Jun 09 01:22:57.915159 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.915071 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" event={"ID":"4ac092af-bc80-4ed7-8311-9c65e03cc6e4","Type":"ContainerStarted","Data":"d0827b343d2c29098352640c199b77d2924794b7b23e8aaa1c9a6d9644343c33"} Jun 09 01:22:57.945222 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:22:57.945187 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:00.932897 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:00.932861 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" event={"ID":"4ac092af-bc80-4ed7-8311-9c65e03cc6e4","Type":"ContainerStarted","Data":"f9e05641a882ead766312a72190ec803927515d2d8abeae66cf95789f785d464"} Jun 09 01:23:01.938903 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:01.938870 2567 generic.go:356] "Generic (PLEG): container finished" podID="4ac092af-bc80-4ed7-8311-9c65e03cc6e4" containerID="f9e05641a882ead766312a72190ec803927515d2d8abeae66cf95789f785d464" exitCode=0 Jun 09 01:23:01.939290 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:01.938926 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" event={"ID":"4ac092af-bc80-4ed7-8311-9c65e03cc6e4","Type":"ContainerDied","Data":"f9e05641a882ead766312a72190ec803927515d2d8abeae66cf95789f785d464"} Jun 09 01:23:02.946526 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:02.946477 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" event={"ID":"4ac092af-bc80-4ed7-8311-9c65e03cc6e4","Type":"ContainerStarted","Data":"b3222ee33f23d00a01e44406094526a8820ba51e78cbd3cecd6b8da674182a66"} Jun 09 01:23:02.946929 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:02.946632 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:23:02.969742 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:02.969685 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" podStartSLOduration=1.857955174 podStartE2EDuration="5.969667648s" totalImagesPullingTime="3.203951769s" totalInitContainerRuntime="907.760705ms" isStatefulPod=false podCreationTimestamp="2026-06-09 01:22:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:23:02.968246343 +0000 UTC m=+446.080246195" watchObservedRunningTime="2026-06-09 01:23:02.969667648 +0000 UTC m=+446.081667497" Jun 09 01:23:13.116780 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:13.116737 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:13.224312 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:13.224271 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:13.954167 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:13.954135 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c5668658c-zmgwp" Jun 09 01:23:15.166163 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.166129 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq"] Jun 09 01:23:15.178111 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.178080 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:15.178701 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.178663 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq"] Jun 09 01:23:15.181845 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.181827 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 01:23:15.181987 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.181879 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 01:23:15.181987 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.181888 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 01:23:15.182187 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.182171 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 01:23:15.182242 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.182228 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 01:23:15.182325 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.182244 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bn7nq\"" Jun 09 01:23:15.230637 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.230608 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/11eb56b4-8c0f-4798-9def-942124eb1e0b-metrics-cert\") pod \"lws-controller-manager-586b6bddf9-sqzwq\" (UID: \"11eb56b4-8c0f-4798-9def-942124eb1e0b\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:15.230766 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.230655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11eb56b4-8c0f-4798-9def-942124eb1e0b-cert\") pod \"lws-controller-manager-586b6bddf9-sqzwq\" (UID: \"11eb56b4-8c0f-4798-9def-942124eb1e0b\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:15.230766 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.230721 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqw4s\" (UniqueName: \"kubernetes.io/projected/11eb56b4-8c0f-4798-9def-942124eb1e0b-kube-api-access-jqw4s\") pod \"lws-controller-manager-586b6bddf9-sqzwq\" (UID: \"11eb56b4-8c0f-4798-9def-942124eb1e0b\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:15.230766 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.230748 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/11eb56b4-8c0f-4798-9def-942124eb1e0b-manager-config\") pod \"lws-controller-manager-586b6bddf9-sqzwq\" (UID: \"11eb56b4-8c0f-4798-9def-942124eb1e0b\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:15.332079 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.332048 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11eb56b4-8c0f-4798-9def-942124eb1e0b-cert\") pod \"lws-controller-manager-586b6bddf9-sqzwq\" (UID: \"11eb56b4-8c0f-4798-9def-942124eb1e0b\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:15.332297 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.332102 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqw4s\" (UniqueName: \"kubernetes.io/projected/11eb56b4-8c0f-4798-9def-942124eb1e0b-kube-api-access-jqw4s\") pod \"lws-controller-manager-586b6bddf9-sqzwq\" (UID: \"11eb56b4-8c0f-4798-9def-942124eb1e0b\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:15.332297 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.332121 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/11eb56b4-8c0f-4798-9def-942124eb1e0b-manager-config\") pod \"lws-controller-manager-586b6bddf9-sqzwq\" (UID: \"11eb56b4-8c0f-4798-9def-942124eb1e0b\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:15.332297 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.332166 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/11eb56b4-8c0f-4798-9def-942124eb1e0b-metrics-cert\") pod \"lws-controller-manager-586b6bddf9-sqzwq\" (UID: \"11eb56b4-8c0f-4798-9def-942124eb1e0b\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:15.332859 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.332837 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/11eb56b4-8c0f-4798-9def-942124eb1e0b-manager-config\") pod \"lws-controller-manager-586b6bddf9-sqzwq\" (UID: \"11eb56b4-8c0f-4798-9def-942124eb1e0b\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:15.334703 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.334676 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/11eb56b4-8c0f-4798-9def-942124eb1e0b-metrics-cert\") pod \"lws-controller-manager-586b6bddf9-sqzwq\" (UID: \"11eb56b4-8c0f-4798-9def-942124eb1e0b\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:15.334784 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.334676 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11eb56b4-8c0f-4798-9def-942124eb1e0b-cert\") pod \"lws-controller-manager-586b6bddf9-sqzwq\" (UID: \"11eb56b4-8c0f-4798-9def-942124eb1e0b\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:15.349516 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.349493 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqw4s\" (UniqueName: \"kubernetes.io/projected/11eb56b4-8c0f-4798-9def-942124eb1e0b-kube-api-access-jqw4s\") pod \"lws-controller-manager-586b6bddf9-sqzwq\" (UID: \"11eb56b4-8c0f-4798-9def-942124eb1e0b\") " pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:15.493770 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.493689 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:15.630522 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.630495 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq"] Jun 09 01:23:15.633637 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:23:15.633609 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11eb56b4_8c0f_4798_9def_942124eb1e0b.slice/crio-8a4a405ccad26fa7ef4b7eb774a2f56777882d813628fdc1a7ff884d4349cbda WatchSource:0}: Error finding container 8a4a405ccad26fa7ef4b7eb774a2f56777882d813628fdc1a7ff884d4349cbda: Status 404 returned error can't find the container with id 8a4a405ccad26fa7ef4b7eb774a2f56777882d813628fdc1a7ff884d4349cbda Jun 09 01:23:15.849267 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.849220 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:15.967128 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:15.967099 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:16.004111 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:16.004079 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" event={"ID":"11eb56b4-8c0f-4798-9def-942124eb1e0b","Type":"ContainerStarted","Data":"8a4a405ccad26fa7ef4b7eb774a2f56777882d813628fdc1a7ff884d4349cbda"} Jun 09 01:23:16.458588 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:16.458546 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:16.523525 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:16.523452 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:16.856661 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:16.856625 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:16.973435 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:16.973401 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:17.115528 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:17.115445 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:25.186355 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:25.186309 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:25.284098 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:25.284069 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:25.480237 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:25.480149 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:25.572693 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:25.572664 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:26.452200 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:26.452169 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:26.553073 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:26.553029 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:26.652062 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:26.652031 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:26.774958 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:26.774877 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:27.223170 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:27.223135 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:32.073760 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:32.073725 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" event={"ID":"11eb56b4-8c0f-4798-9def-942124eb1e0b","Type":"ContainerStarted","Data":"31c0ff17ea8b286806de87a65ef211f503b48a838f5ede20c85b3604ca87f337"} Jun 09 01:23:32.074227 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:32.073837 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:32.089325 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:32.089238 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" podStartSLOduration=1.606996349 podStartE2EDuration="17.089221416s" totalImagesPullingTime="15.482225067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:23:32.088603998 +0000 UTC m=+475.200603849" watchObservedRunningTime="2026-06-09 01:23:32.089221416 +0000 UTC m=+475.201221265" Jun 09 01:23:35.231921 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:35.231888 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:35.278547 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:35.278505 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:39.208678 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:39.208630 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:39.308089 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:39.308045 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:39.435958 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:39.435919 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:39.539686 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:39.539601 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:40.485435 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:40.485400 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:40.591551 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:40.591520 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:41.349519 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:41.349482 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:41.449648 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:41.449608 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:41.976994 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:41.976939 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:43.081572 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.081542 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-586b6bddf9-sqzwq" Jun 09 01:23:43.175932 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.175870 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-98cf8ddb4-5797p"] Jun 09 01:23:43.181269 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.181224 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-98cf8ddb4-5797p" Jun 09 01:23:43.183722 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.183697 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-c4zw6\"" Jun 09 01:23:43.183722 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.183713 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 01:23:43.186607 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.186582 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-98cf8ddb4-5797p"] Jun 09 01:23:43.216880 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.216844 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:43.279503 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.279453 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/17afa3bd-1c71-49b8-9553-f058894fc9e2-redirect-config\") pod \"dashboard-redirect-98cf8ddb4-5797p\" (UID: \"17afa3bd-1c71-49b8-9553-f058894fc9e2\") " pod="opendatahub/dashboard-redirect-98cf8ddb4-5797p" Jun 09 01:23:43.279702 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.279541 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5s5j\" (UniqueName: \"kubernetes.io/projected/17afa3bd-1c71-49b8-9553-f058894fc9e2-kube-api-access-p5s5j\") pod \"dashboard-redirect-98cf8ddb4-5797p\" (UID: \"17afa3bd-1c71-49b8-9553-f058894fc9e2\") " pod="opendatahub/dashboard-redirect-98cf8ddb4-5797p" Jun 09 01:23:43.380651 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.380569 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/17afa3bd-1c71-49b8-9553-f058894fc9e2-redirect-config\") pod \"dashboard-redirect-98cf8ddb4-5797p\" (UID: \"17afa3bd-1c71-49b8-9553-f058894fc9e2\") " pod="opendatahub/dashboard-redirect-98cf8ddb4-5797p" Jun 09 01:23:43.380651 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.380612 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5s5j\" (UniqueName: \"kubernetes.io/projected/17afa3bd-1c71-49b8-9553-f058894fc9e2-kube-api-access-p5s5j\") pod \"dashboard-redirect-98cf8ddb4-5797p\" (UID: \"17afa3bd-1c71-49b8-9553-f058894fc9e2\") " pod="opendatahub/dashboard-redirect-98cf8ddb4-5797p" Jun 09 01:23:43.381364 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.381344 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/17afa3bd-1c71-49b8-9553-f058894fc9e2-redirect-config\") pod \"dashboard-redirect-98cf8ddb4-5797p\" (UID: \"17afa3bd-1c71-49b8-9553-f058894fc9e2\") " pod="opendatahub/dashboard-redirect-98cf8ddb4-5797p" Jun 09 01:23:43.390680 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.390647 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5s5j\" (UniqueName: \"kubernetes.io/projected/17afa3bd-1c71-49b8-9553-f058894fc9e2-kube-api-access-p5s5j\") pod \"dashboard-redirect-98cf8ddb4-5797p\" (UID: \"17afa3bd-1c71-49b8-9553-f058894fc9e2\") " pod="opendatahub/dashboard-redirect-98cf8ddb4-5797p" Jun 09 01:23:43.494880 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.494844 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-98cf8ddb4-5797p" Jun 09 01:23:43.629228 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:43.629201 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-98cf8ddb4-5797p"] Jun 09 01:23:43.632116 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:23:43.632055 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17afa3bd_1c71_49b8_9553_f058894fc9e2.slice/crio-931a7c33ce5a635bb8a04fe48b58a5cdc0b6e5c9d8cc41c122f015c3a176b6e9 WatchSource:0}: Error finding container 931a7c33ce5a635bb8a04fe48b58a5cdc0b6e5c9d8cc41c122f015c3a176b6e9: Status 404 returned error can't find the container with id 931a7c33ce5a635bb8a04fe48b58a5cdc0b6e5c9d8cc41c122f015c3a176b6e9 Jun 09 01:23:44.139770 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:44.139732 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-98cf8ddb4-5797p" event={"ID":"17afa3bd-1c71-49b8-9553-f058894fc9e2","Type":"ContainerStarted","Data":"931a7c33ce5a635bb8a04fe48b58a5cdc0b6e5c9d8cc41c122f015c3a176b6e9"} Jun 09 01:23:47.157009 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:47.156974 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-98cf8ddb4-5797p" event={"ID":"17afa3bd-1c71-49b8-9553-f058894fc9e2","Type":"ContainerStarted","Data":"9459bd19d36965930ee28685cdce97bb894699b828d34805574ecc4970fccf25"} Jun 09 01:23:47.173839 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:47.173789 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-98cf8ddb4-5797p" podStartSLOduration=1.577523834 podStartE2EDuration="4.173773631s" totalImagesPullingTime="2.596249797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:23:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:23:47.172107388 +0000 UTC m=+490.284107239" watchObservedRunningTime="2026-06-09 01:23:47.173773631 +0000 UTC m=+490.285773482" Jun 09 01:23:52.220114 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:52.220075 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:52.321113 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:52.321080 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:57.021532 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:57.021500 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:57.119650 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:57.119581 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:23:57.547477 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:23:57.547440 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:03.903188 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:03.903149 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:03.998401 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:03.998372 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:04.150454 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.150421 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh"] Jun 09 01:24:04.159452 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.159386 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.161888 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.161850 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 01:24:04.162025 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.161968 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-tkc7x\"" Jun 09 01:24:04.164008 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.163978 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh"] Jun 09 01:24:04.184741 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.184719 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:04.248923 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.248887 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.249078 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.248929 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f986edbd-5967-4354-8898-33da15d1ba21-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.249078 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.248956 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6m8k\" (UniqueName: \"kubernetes.io/projected/f986edbd-5967-4354-8898-33da15d1ba21-kube-api-access-j6m8k\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.249078 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.248992 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.249078 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.249022 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.249078 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.249036 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f986edbd-5967-4354-8898-33da15d1ba21-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.249078 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.249055 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.249425 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.249110 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.249425 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.249128 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f986edbd-5967-4354-8898-33da15d1ba21-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.279431 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.279396 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:04.350081 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.350049 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.350288 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.350089 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f986edbd-5967-4354-8898-33da15d1ba21-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.350288 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.350114 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6m8k\" (UniqueName: \"kubernetes.io/projected/f986edbd-5967-4354-8898-33da15d1ba21-kube-api-access-j6m8k\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.350288 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.350145 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.350288 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.350178 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.350288 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.350193 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f986edbd-5967-4354-8898-33da15d1ba21-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.350288 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.350209 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.350288 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.350280 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.350816 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.350356 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f986edbd-5967-4354-8898-33da15d1ba21-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.350816 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.350549 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.350816 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.350637 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.350816 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.350741 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.350816 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.350803 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.351031 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.351010 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f986edbd-5967-4354-8898-33da15d1ba21-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.352491 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.352471 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f986edbd-5967-4354-8898-33da15d1ba21-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.352849 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.352828 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f986edbd-5967-4354-8898-33da15d1ba21-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.357195 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.357170 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f986edbd-5967-4354-8898-33da15d1ba21-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.357297 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.357263 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6m8k\" (UniqueName: \"kubernetes.io/projected/f986edbd-5967-4354-8898-33da15d1ba21-kube-api-access-j6m8k\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcppmwh\" (UID: \"f986edbd-5967-4354-8898-33da15d1ba21\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.380094 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.380063 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:04.470912 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.470822 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:04.601116 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.601089 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh"] Jun 09 01:24:04.603055 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:24:04.603030 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf986edbd_5967_4354_8898_33da15d1ba21.slice/crio-e7b7eca371fab45fee4d85140416a326c022b2208028358e2fe97d85212a47e8 WatchSource:0}: Error finding container e7b7eca371fab45fee4d85140416a326c022b2208028358e2fe97d85212a47e8: Status 404 returned error can't find the container with id e7b7eca371fab45fee4d85140416a326c022b2208028358e2fe97d85212a47e8 Jun 09 01:24:04.952524 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:04.952489 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:05.239369 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:05.239284 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" event={"ID":"f986edbd-5967-4354-8898-33da15d1ba21","Type":"ContainerStarted","Data":"e7b7eca371fab45fee4d85140416a326c022b2208028358e2fe97d85212a47e8"} Jun 09 01:24:09.968334 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:09.968278 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:10.069521 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:10.069488 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:14.215936 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:14.215897 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:24:14.216202 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:14.215965 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:24:14.216202 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:14.215992 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:24:14.279050 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:14.279013 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" event={"ID":"f986edbd-5967-4354-8898-33da15d1ba21","Type":"ContainerStarted","Data":"e5f2bb2533b81361abeb64e78712d448ff4e87d00b2b27287a00667328761781"} Jun 09 01:24:14.299530 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:14.299475 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" podStartSLOduration=0.688783378 podStartE2EDuration="10.29945896s" totalImagesPullingTime="9.610675582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:24:14.297986261 +0000 UTC m=+517.409986128" watchObservedRunningTime="2026-06-09 01:24:14.29945896 +0000 UTC m=+517.411458810" Jun 09 01:24:14.471434 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:14.471351 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:15.476126 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:15.476092 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:16.287869 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:16.287840 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:16.288828 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:16.288810 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcppmwh" Jun 09 01:24:17.418897 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:17.418859 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:17.519970 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:17.519932 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:17.544982 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:17.544944 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9cpxs"] Jun 09 01:24:17.548381 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:17.548355 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9cpxs" Jun 09 01:24:17.550631 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:17.550610 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 01:24:17.550770 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:17.550746 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 01:24:17.551666 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:17.551647 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mzp8l\"" Jun 09 01:24:17.555590 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:17.555567 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9cpxs"] Jun 09 01:24:17.581780 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:17.581741 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:17.671961 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:17.671868 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grt4j\" (UniqueName: \"kubernetes.io/projected/986e9559-5909-4e8c-a9f7-4e0a0969d6d0-kube-api-access-grt4j\") pod \"kuadrant-operator-catalog-9cpxs\" (UID: \"986e9559-5909-4e8c-a9f7-4e0a0969d6d0\") " pod="kuadrant-system/kuadrant-operator-catalog-9cpxs" Jun 09 01:24:17.772713 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:17.772675 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grt4j\" (UniqueName: \"kubernetes.io/projected/986e9559-5909-4e8c-a9f7-4e0a0969d6d0-kube-api-access-grt4j\") pod \"kuadrant-operator-catalog-9cpxs\" (UID: \"986e9559-5909-4e8c-a9f7-4e0a0969d6d0\") " pod="kuadrant-system/kuadrant-operator-catalog-9cpxs" Jun 09 01:24:17.780531 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:17.780496 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grt4j\" (UniqueName: \"kubernetes.io/projected/986e9559-5909-4e8c-a9f7-4e0a0969d6d0-kube-api-access-grt4j\") pod \"kuadrant-operator-catalog-9cpxs\" (UID: \"986e9559-5909-4e8c-a9f7-4e0a0969d6d0\") " pod="kuadrant-system/kuadrant-operator-catalog-9cpxs" Jun 09 01:24:17.861547 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:17.861512 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9cpxs" Jun 09 01:24:17.911500 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:17.911412 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9cpxs"] Jun 09 01:24:18.009037 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:18.009012 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9cpxs"] Jun 09 01:24:18.011212 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:24:18.011183 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986e9559_5909_4e8c_a9f7_4e0a0969d6d0.slice/crio-9ba16c69515beae00914afbbf6d818f66b07c75b04441b16c70497a7dd513fa2 WatchSource:0}: Error finding container 9ba16c69515beae00914afbbf6d818f66b07c75b04441b16c70497a7dd513fa2: Status 404 returned error can't find the container with id 9ba16c69515beae00914afbbf6d818f66b07c75b04441b16c70497a7dd513fa2 Jun 09 01:24:18.120028 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:18.119993 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mbd5p"] Jun 09 01:24:18.124794 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:18.124776 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mbd5p" Jun 09 01:24:18.130076 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:18.130050 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mbd5p"] Jun 09 01:24:18.178670 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:18.178644 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzkgz\" (UniqueName: \"kubernetes.io/projected/95c4d7bb-7427-4ce1-b61e-52e81bc8a664-kube-api-access-wzkgz\") pod \"kuadrant-operator-catalog-mbd5p\" (UID: \"95c4d7bb-7427-4ce1-b61e-52e81bc8a664\") " pod="kuadrant-system/kuadrant-operator-catalog-mbd5p" Jun 09 01:24:18.279870 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:18.279798 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzkgz\" (UniqueName: \"kubernetes.io/projected/95c4d7bb-7427-4ce1-b61e-52e81bc8a664-kube-api-access-wzkgz\") pod \"kuadrant-operator-catalog-mbd5p\" (UID: \"95c4d7bb-7427-4ce1-b61e-52e81bc8a664\") " pod="kuadrant-system/kuadrant-operator-catalog-mbd5p" Jun 09 01:24:18.288096 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:18.288071 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzkgz\" (UniqueName: \"kubernetes.io/projected/95c4d7bb-7427-4ce1-b61e-52e81bc8a664-kube-api-access-wzkgz\") pod \"kuadrant-operator-catalog-mbd5p\" (UID: \"95c4d7bb-7427-4ce1-b61e-52e81bc8a664\") " pod="kuadrant-system/kuadrant-operator-catalog-mbd5p" Jun 09 01:24:18.298290 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:18.298241 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9cpxs" event={"ID":"986e9559-5909-4e8c-a9f7-4e0a0969d6d0","Type":"ContainerStarted","Data":"9ba16c69515beae00914afbbf6d818f66b07c75b04441b16c70497a7dd513fa2"} Jun 09 01:24:18.341176 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:18.341142 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:18.435978 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:18.435943 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mbd5p" Jun 09 01:24:18.540157 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:18.540085 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:18.575231 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:18.575206 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mbd5p"] Jun 09 01:24:18.577042 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:24:18.577007 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c4d7bb_7427_4ce1_b61e_52e81bc8a664.slice/crio-cf7644a83e4be336d393013ab1469b9aa11301fdfa62e5b376723f7833da58fc WatchSource:0}: Error finding container cf7644a83e4be336d393013ab1469b9aa11301fdfa62e5b376723f7833da58fc: Status 404 returned error can't find the container with id cf7644a83e4be336d393013ab1469b9aa11301fdfa62e5b376723f7833da58fc Jun 09 01:24:19.304348 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:19.304310 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mbd5p" event={"ID":"95c4d7bb-7427-4ce1-b61e-52e81bc8a664","Type":"ContainerStarted","Data":"cf7644a83e4be336d393013ab1469b9aa11301fdfa62e5b376723f7833da58fc"} Jun 09 01:24:21.316150 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:21.316103 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9cpxs" event={"ID":"986e9559-5909-4e8c-a9f7-4e0a0969d6d0","Type":"ContainerStarted","Data":"b399dc667d606e3614b60e7661ec175c12b81875ca65babe323a4db41db493e5"} Jun 09 01:24:21.316657 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:21.316147 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9cpxs" podUID="986e9559-5909-4e8c-a9f7-4e0a0969d6d0" containerName="registry-server" containerID="cri-o://b399dc667d606e3614b60e7661ec175c12b81875ca65babe323a4db41db493e5" gracePeriod=2 Jun 09 01:24:21.317755 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:21.317731 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mbd5p" event={"ID":"95c4d7bb-7427-4ce1-b61e-52e81bc8a664","Type":"ContainerStarted","Data":"a18181533afc2e90e8260627713c02212b73252429de3266f1827d73f7cda8ec"} Jun 09 01:24:21.331452 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:21.331400 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9cpxs" podStartSLOduration=1.7199199269999998 podStartE2EDuration="4.331382427s" totalImagesPullingTime="2.6114625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:24:21.330083487 +0000 UTC m=+524.442083338" watchObservedRunningTime="2026-06-09 01:24:21.331382427 +0000 UTC m=+524.443382278" Jun 09 01:24:21.344641 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:21.344594 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mbd5p" podStartSLOduration=1.3022282490000001 podStartE2EDuration="3.344576754s" totalImagesPullingTime="2.042348505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:24:21.343143218 +0000 UTC m=+524.455143070" watchObservedRunningTime="2026-06-09 01:24:21.344576754 +0000 UTC m=+524.456576648" Jun 09 01:24:21.561135 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:21.561110 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9cpxs" Jun 09 01:24:21.708729 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:21.708648 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grt4j\" (UniqueName: \"kubernetes.io/projected/986e9559-5909-4e8c-a9f7-4e0a0969d6d0-kube-api-access-grt4j\") pod \"986e9559-5909-4e8c-a9f7-4e0a0969d6d0\" (UID: \"986e9559-5909-4e8c-a9f7-4e0a0969d6d0\") " Jun 09 01:24:21.710822 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:21.710798 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/986e9559-5909-4e8c-a9f7-4e0a0969d6d0-kube-api-access-grt4j" (OuterVolumeSpecName: "kube-api-access-grt4j") pod "986e9559-5909-4e8c-a9f7-4e0a0969d6d0" (UID: "986e9559-5909-4e8c-a9f7-4e0a0969d6d0"). InnerVolumeSpecName "kube-api-access-grt4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:24:21.809656 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:21.809612 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grt4j\" (UniqueName: \"kubernetes.io/projected/986e9559-5909-4e8c-a9f7-4e0a0969d6d0-kube-api-access-grt4j\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:24:22.324354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:22.324315 2567 generic.go:356] "Generic (PLEG): container finished" podID="986e9559-5909-4e8c-a9f7-4e0a0969d6d0" containerID="b399dc667d606e3614b60e7661ec175c12b81875ca65babe323a4db41db493e5" exitCode=0 Jun 09 01:24:22.324765 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:22.324366 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9cpxs" event={"ID":"986e9559-5909-4e8c-a9f7-4e0a0969d6d0","Type":"ContainerDied","Data":"b399dc667d606e3614b60e7661ec175c12b81875ca65babe323a4db41db493e5"} Jun 09 01:24:22.324765 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:22.324381 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9cpxs" Jun 09 01:24:22.324765 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:22.324454 2567 scope.go:117] "RemoveContainer" containerID="b399dc667d606e3614b60e7661ec175c12b81875ca65babe323a4db41db493e5" Jun 09 01:24:22.324765 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:22.324442 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9cpxs" event={"ID":"986e9559-5909-4e8c-a9f7-4e0a0969d6d0","Type":"ContainerDied","Data":"9ba16c69515beae00914afbbf6d818f66b07c75b04441b16c70497a7dd513fa2"} Jun 09 01:24:22.334027 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:22.334008 2567 scope.go:117] "RemoveContainer" containerID="b399dc667d606e3614b60e7661ec175c12b81875ca65babe323a4db41db493e5" Jun 09 01:24:22.334327 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:24:22.334310 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b399dc667d606e3614b60e7661ec175c12b81875ca65babe323a4db41db493e5\": container with ID starting with b399dc667d606e3614b60e7661ec175c12b81875ca65babe323a4db41db493e5 not found: ID does not exist" containerID="b399dc667d606e3614b60e7661ec175c12b81875ca65babe323a4db41db493e5" Jun 09 01:24:22.334371 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:22.334336 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b399dc667d606e3614b60e7661ec175c12b81875ca65babe323a4db41db493e5"} err="failed to get container status \"b399dc667d606e3614b60e7661ec175c12b81875ca65babe323a4db41db493e5\": rpc error: code = NotFound desc = could not find container \"b399dc667d606e3614b60e7661ec175c12b81875ca65babe323a4db41db493e5\": container with ID starting with b399dc667d606e3614b60e7661ec175c12b81875ca65babe323a4db41db493e5 not found: ID does not exist" Jun 09 01:24:22.344421 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:22.344393 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9cpxs"] Jun 09 01:24:22.348072 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:22.348045 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9cpxs"] Jun 09 01:24:23.343561 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:23.343523 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="986e9559-5909-4e8c-a9f7-4e0a0969d6d0" path="/var/lib/kubelet/pods/986e9559-5909-4e8c-a9f7-4e0a0969d6d0/volumes" Jun 09 01:24:28.436807 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:28.436712 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mbd5p" Jun 09 01:24:28.436807 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:28.436806 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mbd5p" Jun 09 01:24:28.458955 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:28.458929 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mbd5p" Jun 09 01:24:29.379101 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:29.379074 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mbd5p" Jun 09 01:24:46.197813 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:46.197780 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:46.615194 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:46.615153 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:46.712979 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:46.712946 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:50.461606 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:50.461567 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:51.288740 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.288709 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2"] Jun 09 01:24:51.289086 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.289074 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986e9559-5909-4e8c-a9f7-4e0a0969d6d0" containerName="registry-server" Jun 09 01:24:51.289131 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.289088 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="986e9559-5909-4e8c-a9f7-4e0a0969d6d0" containerName="registry-server" Jun 09 01:24:51.289165 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.289135 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="986e9559-5909-4e8c-a9f7-4e0a0969d6d0" containerName="registry-server" Jun 09 01:24:51.296529 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.296508 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:24:51.298804 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.298778 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-std87\"" Jun 09 01:24:51.301033 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.301011 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2"] Jun 09 01:24:51.361223 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.361197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrjll\" (UniqueName: \"kubernetes.io/projected/d67938f1-71eb-4c76-92f9-a02ddfa4cca9-kube-api-access-xrjll\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\" (UID: \"d67938f1-71eb-4c76-92f9-a02ddfa4cca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:24:51.361378 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.361321 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d67938f1-71eb-4c76-92f9-a02ddfa4cca9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\" (UID: \"d67938f1-71eb-4c76-92f9-a02ddfa4cca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:24:51.415383 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.415333 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:51.462395 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.462364 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrjll\" (UniqueName: \"kubernetes.io/projected/d67938f1-71eb-4c76-92f9-a02ddfa4cca9-kube-api-access-xrjll\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\" (UID: \"d67938f1-71eb-4c76-92f9-a02ddfa4cca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:24:51.462738 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.462457 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d67938f1-71eb-4c76-92f9-a02ddfa4cca9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\" (UID: \"d67938f1-71eb-4c76-92f9-a02ddfa4cca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:24:51.462838 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.462820 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d67938f1-71eb-4c76-92f9-a02ddfa4cca9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\" (UID: \"d67938f1-71eb-4c76-92f9-a02ddfa4cca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:24:51.475857 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.475830 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrjll\" (UniqueName: \"kubernetes.io/projected/d67938f1-71eb-4c76-92f9-a02ddfa4cca9-kube-api-access-xrjll\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\" (UID: \"d67938f1-71eb-4c76-92f9-a02ddfa4cca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:24:51.608105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.608081 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:24:51.742334 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.742310 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2"] Jun 09 01:24:51.744403 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:24:51.744376 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67938f1_71eb_4c76_92f9_a02ddfa4cca9.slice/crio-43ae1d123a650bc4dc6360b17894c0f9b8327cc88f2d1098d74ce33efcbd26f0 WatchSource:0}: Error finding container 43ae1d123a650bc4dc6360b17894c0f9b8327cc88f2d1098d74ce33efcbd26f0: Status 404 returned error can't find the container with id 43ae1d123a650bc4dc6360b17894c0f9b8327cc88f2d1098d74ce33efcbd26f0 Jun 09 01:24:51.815828 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:51.815801 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:52.455332 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:52.455287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" event={"ID":"d67938f1-71eb-4c76-92f9-a02ddfa4cca9","Type":"ContainerStarted","Data":"43ae1d123a650bc4dc6360b17894c0f9b8327cc88f2d1098d74ce33efcbd26f0"} Jun 09 01:24:53.269472 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:53.269430 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:53.619710 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:53.619676 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hspz7"] Jun 09 01:24:53.623384 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:53.623365 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hspz7" Jun 09 01:24:53.625770 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:53.625750 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-46qcw\"" Jun 09 01:24:53.635685 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:53.635665 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hspz7"] Jun 09 01:24:53.682065 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:53.682038 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cff8f\" (UniqueName: \"kubernetes.io/projected/1b3d5473-e10d-4cab-b1b9-53a5bc2004c7-kube-api-access-cff8f\") pod \"authorino-operator-75cc8d5cb7-hspz7\" (UID: \"1b3d5473-e10d-4cab-b1b9-53a5bc2004c7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hspz7" Jun 09 01:24:53.783210 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:53.783170 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cff8f\" (UniqueName: \"kubernetes.io/projected/1b3d5473-e10d-4cab-b1b9-53a5bc2004c7-kube-api-access-cff8f\") pod \"authorino-operator-75cc8d5cb7-hspz7\" (UID: \"1b3d5473-e10d-4cab-b1b9-53a5bc2004c7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hspz7" Jun 09 01:24:53.790667 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:53.790643 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cff8f\" (UniqueName: \"kubernetes.io/projected/1b3d5473-e10d-4cab-b1b9-53a5bc2004c7-kube-api-access-cff8f\") pod \"authorino-operator-75cc8d5cb7-hspz7\" (UID: \"1b3d5473-e10d-4cab-b1b9-53a5bc2004c7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hspz7" Jun 09 01:24:53.934315 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:53.934227 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hspz7" Jun 09 01:24:54.062163 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:54.062133 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hspz7"] Jun 09 01:24:54.066195 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:24:54.066166 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b3d5473_e10d_4cab_b1b9_53a5bc2004c7.slice/crio-ad03ca09ef54a50bce63cedecc36b517684cb5b5ce07993dc7775120a95f431f WatchSource:0}: Error finding container ad03ca09ef54a50bce63cedecc36b517684cb5b5ce07993dc7775120a95f431f: Status 404 returned error can't find the container with id ad03ca09ef54a50bce63cedecc36b517684cb5b5ce07993dc7775120a95f431f Jun 09 01:24:54.467860 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:54.467823 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hspz7" event={"ID":"1b3d5473-e10d-4cab-b1b9-53a5bc2004c7","Type":"ContainerStarted","Data":"ad03ca09ef54a50bce63cedecc36b517684cb5b5ce07993dc7775120a95f431f"} Jun 09 01:24:54.628147 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:54.628117 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:56.259924 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:56.259884 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:57.229680 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:57.229646 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:57.322169 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:57.322118 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:57.424060 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:57.424014 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:57.481919 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:57.481837 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hspz7" event={"ID":"1b3d5473-e10d-4cab-b1b9-53a5bc2004c7","Type":"ContainerStarted","Data":"4e474fc6bb285b5748c016dc30d8db0c423af2e9797395a49ca1dde0f3bd2b9f"} Jun 09 01:24:57.482072 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:57.481942 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hspz7" Jun 09 01:24:57.503331 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:57.503293 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hspz7" podStartSLOduration=2.084976871 podStartE2EDuration="4.503238186s" totalImagesPullingTime="2.418261315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:24:57.502651445 +0000 UTC m=+560.614651297" watchObservedRunningTime="2026-06-09 01:24:57.503238186 +0000 UTC m=+560.615238036" Jun 09 01:24:57.510923 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:57.510902 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:59.067318 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:59.067286 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:24:59.493617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:59.493484 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" event={"ID":"d67938f1-71eb-4c76-92f9-a02ddfa4cca9","Type":"ContainerStarted","Data":"0d0ab35c90fb52d3cce2f4542b439ca2e1bbcd79cf4666be5b82848b03864f92"} Jun 09 01:24:59.493617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:59.493552 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:24:59.513358 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:24:59.513313 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" podStartSLOduration=1.452204926 podStartE2EDuration="8.513296603s" totalImagesPullingTime="7.061091677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:24:59.511179764 +0000 UTC m=+562.623179615" watchObservedRunningTime="2026-06-09 01:24:59.513296603 +0000 UTC m=+562.625296455" Jun 09 01:25:01.213057 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:01.213018 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:01.264702 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:01.264672 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:01.574857 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:01.574828 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:01.909137 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:01.909063 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:08.489678 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:08.489649 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hspz7" Jun 09 01:25:09.596732 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:09.596702 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:09.696859 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:09.696821 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:10.500051 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:10.500023 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:25:11.438957 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.438925 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:11.536387 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.536352 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:11.638190 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.638159 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:11.640317 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.640297 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm"] Jun 09 01:25:11.643850 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.643836 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" Jun 09 01:25:11.658956 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.658933 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm"] Jun 09 01:25:11.747552 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.747489 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5929f81-c065-4fdc-bd56-7a0bf60ae6ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8mnvm\" (UID: \"e5929f81-c065-4fdc-bd56-7a0bf60ae6ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" Jun 09 01:25:11.747552 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.747529 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65j7j\" (UniqueName: \"kubernetes.io/projected/e5929f81-c065-4fdc-bd56-7a0bf60ae6ec-kube-api-access-65j7j\") pod \"kuadrant-operator-controller-manager-55467d9f7-8mnvm\" (UID: \"e5929f81-c065-4fdc-bd56-7a0bf60ae6ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" Jun 09 01:25:11.753761 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.753732 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:11.848883 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.848851 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5929f81-c065-4fdc-bd56-7a0bf60ae6ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8mnvm\" (UID: \"e5929f81-c065-4fdc-bd56-7a0bf60ae6ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" Jun 09 01:25:11.848992 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.848905 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65j7j\" (UniqueName: \"kubernetes.io/projected/e5929f81-c065-4fdc-bd56-7a0bf60ae6ec-kube-api-access-65j7j\") pod \"kuadrant-operator-controller-manager-55467d9f7-8mnvm\" (UID: \"e5929f81-c065-4fdc-bd56-7a0bf60ae6ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" Jun 09 01:25:11.849330 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.849306 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5929f81-c065-4fdc-bd56-7a0bf60ae6ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8mnvm\" (UID: \"e5929f81-c065-4fdc-bd56-7a0bf60ae6ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" Jun 09 01:25:11.857169 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.857148 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:11.864421 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.864398 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65j7j\" (UniqueName: \"kubernetes.io/projected/e5929f81-c065-4fdc-bd56-7a0bf60ae6ec-kube-api-access-65j7j\") pod \"kuadrant-operator-controller-manager-55467d9f7-8mnvm\" (UID: \"e5929f81-c065-4fdc-bd56-7a0bf60ae6ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" Jun 09 01:25:11.954263 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:11.954225 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" Jun 09 01:25:12.086140 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.086117 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm"] Jun 09 01:25:12.088695 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:25:12.088660 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5929f81_c065_4fdc_bd56_7a0bf60ae6ec.slice/crio-8a5d221018de99215a067737f4ab418ac3be67153ff5dcf885bbefda0c4385fc WatchSource:0}: Error finding container 8a5d221018de99215a067737f4ab418ac3be67153ff5dcf885bbefda0c4385fc: Status 404 returned error can't find the container with id 8a5d221018de99215a067737f4ab418ac3be67153ff5dcf885bbefda0c4385fc Jun 09 01:25:12.091910 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.091887 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm"] Jun 09 01:25:12.102104 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.101120 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm"] Jun 09 01:25:12.114888 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.114866 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2"] Jun 09 01:25:12.115116 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.115070 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" podUID="d67938f1-71eb-4c76-92f9-a02ddfa4cca9" containerName="manager" containerID="cri-o://0d0ab35c90fb52d3cce2f4542b439ca2e1bbcd79cf4666be5b82848b03864f92" gracePeriod=2 Jun 09 01:25:12.118901 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.118850 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9"] Jun 09 01:25:12.123972 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.123950 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" Jun 09 01:25:12.128416 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:12.128381 2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d67938f1-71eb-4c76-92f9-a02ddfa4cca9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\": pods \"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:25:12.129114 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.129093 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2"] Jun 09 01:25:12.136648 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.136623 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9"] Jun 09 01:25:12.145407 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.145386 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2"] Jun 09 01:25:12.145863 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.145841 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67938f1-71eb-4c76-92f9-a02ddfa4cca9" containerName="manager" Jun 09 01:25:12.145863 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.145862 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67938f1-71eb-4c76-92f9-a02ddfa4cca9" containerName="manager" Jun 09 01:25:12.146034 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.145931 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d67938f1-71eb-4c76-92f9-a02ddfa4cca9" containerName="manager" Jun 09 01:25:12.149032 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.149010 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" Jun 09 01:25:12.152494 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:12.152465 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\" is forbidden: User \"system:node:ip-10-0-137-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-100.ec2.internal' and this object" podUID="d67938f1-71eb-4c76-92f9-a02ddfa4cca9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:25:12.162049 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.162018 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2"] Jun 09 01:25:12.195206 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:12.195170 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\" is forbidden: User \"system:node:ip-10-0-137-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-100.ec2.internal' and this object" podUID="d67938f1-71eb-4c76-92f9-a02ddfa4cca9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:25:12.252091 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.252053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2c53815-a195-4313-b5cc-09789410b152-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-p94s9\" (UID: \"e2c53815-a195-4313-b5cc-09789410b152\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" Jun 09 01:25:12.252234 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.252134 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlsld\" (UniqueName: \"kubernetes.io/projected/e2c53815-a195-4313-b5cc-09789410b152-kube-api-access-mlsld\") pod \"kuadrant-operator-controller-manager-55467d9f7-p94s9\" (UID: \"e2c53815-a195-4313-b5cc-09789410b152\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" Jun 09 01:25:12.252234 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.252164 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0073bd7-5bed-4439-8ac3-71f6e9877b59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6k5l2\" (UID: \"a0073bd7-5bed-4439-8ac3-71f6e9877b59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" Jun 09 01:25:12.252234 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.252186 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x5xt\" (UniqueName: \"kubernetes.io/projected/a0073bd7-5bed-4439-8ac3-71f6e9877b59-kube-api-access-5x5xt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6k5l2\" (UID: \"a0073bd7-5bed-4439-8ac3-71f6e9877b59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" Jun 09 01:25:12.343765 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.343742 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:25:12.345698 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:12.345673 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\" is forbidden: User \"system:node:ip-10-0-137-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-100.ec2.internal' and this object" podUID="d67938f1-71eb-4c76-92f9-a02ddfa4cca9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:25:12.353042 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.353022 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlsld\" (UniqueName: \"kubernetes.io/projected/e2c53815-a195-4313-b5cc-09789410b152-kube-api-access-mlsld\") pod \"kuadrant-operator-controller-manager-55467d9f7-p94s9\" (UID: \"e2c53815-a195-4313-b5cc-09789410b152\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" Jun 09 01:25:12.353110 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.353052 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0073bd7-5bed-4439-8ac3-71f6e9877b59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6k5l2\" (UID: \"a0073bd7-5bed-4439-8ac3-71f6e9877b59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" Jun 09 01:25:12.353110 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.353074 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x5xt\" (UniqueName: \"kubernetes.io/projected/a0073bd7-5bed-4439-8ac3-71f6e9877b59-kube-api-access-5x5xt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6k5l2\" (UID: \"a0073bd7-5bed-4439-8ac3-71f6e9877b59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" Jun 09 01:25:12.353196 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.353181 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2c53815-a195-4313-b5cc-09789410b152-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-p94s9\" (UID: \"e2c53815-a195-4313-b5cc-09789410b152\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" Jun 09 01:25:12.353486 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.353467 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0073bd7-5bed-4439-8ac3-71f6e9877b59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6k5l2\" (UID: \"a0073bd7-5bed-4439-8ac3-71f6e9877b59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" Jun 09 01:25:12.353522 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.353510 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2c53815-a195-4313-b5cc-09789410b152-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-p94s9\" (UID: \"e2c53815-a195-4313-b5cc-09789410b152\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" Jun 09 01:25:12.365208 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.365191 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x5xt\" (UniqueName: \"kubernetes.io/projected/a0073bd7-5bed-4439-8ac3-71f6e9877b59-kube-api-access-5x5xt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6k5l2\" (UID: \"a0073bd7-5bed-4439-8ac3-71f6e9877b59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" Jun 09 01:25:12.365298 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.365207 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlsld\" (UniqueName: \"kubernetes.io/projected/e2c53815-a195-4313-b5cc-09789410b152-kube-api-access-mlsld\") pod \"kuadrant-operator-controller-manager-55467d9f7-p94s9\" (UID: \"e2c53815-a195-4313-b5cc-09789410b152\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" Jun 09 01:25:12.453547 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.453527 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrjll\" (UniqueName: \"kubernetes.io/projected/d67938f1-71eb-4c76-92f9-a02ddfa4cca9-kube-api-access-xrjll\") pod \"d67938f1-71eb-4c76-92f9-a02ddfa4cca9\" (UID: \"d67938f1-71eb-4c76-92f9-a02ddfa4cca9\") " Jun 09 01:25:12.453839 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.453562 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d67938f1-71eb-4c76-92f9-a02ddfa4cca9-extensions-socket-volume\") pod \"d67938f1-71eb-4c76-92f9-a02ddfa4cca9\" (UID: \"d67938f1-71eb-4c76-92f9-a02ddfa4cca9\") " Jun 09 01:25:12.454038 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.454018 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d67938f1-71eb-4c76-92f9-a02ddfa4cca9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d67938f1-71eb-4c76-92f9-a02ddfa4cca9" (UID: "d67938f1-71eb-4c76-92f9-a02ddfa4cca9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:25:12.455320 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.455301 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d67938f1-71eb-4c76-92f9-a02ddfa4cca9-kube-api-access-xrjll" (OuterVolumeSpecName: "kube-api-access-xrjll") pod "d67938f1-71eb-4c76-92f9-a02ddfa4cca9" (UID: "d67938f1-71eb-4c76-92f9-a02ddfa4cca9"). InnerVolumeSpecName "kube-api-access-xrjll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:25:12.501682 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.501661 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" Jun 09 01:25:12.507611 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.507592 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" Jun 09 01:25:12.554372 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.554295 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrjll\" (UniqueName: \"kubernetes.io/projected/d67938f1-71eb-4c76-92f9-a02ddfa4cca9-kube-api-access-xrjll\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:25:12.554372 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.554326 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d67938f1-71eb-4c76-92f9-a02ddfa4cca9-extensions-socket-volume\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:25:12.557590 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.557335 2567 generic.go:356] "Generic (PLEG): container finished" podID="d67938f1-71eb-4c76-92f9-a02ddfa4cca9" containerID="0d0ab35c90fb52d3cce2f4542b439ca2e1bbcd79cf4666be5b82848b03864f92" exitCode=0 Jun 09 01:25:12.557590 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.557390 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:25:12.557590 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.557446 2567 scope.go:117] "RemoveContainer" containerID="0d0ab35c90fb52d3cce2f4542b439ca2e1bbcd79cf4666be5b82848b03864f92" Jun 09 01:25:12.560819 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:12.560517 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\" is forbidden: User \"system:node:ip-10-0-137-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-100.ec2.internal' and this object" podUID="d67938f1-71eb-4c76-92f9-a02ddfa4cca9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:25:12.561946 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.561915 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" podUID="e5929f81-c065-4fdc-bd56-7a0bf60ae6ec" containerName="manager" containerID="cri-o://a7844eb9bdfbebb8caf0ef8054fbb6aa69531a9d6b276587ecd5ceb51b30e699" gracePeriod=2 Jun 09 01:25:12.565747 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:12.565589 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\" is forbidden: User \"system:node:ip-10-0-137-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-100.ec2.internal' and this object" podUID="d67938f1-71eb-4c76-92f9-a02ddfa4cca9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:25:12.567667 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:12.567634 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8mnvm\" is forbidden: User \"system:node:ip-10-0-137-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-100.ec2.internal' and this object" podUID="e5929f81-c065-4fdc-bd56-7a0bf60ae6ec" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" Jun 09 01:25:12.575732 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.575103 2567 scope.go:117] "RemoveContainer" containerID="0d0ab35c90fb52d3cce2f4542b439ca2e1bbcd79cf4666be5b82848b03864f92" Jun 09 01:25:12.576207 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:12.576064 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d0ab35c90fb52d3cce2f4542b439ca2e1bbcd79cf4666be5b82848b03864f92\": container with ID starting with 0d0ab35c90fb52d3cce2f4542b439ca2e1bbcd79cf4666be5b82848b03864f92 not found: ID does not exist" containerID="0d0ab35c90fb52d3cce2f4542b439ca2e1bbcd79cf4666be5b82848b03864f92" Jun 09 01:25:12.576207 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.576100 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d0ab35c90fb52d3cce2f4542b439ca2e1bbcd79cf4666be5b82848b03864f92"} err="failed to get container status \"0d0ab35c90fb52d3cce2f4542b439ca2e1bbcd79cf4666be5b82848b03864f92\": rpc error: code = NotFound desc = could not find container \"0d0ab35c90fb52d3cce2f4542b439ca2e1bbcd79cf4666be5b82848b03864f92\": container with ID starting with 0d0ab35c90fb52d3cce2f4542b439ca2e1bbcd79cf4666be5b82848b03864f92 not found: ID does not exist" Jun 09 01:25:12.578775 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:12.578469 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\" is forbidden: User \"system:node:ip-10-0-137-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-100.ec2.internal' and this object" podUID="d67938f1-71eb-4c76-92f9-a02ddfa4cca9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:25:12.582497 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:12.582448 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8mnvm\" is forbidden: User \"system:node:ip-10-0-137-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-100.ec2.internal' and this object" podUID="e5929f81-c065-4fdc-bd56-7a0bf60ae6ec" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" Jun 09 01:25:12.650714 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.650682 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9"] Jun 09 01:25:12.654136 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:25:12.654109 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c53815_a195_4313_b5cc_09789410b152.slice/crio-7d19d0a8f87c9962e48e19c203a0a55dd9a10e44fd7c26336c0c1561bc13f89e WatchSource:0}: Error finding container 7d19d0a8f87c9962e48e19c203a0a55dd9a10e44fd7c26336c0c1561bc13f89e: Status 404 returned error can't find the container with id 7d19d0a8f87c9962e48e19c203a0a55dd9a10e44fd7c26336c0c1561bc13f89e Jun 09 01:25:12.671488 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.671466 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2"] Jun 09 01:25:12.673491 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:25:12.673468 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0073bd7_5bed_4439_8ac3_71f6e9877b59.slice/crio-b6fda63aa684ef3386dd1098dff0fdf98ff5d0d2351e0b1ce80e7bf40e3b212e WatchSource:0}: Error finding container b6fda63aa684ef3386dd1098dff0fdf98ff5d0d2351e0b1ce80e7bf40e3b212e: Status 404 returned error can't find the container with id b6fda63aa684ef3386dd1098dff0fdf98ff5d0d2351e0b1ce80e7bf40e3b212e Jun 09 01:25:12.804945 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.804887 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" Jun 09 01:25:12.806960 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:12.806937 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jmwn2\" is forbidden: User \"system:node:ip-10-0-137-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-100.ec2.internal' and this object" podUID="d67938f1-71eb-4c76-92f9-a02ddfa4cca9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmwn2" Jun 09 01:25:12.808517 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:12.808500 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8mnvm\" is forbidden: User \"system:node:ip-10-0-137-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-100.ec2.internal' and this object" podUID="e5929f81-c065-4fdc-bd56-7a0bf60ae6ec" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" Jun 09 01:25:12.957780 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.957745 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5929f81-c065-4fdc-bd56-7a0bf60ae6ec-extensions-socket-volume\") pod \"e5929f81-c065-4fdc-bd56-7a0bf60ae6ec\" (UID: \"e5929f81-c065-4fdc-bd56-7a0bf60ae6ec\") " Jun 09 01:25:12.957938 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.957856 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65j7j\" (UniqueName: \"kubernetes.io/projected/e5929f81-c065-4fdc-bd56-7a0bf60ae6ec-kube-api-access-65j7j\") pod \"e5929f81-c065-4fdc-bd56-7a0bf60ae6ec\" (UID: \"e5929f81-c065-4fdc-bd56-7a0bf60ae6ec\") " Jun 09 01:25:12.958023 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.957994 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5929f81-c065-4fdc-bd56-7a0bf60ae6ec-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e5929f81-c065-4fdc-bd56-7a0bf60ae6ec" (UID: "e5929f81-c065-4fdc-bd56-7a0bf60ae6ec"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:25:12.958121 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.958104 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5929f81-c065-4fdc-bd56-7a0bf60ae6ec-extensions-socket-volume\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:25:12.960406 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:12.960376 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5929f81-c065-4fdc-bd56-7a0bf60ae6ec-kube-api-access-65j7j" (OuterVolumeSpecName: "kube-api-access-65j7j") pod "e5929f81-c065-4fdc-bd56-7a0bf60ae6ec" (UID: "e5929f81-c065-4fdc-bd56-7a0bf60ae6ec"). InnerVolumeSpecName "kube-api-access-65j7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:25:13.058865 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.058783 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65j7j\" (UniqueName: \"kubernetes.io/projected/e5929f81-c065-4fdc-bd56-7a0bf60ae6ec-kube-api-access-65j7j\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:25:13.345347 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.345298 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d67938f1-71eb-4c76-92f9-a02ddfa4cca9" path="/var/lib/kubelet/pods/d67938f1-71eb-4c76-92f9-a02ddfa4cca9/volumes" Jun 09 01:25:13.345692 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.345680 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5929f81-c065-4fdc-bd56-7a0bf60ae6ec" path="/var/lib/kubelet/pods/e5929f81-c065-4fdc-bd56-7a0bf60ae6ec/volumes" Jun 09 01:25:13.568727 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.568681 2567 generic.go:356] "Generic (PLEG): container finished" podID="e5929f81-c065-4fdc-bd56-7a0bf60ae6ec" containerID="a7844eb9bdfbebb8caf0ef8054fbb6aa69531a9d6b276587ecd5ceb51b30e699" exitCode=2 Jun 09 01:25:13.568727 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.568729 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" Jun 09 01:25:13.569208 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.568763 2567 scope.go:117] "RemoveContainer" containerID="a7844eb9bdfbebb8caf0ef8054fbb6aa69531a9d6b276587ecd5ceb51b30e699" Jun 09 01:25:13.571089 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.571062 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" event={"ID":"e2c53815-a195-4313-b5cc-09789410b152","Type":"ContainerStarted","Data":"fbf00c13d75aee141c1654f1c3765b4636fa405d4c6c37f01020a5bac610564d"} Jun 09 01:25:13.571206 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.571122 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" event={"ID":"e2c53815-a195-4313-b5cc-09789410b152","Type":"ContainerStarted","Data":"7d19d0a8f87c9962e48e19c203a0a55dd9a10e44fd7c26336c0c1561bc13f89e"} Jun 09 01:25:13.571206 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.571170 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" Jun 09 01:25:13.572354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.572334 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" event={"ID":"a0073bd7-5bed-4439-8ac3-71f6e9877b59","Type":"ContainerStarted","Data":"4a6b30eea2b1c828417a709519606b0d4c14b71cf772bc847ef35f78fc201350"} Jun 09 01:25:13.572451 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.572374 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" event={"ID":"a0073bd7-5bed-4439-8ac3-71f6e9877b59","Type":"ContainerStarted","Data":"b6fda63aa684ef3386dd1098dff0fdf98ff5d0d2351e0b1ce80e7bf40e3b212e"} Jun 09 01:25:13.572496 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.572468 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" Jun 09 01:25:13.577423 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.577407 2567 scope.go:117] "RemoveContainer" containerID="a7844eb9bdfbebb8caf0ef8054fbb6aa69531a9d6b276587ecd5ceb51b30e699" Jun 09 01:25:13.577682 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:13.577664 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7844eb9bdfbebb8caf0ef8054fbb6aa69531a9d6b276587ecd5ceb51b30e699\": container with ID starting with a7844eb9bdfbebb8caf0ef8054fbb6aa69531a9d6b276587ecd5ceb51b30e699 not found: ID does not exist" containerID="a7844eb9bdfbebb8caf0ef8054fbb6aa69531a9d6b276587ecd5ceb51b30e699" Jun 09 01:25:13.577744 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.577687 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7844eb9bdfbebb8caf0ef8054fbb6aa69531a9d6b276587ecd5ceb51b30e699"} err="failed to get container status \"a7844eb9bdfbebb8caf0ef8054fbb6aa69531a9d6b276587ecd5ceb51b30e699\": rpc error: code = NotFound desc = could not find container \"a7844eb9bdfbebb8caf0ef8054fbb6aa69531a9d6b276587ecd5ceb51b30e699\": container with ID starting with a7844eb9bdfbebb8caf0ef8054fbb6aa69531a9d6b276587ecd5ceb51b30e699 not found: ID does not exist" Jun 09 01:25:13.605978 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.605911 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" podStartSLOduration=1.605898078 podStartE2EDuration="1.605898078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:25:13.604768908 +0000 UTC m=+576.716768762" watchObservedRunningTime="2026-06-09 01:25:13.605898078 +0000 UTC m=+576.717897928" Jun 09 01:25:13.608333 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:13.608310 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8mnvm\" is forbidden: User \"system:node:ip-10-0-137-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-100.ec2.internal' and this object" podUID="e5929f81-c065-4fdc-bd56-7a0bf60ae6ec" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mnvm" Jun 09 01:25:13.648600 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:13.648555 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" podStartSLOduration=1.648542028 podStartE2EDuration="1.648542028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:25:13.646923426 +0000 UTC m=+576.758923315" watchObservedRunningTime="2026-06-09 01:25:13.648542028 +0000 UTC m=+576.760541879" Jun 09 01:25:14.448751 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:14.448719 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:14.546699 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:14.546670 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:16.865341 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:16.865305 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:16.964923 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:16.964887 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:22.672956 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:22.672919 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:22.728515 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:22.728471 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:24.582751 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:24.582720 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" Jun 09 01:25:24.583128 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:24.582887 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" Jun 09 01:25:24.664435 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:24.664404 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2"] Jun 09 01:25:24.664615 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:24.664577 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" podUID="a0073bd7-5bed-4439-8ac3-71f6e9877b59" containerName="manager" containerID="cri-o://4a6b30eea2b1c828417a709519606b0d4c14b71cf772bc847ef35f78fc201350" gracePeriod=10 Jun 09 01:25:24.911936 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:24.911915 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" Jun 09 01:25:24.990755 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:24.990725 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t"] Jun 09 01:25:24.991080 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:24.991067 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5929f81-c065-4fdc-bd56-7a0bf60ae6ec" containerName="manager" Jun 09 01:25:24.991128 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:24.991081 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5929f81-c065-4fdc-bd56-7a0bf60ae6ec" containerName="manager" Jun 09 01:25:24.991128 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:24.991108 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0073bd7-5bed-4439-8ac3-71f6e9877b59" containerName="manager" Jun 09 01:25:24.991128 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:24.991113 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0073bd7-5bed-4439-8ac3-71f6e9877b59" containerName="manager" Jun 09 01:25:24.991220 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:24.991165 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5929f81-c065-4fdc-bd56-7a0bf60ae6ec" containerName="manager" Jun 09 01:25:24.991220 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:24.991176 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0073bd7-5bed-4439-8ac3-71f6e9877b59" containerName="manager" Jun 09 01:25:24.994269 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:24.994238 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" Jun 09 01:25:25.017592 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.017564 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t"] Jun 09 01:25:25.066047 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.066021 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0073bd7-5bed-4439-8ac3-71f6e9877b59-extensions-socket-volume\") pod \"a0073bd7-5bed-4439-8ac3-71f6e9877b59\" (UID: \"a0073bd7-5bed-4439-8ac3-71f6e9877b59\") " Jun 09 01:25:25.066174 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.066054 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5x5xt\" (UniqueName: \"kubernetes.io/projected/a0073bd7-5bed-4439-8ac3-71f6e9877b59-kube-api-access-5x5xt\") pod \"a0073bd7-5bed-4439-8ac3-71f6e9877b59\" (UID: \"a0073bd7-5bed-4439-8ac3-71f6e9877b59\") " Jun 09 01:25:25.066462 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.066432 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0073bd7-5bed-4439-8ac3-71f6e9877b59-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a0073bd7-5bed-4439-8ac3-71f6e9877b59" (UID: "a0073bd7-5bed-4439-8ac3-71f6e9877b59"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:25:25.068124 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.068102 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0073bd7-5bed-4439-8ac3-71f6e9877b59-kube-api-access-5x5xt" (OuterVolumeSpecName: "kube-api-access-5x5xt") pod "a0073bd7-5bed-4439-8ac3-71f6e9877b59" (UID: "a0073bd7-5bed-4439-8ac3-71f6e9877b59"). InnerVolumeSpecName "kube-api-access-5x5xt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:25:25.166996 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.166895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97eb0195-555f-4018-9915-3cbd42d4d7fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ps24t\" (UID: \"97eb0195-555f-4018-9915-3cbd42d4d7fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" Jun 09 01:25:25.167171 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.167060 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j7mc\" (UniqueName: \"kubernetes.io/projected/97eb0195-555f-4018-9915-3cbd42d4d7fa-kube-api-access-7j7mc\") pod \"kuadrant-operator-controller-manager-86878c769f-ps24t\" (UID: \"97eb0195-555f-4018-9915-3cbd42d4d7fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" Jun 09 01:25:25.167242 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.167195 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0073bd7-5bed-4439-8ac3-71f6e9877b59-extensions-socket-volume\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:25:25.167242 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.167214 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5x5xt\" (UniqueName: \"kubernetes.io/projected/a0073bd7-5bed-4439-8ac3-71f6e9877b59-kube-api-access-5x5xt\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:25:25.268390 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.268359 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7mc\" (UniqueName: \"kubernetes.io/projected/97eb0195-555f-4018-9915-3cbd42d4d7fa-kube-api-access-7j7mc\") pod \"kuadrant-operator-controller-manager-86878c769f-ps24t\" (UID: \"97eb0195-555f-4018-9915-3cbd42d4d7fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" Jun 09 01:25:25.268530 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.268412 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97eb0195-555f-4018-9915-3cbd42d4d7fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ps24t\" (UID: \"97eb0195-555f-4018-9915-3cbd42d4d7fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" Jun 09 01:25:25.268749 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.268731 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97eb0195-555f-4018-9915-3cbd42d4d7fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ps24t\" (UID: \"97eb0195-555f-4018-9915-3cbd42d4d7fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" Jun 09 01:25:25.277443 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.277415 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j7mc\" (UniqueName: \"kubernetes.io/projected/97eb0195-555f-4018-9915-3cbd42d4d7fa-kube-api-access-7j7mc\") pod \"kuadrant-operator-controller-manager-86878c769f-ps24t\" (UID: \"97eb0195-555f-4018-9915-3cbd42d4d7fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" Jun 09 01:25:25.303883 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.303856 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" Jun 09 01:25:25.448290 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.446435 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t"] Jun 09 01:25:25.451644 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:25:25.451619 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97eb0195_555f_4018_9915_3cbd42d4d7fa.slice/crio-1eb18684cee43891cfd72777cbb8d1a043e27c05a10af7a44d0f94d014b6344a WatchSource:0}: Error finding container 1eb18684cee43891cfd72777cbb8d1a043e27c05a10af7a44d0f94d014b6344a: Status 404 returned error can't find the container with id 1eb18684cee43891cfd72777cbb8d1a043e27c05a10af7a44d0f94d014b6344a Jun 09 01:25:25.634236 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.634203 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" event={"ID":"97eb0195-555f-4018-9915-3cbd42d4d7fa","Type":"ContainerStarted","Data":"e6fbba4222b04e7adff82c672f57cd2be518b76317ce0e3c2da4b10d92a5a385"} Jun 09 01:25:25.634684 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.634285 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" event={"ID":"97eb0195-555f-4018-9915-3cbd42d4d7fa","Type":"ContainerStarted","Data":"1eb18684cee43891cfd72777cbb8d1a043e27c05a10af7a44d0f94d014b6344a"} Jun 09 01:25:25.634684 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.634407 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" Jun 09 01:25:25.635609 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.635586 2567 generic.go:356] "Generic (PLEG): container finished" podID="a0073bd7-5bed-4439-8ac3-71f6e9877b59" containerID="4a6b30eea2b1c828417a709519606b0d4c14b71cf772bc847ef35f78fc201350" exitCode=0 Jun 09 01:25:25.635737 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.635630 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" event={"ID":"a0073bd7-5bed-4439-8ac3-71f6e9877b59","Type":"ContainerDied","Data":"4a6b30eea2b1c828417a709519606b0d4c14b71cf772bc847ef35f78fc201350"} Jun 09 01:25:25.635737 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.635648 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" Jun 09 01:25:25.635737 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.635661 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2" event={"ID":"a0073bd7-5bed-4439-8ac3-71f6e9877b59","Type":"ContainerDied","Data":"b6fda63aa684ef3386dd1098dff0fdf98ff5d0d2351e0b1ce80e7bf40e3b212e"} Jun 09 01:25:25.635737 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.635682 2567 scope.go:117] "RemoveContainer" containerID="4a6b30eea2b1c828417a709519606b0d4c14b71cf772bc847ef35f78fc201350" Jun 09 01:25:25.644501 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.644480 2567 scope.go:117] "RemoveContainer" containerID="4a6b30eea2b1c828417a709519606b0d4c14b71cf772bc847ef35f78fc201350" Jun 09 01:25:25.644765 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:25.644747 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a6b30eea2b1c828417a709519606b0d4c14b71cf772bc847ef35f78fc201350\": container with ID starting with 4a6b30eea2b1c828417a709519606b0d4c14b71cf772bc847ef35f78fc201350 not found: ID does not exist" containerID="4a6b30eea2b1c828417a709519606b0d4c14b71cf772bc847ef35f78fc201350" Jun 09 01:25:25.644828 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.644773 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a6b30eea2b1c828417a709519606b0d4c14b71cf772bc847ef35f78fc201350"} err="failed to get container status \"4a6b30eea2b1c828417a709519606b0d4c14b71cf772bc847ef35f78fc201350\": rpc error: code = NotFound desc = could not find container \"4a6b30eea2b1c828417a709519606b0d4c14b71cf772bc847ef35f78fc201350\": container with ID starting with 4a6b30eea2b1c828417a709519606b0d4c14b71cf772bc847ef35f78fc201350 not found: ID does not exist" Jun 09 01:25:25.654269 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.654215 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" podStartSLOduration=1.65420211 podStartE2EDuration="1.65420211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:25:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:25:25.652736708 +0000 UTC m=+588.764736560" watchObservedRunningTime="2026-06-09 01:25:25.65420211 +0000 UTC m=+588.766201961" Jun 09 01:25:25.666239 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.666217 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2"] Jun 09 01:25:25.678809 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:25.678784 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6k5l2"] Jun 09 01:25:27.343563 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:27.343530 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0073bd7-5bed-4439-8ac3-71f6e9877b59" path="/var/lib/kubelet/pods/a0073bd7-5bed-4439-8ac3-71f6e9877b59/volumes" Jun 09 01:25:33.021085 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:33.021054 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:33.073351 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:33.073322 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:33.624344 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:33.624315 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:33.724912 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:33.724881 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:33.979783 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:33.979700 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:34.069240 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:34.069209 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:36.643883 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:36.643856 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" Jun 09 01:25:36.690678 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:36.690651 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9"] Jun 09 01:25:36.690939 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:36.690910 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" podUID="e2c53815-a195-4313-b5cc-09789410b152" containerName="manager" containerID="cri-o://fbf00c13d75aee141c1654f1c3765b4636fa405d4c6c37f01020a5bac610564d" gracePeriod=10 Jun 09 01:25:36.930459 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:36.930435 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" Jun 09 01:25:36.963937 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:36.963911 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlsld\" (UniqueName: \"kubernetes.io/projected/e2c53815-a195-4313-b5cc-09789410b152-kube-api-access-mlsld\") pod \"e2c53815-a195-4313-b5cc-09789410b152\" (UID: \"e2c53815-a195-4313-b5cc-09789410b152\") " Jun 09 01:25:36.964074 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:36.963953 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2c53815-a195-4313-b5cc-09789410b152-extensions-socket-volume\") pod \"e2c53815-a195-4313-b5cc-09789410b152\" (UID: \"e2c53815-a195-4313-b5cc-09789410b152\") " Jun 09 01:25:36.964378 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:36.964356 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2c53815-a195-4313-b5cc-09789410b152-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e2c53815-a195-4313-b5cc-09789410b152" (UID: "e2c53815-a195-4313-b5cc-09789410b152"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:25:36.966033 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:36.966006 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2c53815-a195-4313-b5cc-09789410b152-kube-api-access-mlsld" (OuterVolumeSpecName: "kube-api-access-mlsld") pod "e2c53815-a195-4313-b5cc-09789410b152" (UID: "e2c53815-a195-4313-b5cc-09789410b152"). InnerVolumeSpecName "kube-api-access-mlsld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:25:37.064667 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.064641 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlsld\" (UniqueName: \"kubernetes.io/projected/e2c53815-a195-4313-b5cc-09789410b152-kube-api-access-mlsld\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:25:37.064667 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.064664 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2c53815-a195-4313-b5cc-09789410b152-extensions-socket-volume\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:25:37.323698 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.323671 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:25:37.323830 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.323700 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:25:37.419076 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.419046 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:37.522453 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.522354 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:37.706078 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.705989 2567 generic.go:356] "Generic (PLEG): container finished" podID="e2c53815-a195-4313-b5cc-09789410b152" containerID="fbf00c13d75aee141c1654f1c3765b4636fa405d4c6c37f01020a5bac610564d" exitCode=0 Jun 09 01:25:37.706078 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.706040 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" Jun 09 01:25:37.706617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.706046 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" event={"ID":"e2c53815-a195-4313-b5cc-09789410b152","Type":"ContainerDied","Data":"fbf00c13d75aee141c1654f1c3765b4636fa405d4c6c37f01020a5bac610564d"} Jun 09 01:25:37.706617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.706156 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9" event={"ID":"e2c53815-a195-4313-b5cc-09789410b152","Type":"ContainerDied","Data":"7d19d0a8f87c9962e48e19c203a0a55dd9a10e44fd7c26336c0c1561bc13f89e"} Jun 09 01:25:37.706617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.706187 2567 scope.go:117] "RemoveContainer" containerID="fbf00c13d75aee141c1654f1c3765b4636fa405d4c6c37f01020a5bac610564d" Jun 09 01:25:37.714790 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.714774 2567 scope.go:117] "RemoveContainer" containerID="fbf00c13d75aee141c1654f1c3765b4636fa405d4c6c37f01020a5bac610564d" Jun 09 01:25:37.715015 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:25:37.714995 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbf00c13d75aee141c1654f1c3765b4636fa405d4c6c37f01020a5bac610564d\": container with ID starting with fbf00c13d75aee141c1654f1c3765b4636fa405d4c6c37f01020a5bac610564d not found: ID does not exist" containerID="fbf00c13d75aee141c1654f1c3765b4636fa405d4c6c37f01020a5bac610564d" Jun 09 01:25:37.715071 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.715022 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf00c13d75aee141c1654f1c3765b4636fa405d4c6c37f01020a5bac610564d"} err="failed to get container status \"fbf00c13d75aee141c1654f1c3765b4636fa405d4c6c37f01020a5bac610564d\": rpc error: code = NotFound desc = could not find container \"fbf00c13d75aee141c1654f1c3765b4636fa405d4c6c37f01020a5bac610564d\": container with ID starting with fbf00c13d75aee141c1654f1c3765b4636fa405d4c6c37f01020a5bac610564d not found: ID does not exist" Jun 09 01:25:37.723379 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.723359 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9"] Jun 09 01:25:37.731482 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:37.731462 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p94s9"] Jun 09 01:25:39.343201 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:39.343167 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2c53815-a195-4313-b5cc-09789410b152" path="/var/lib/kubelet/pods/e2c53815-a195-4313-b5cc-09789410b152/volumes" Jun 09 01:25:39.619730 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:39.619646 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:39.668613 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:39.668586 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:40.890426 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:40.890393 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8"] Jun 09 01:25:40.890804 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:40.890770 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2c53815-a195-4313-b5cc-09789410b152" containerName="manager" Jun 09 01:25:40.890804 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:40.890781 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2c53815-a195-4313-b5cc-09789410b152" containerName="manager" Jun 09 01:25:40.890888 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:40.890832 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2c53815-a195-4313-b5cc-09789410b152" containerName="manager" Jun 09 01:25:40.893349 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:40.893332 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:40.895516 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:40.895497 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-n24c8\"" Jun 09 01:25:40.905870 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:40.905844 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8"] Jun 09 01:25:40.924747 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:40.924706 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:41.001025 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.000996 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.001146 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.001028 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.001146 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.001050 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2d85acc-f111-4852-96bf-17ae3a89b667-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.001146 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.001075 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.001338 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.001168 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2d85acc-f111-4852-96bf-17ae3a89b667-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.001338 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.001274 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.001338 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.001324 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2d85acc-f111-4852-96bf-17ae3a89b667-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.001467 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.001348 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.001467 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.001368 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2srm\" (UniqueName: \"kubernetes.io/projected/f2d85acc-f111-4852-96bf-17ae3a89b667-kube-api-access-v2srm\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.102167 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.102142 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.102288 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.102170 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2srm\" (UniqueName: \"kubernetes.io/projected/f2d85acc-f111-4852-96bf-17ae3a89b667-kube-api-access-v2srm\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.102288 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.102201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.102288 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.102222 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.102288 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.102274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2d85acc-f111-4852-96bf-17ae3a89b667-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.102482 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.102313 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.102482 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.102346 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2d85acc-f111-4852-96bf-17ae3a89b667-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.102482 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.102397 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.102482 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.102422 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2d85acc-f111-4852-96bf-17ae3a89b667-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.102691 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.102605 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.102691 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.102640 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.102799 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.102737 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.102854 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.102794 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.103317 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.103296 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2d85acc-f111-4852-96bf-17ae3a89b667-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.104476 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.104448 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2d85acc-f111-4852-96bf-17ae3a89b667-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.104870 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.104854 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2d85acc-f111-4852-96bf-17ae3a89b667-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.110518 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.110492 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2d85acc-f111-4852-96bf-17ae3a89b667-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.110602 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.110536 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2srm\" (UniqueName: \"kubernetes.io/projected/f2d85acc-f111-4852-96bf-17ae3a89b667-kube-api-access-v2srm\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8pp8\" (UID: \"f2d85acc-f111-4852-96bf-17ae3a89b667\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.204431 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.204372 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:41.337141 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.337116 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8"] Jun 09 01:25:41.338966 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:25:41.338936 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d85acc_f111_4852_96bf_17ae3a89b667.slice/crio-9e6e393ea8caf21b995c21119aa884f69120917259885776be4511ff907fe9d7 WatchSource:0}: Error finding container 9e6e393ea8caf21b995c21119aa884f69120917259885776be4511ff907fe9d7: Status 404 returned error can't find the container with id 9e6e393ea8caf21b995c21119aa884f69120917259885776be4511ff907fe9d7 Jun 09 01:25:41.341127 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.341093 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:25:41.341198 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.341175 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:25:41.341240 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.341214 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:25:41.728174 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.728138 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" event={"ID":"f2d85acc-f111-4852-96bf-17ae3a89b667","Type":"ContainerStarted","Data":"a86b37fda9add026a33b3fb921838fcf2783eb8e14a39e46059047e2d19b0b5b"} Jun 09 01:25:41.728369 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.728204 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" event={"ID":"f2d85acc-f111-4852-96bf-17ae3a89b667","Type":"ContainerStarted","Data":"9e6e393ea8caf21b995c21119aa884f69120917259885776be4511ff907fe9d7"} Jun 09 01:25:41.746348 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:41.746304 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" podStartSLOduration=1.7462899539999999 podStartE2EDuration="1.746289954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:25:41.74505988 +0000 UTC m=+604.857059732" watchObservedRunningTime="2026-06-09 01:25:41.746289954 +0000 UTC m=+604.858289805" Jun 09 01:25:42.147208 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:42.147177 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:42.205347 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:42.205324 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:42.209958 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:42.209940 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:42.732997 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:42.732968 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:42.733775 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:42.733756 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:25:44.490398 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:44.490367 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:54.009024 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.008991 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:54.106176 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.106142 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:54.211269 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.211154 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:54.411342 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.411309 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:25:54.413841 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.413824 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-644bg" Jun 09 01:25:54.416094 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.416066 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 01:25:54.416211 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.416076 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f84hw\"" Jun 09 01:25:54.421979 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.421953 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:25:54.445751 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.445724 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:25:54.519075 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.519037 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0655ab64-7f63-49d5-ace9-90feb49dfec1-config-file\") pod \"limitador-limitador-54d6d988d5-644bg\" (UID: \"0655ab64-7f63-49d5-ace9-90feb49dfec1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-644bg" Jun 09 01:25:54.519295 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.519095 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kj8j\" (UniqueName: \"kubernetes.io/projected/0655ab64-7f63-49d5-ace9-90feb49dfec1-kube-api-access-4kj8j\") pod \"limitador-limitador-54d6d988d5-644bg\" (UID: \"0655ab64-7f63-49d5-ace9-90feb49dfec1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-644bg" Jun 09 01:25:54.619655 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.619614 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0655ab64-7f63-49d5-ace9-90feb49dfec1-config-file\") pod \"limitador-limitador-54d6d988d5-644bg\" (UID: \"0655ab64-7f63-49d5-ace9-90feb49dfec1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-644bg" Jun 09 01:25:54.619828 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.619665 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kj8j\" (UniqueName: \"kubernetes.io/projected/0655ab64-7f63-49d5-ace9-90feb49dfec1-kube-api-access-4kj8j\") pod \"limitador-limitador-54d6d988d5-644bg\" (UID: \"0655ab64-7f63-49d5-ace9-90feb49dfec1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-644bg" Jun 09 01:25:54.620224 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.620204 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0655ab64-7f63-49d5-ace9-90feb49dfec1-config-file\") pod \"limitador-limitador-54d6d988d5-644bg\" (UID: \"0655ab64-7f63-49d5-ace9-90feb49dfec1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-644bg" Jun 09 01:25:54.627702 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.627674 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kj8j\" (UniqueName: \"kubernetes.io/projected/0655ab64-7f63-49d5-ace9-90feb49dfec1-kube-api-access-4kj8j\") pod \"limitador-limitador-54d6d988d5-644bg\" (UID: \"0655ab64-7f63-49d5-ace9-90feb49dfec1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-644bg" Jun 09 01:25:54.725642 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.725562 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-644bg" Jun 09 01:25:54.849493 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.849465 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:54.855077 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.855054 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:25:54.856995 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:25:54.856965 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0655ab64_7f63_49d5_ace9_90feb49dfec1.slice/crio-ce684dd7732189ec0556560168caadb08e85da3e6f60607eaf869839772d69d7 WatchSource:0}: Error finding container ce684dd7732189ec0556560168caadb08e85da3e6f60607eaf869839772d69d7: Status 404 returned error can't find the container with id ce684dd7732189ec0556560168caadb08e85da3e6f60607eaf869839772d69d7 Jun 09 01:25:54.949609 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:54.949580 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:25:55.798098 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:55.797938 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-644bg" event={"ID":"0655ab64-7f63-49d5-ace9-90feb49dfec1","Type":"ContainerStarted","Data":"ce684dd7732189ec0556560168caadb08e85da3e6f60607eaf869839772d69d7"} Jun 09 01:25:57.810152 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:57.810115 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-644bg" event={"ID":"0655ab64-7f63-49d5-ace9-90feb49dfec1","Type":"ContainerStarted","Data":"e918019bf11e78d242cb8de5f6de89c9a41411bbdcc19512198fcc139da552c9"} Jun 09 01:25:57.810578 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:57.810277 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-644bg" Jun 09 01:25:57.825800 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:25:57.825759 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-644bg" podStartSLOduration=1.388944521 podStartE2EDuration="3.825747173s" totalImagesPullingTime="2.436802652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:25:57.824862289 +0000 UTC m=+620.936862133" watchObservedRunningTime="2026-06-09 01:25:57.825747173 +0000 UTC m=+620.937747023" Jun 09 01:26:08.816005 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:08.815976 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-644bg" Jun 09 01:26:11.157501 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:11.157467 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:26:11.255948 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:11.255912 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:26:11.600051 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:11.600021 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:26:20.893607 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:20.893572 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:26:20.996833 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:20.996802 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:26:21.123872 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:21.123835 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:26:43.887359 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:43.887326 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:26:43.986941 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:43.986910 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:26:44.288176 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:44.288088 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 01:26:44.292735 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:44.292712 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 01:26:44.295320 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:44.295293 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 01:26:44.295437 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:44.295371 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 01:26:44.295516 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:44.295434 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 01:26:44.296028 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:44.296015 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-xccg8\"" Jun 09 01:26:44.300339 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:44.300085 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 01:26:44.356618 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:44.356594 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xff59\" (UniqueName: \"kubernetes.io/projected/0598a975-b422-43af-9fd7-170ce7ec2102-kube-api-access-xff59\") pod \"maas-keycloak-0\" (UID: \"0598a975-b422-43af-9fd7-170ce7ec2102\") " pod="keycloak-system/maas-keycloak-0" Jun 09 01:26:44.457065 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:44.457035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xff59\" (UniqueName: \"kubernetes.io/projected/0598a975-b422-43af-9fd7-170ce7ec2102-kube-api-access-xff59\") pod \"maas-keycloak-0\" (UID: \"0598a975-b422-43af-9fd7-170ce7ec2102\") " pod="keycloak-system/maas-keycloak-0" Jun 09 01:26:44.464762 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:44.464738 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xff59\" (UniqueName: \"kubernetes.io/projected/0598a975-b422-43af-9fd7-170ce7ec2102-kube-api-access-xff59\") pod \"maas-keycloak-0\" (UID: \"0598a975-b422-43af-9fd7-170ce7ec2102\") " pod="keycloak-system/maas-keycloak-0" Jun 09 01:26:44.603766 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:44.603737 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 01:26:44.741781 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:44.741753 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 01:26:44.745105 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:26:44.745068 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0598a975_b422_43af_9fd7_170ce7ec2102.slice/crio-f137c538d19209e29e863edbacff14777998f6791c1043a7a4f4d455ab1fdbd6 WatchSource:0}: Error finding container f137c538d19209e29e863edbacff14777998f6791c1043a7a4f4d455ab1fdbd6: Status 404 returned error can't find the container with id f137c538d19209e29e863edbacff14777998f6791c1043a7a4f4d455ab1fdbd6 Jun 09 01:26:45.033892 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:45.033812 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0598a975-b422-43af-9fd7-170ce7ec2102","Type":"ContainerStarted","Data":"f137c538d19209e29e863edbacff14777998f6791c1043a7a4f4d455ab1fdbd6"} Jun 09 01:26:51.067664 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:51.067620 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0598a975-b422-43af-9fd7-170ce7ec2102","Type":"ContainerStarted","Data":"42809aeadb107738c781e9dd58fbcd904779cd37454add8d83d6874d4e7c2eed"} Jun 09 01:26:51.087021 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:51.086953 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.6593034 podStartE2EDuration="7.086935539s" totalImagesPullingTime="5.427632139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:26:51.084211343 +0000 UTC m=+674.196211193" watchObservedRunningTime="2026-06-09 01:26:51.086935539 +0000 UTC m=+674.198935389" Jun 09 01:26:51.604372 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:51.604315 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 01:26:51.606334 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:51.606295 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 01:26:52.604381 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:52.604332 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 01:26:53.604792 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:53.604739 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 01:26:54.603908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:54.603859 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 01:26:54.604288 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:54.604231 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 01:26:55.605664 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:55.605209 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 01:26:56.605265 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:56.605200 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 01:26:57.604208 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:57.604157 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 01:26:58.604339 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:58.604298 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 01:26:59.604262 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:26:59.604203 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 01:27:00.605210 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:00.605155 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 01:27:01.605065 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:01.605010 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 01:27:02.604219 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:02.604165 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 01:27:03.724649 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:03.724614 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 01:27:03.740927 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:03.740885 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 01:27:13.732286 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:13.732235 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 01:27:14.373027 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:14.372994 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:27:14.498438 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:14.498404 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:27:20.050706 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:20.050662 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:27:20.115897 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:20.115865 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:27:20.176024 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:20.175986 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:27:20.290723 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:20.290697 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:27:23.427844 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:23.427801 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:27:23.529345 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:23.529302 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:27:41.878076 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:41.877998 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:27:55.191457 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:55.191414 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:27:55.627440 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:55.627402 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:27:55.860005 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:27:55.859961 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:28:03.435138 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:03.435105 2567 generic.go:356] "Generic (PLEG): container finished" podID="f2d85acc-f111-4852-96bf-17ae3a89b667" containerID="a86b37fda9add026a33b3fb921838fcf2783eb8e14a39e46059047e2d19b0b5b" exitCode=0 Jun 09 01:28:03.435627 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:03.435184 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" event={"ID":"f2d85acc-f111-4852-96bf-17ae3a89b667","Type":"ContainerDied","Data":"a86b37fda9add026a33b3fb921838fcf2783eb8e14a39e46059047e2d19b0b5b"} Jun 09 01:28:03.435627 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:03.435621 2567 scope.go:117] "RemoveContainer" containerID="a86b37fda9add026a33b3fb921838fcf2783eb8e14a39e46059047e2d19b0b5b" Jun 09 01:28:03.436568 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:03.436541 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:28:03.436617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:03.436607 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:28:03.436652 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:03.436637 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:28:04.449187 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:04.449144 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" event={"ID":"f2d85acc-f111-4852-96bf-17ae3a89b667","Type":"ContainerStarted","Data":"13d98d8c8b10f59b9c63658777bd1d2898a52a79725a3f57a95f0a3ab5b3f7c5"} Jun 09 01:28:05.204907 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:05.204871 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:28:05.205105 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:05.205084 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-v8pp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jun 09 01:28:05.205152 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:05.205131 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" podUID="f2d85acc-f111-4852-96bf-17ae3a89b667" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jun 09 01:28:05.967642 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:05.967606 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 01:28:05.968067 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:05.967796 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" containerID="cri-o://42809aeadb107738c781e9dd58fbcd904779cd37454add8d83d6874d4e7c2eed" gracePeriod=30 Jun 09 01:28:06.205120 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:06.205085 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-v8pp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jun 09 01:28:06.205319 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:06.205142 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" podUID="f2d85acc-f111-4852-96bf-17ae3a89b667" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jun 09 01:28:07.205119 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:07.205072 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-v8pp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jun 09 01:28:07.205529 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:07.205154 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" podUID="f2d85acc-f111-4852-96bf-17ae3a89b667" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jun 09 01:28:07.471803 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:07.471719 2567 generic.go:356] "Generic (PLEG): container finished" podID="0598a975-b422-43af-9fd7-170ce7ec2102" containerID="42809aeadb107738c781e9dd58fbcd904779cd37454add8d83d6874d4e7c2eed" exitCode=143 Jun 09 01:28:07.471803 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:07.471789 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0598a975-b422-43af-9fd7-170ce7ec2102","Type":"ContainerDied","Data":"42809aeadb107738c781e9dd58fbcd904779cd37454add8d83d6874d4e7c2eed"} Jun 09 01:28:08.022657 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.022634 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 01:28:08.113765 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.113739 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xff59\" (UniqueName: \"kubernetes.io/projected/0598a975-b422-43af-9fd7-170ce7ec2102-kube-api-access-xff59\") pod \"0598a975-b422-43af-9fd7-170ce7ec2102\" (UID: \"0598a975-b422-43af-9fd7-170ce7ec2102\") " Jun 09 01:28:08.115755 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.115734 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0598a975-b422-43af-9fd7-170ce7ec2102-kube-api-access-xff59" (OuterVolumeSpecName: "kube-api-access-xff59") pod "0598a975-b422-43af-9fd7-170ce7ec2102" (UID: "0598a975-b422-43af-9fd7-170ce7ec2102"). InnerVolumeSpecName "kube-api-access-xff59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:28:08.204852 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.204764 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-v8pp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jun 09 01:28:08.204852 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.204824 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" podUID="f2d85acc-f111-4852-96bf-17ae3a89b667" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jun 09 01:28:08.214723 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.214702 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xff59\" (UniqueName: \"kubernetes.io/projected/0598a975-b422-43af-9fd7-170ce7ec2102-kube-api-access-xff59\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:28:08.483702 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.483630 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 01:28:08.483702 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.483647 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0598a975-b422-43af-9fd7-170ce7ec2102","Type":"ContainerDied","Data":"f137c538d19209e29e863edbacff14777998f6791c1043a7a4f4d455ab1fdbd6"} Jun 09 01:28:08.483905 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.483722 2567 scope.go:117] "RemoveContainer" containerID="42809aeadb107738c781e9dd58fbcd904779cd37454add8d83d6874d4e7c2eed" Jun 09 01:28:08.503323 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.503301 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 01:28:08.509131 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.509111 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 01:28:08.528830 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.528803 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 01:28:08.529166 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.529154 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" Jun 09 01:28:08.529206 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.529168 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" Jun 09 01:28:08.529237 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.529228 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" containerName="keycloak" Jun 09 01:28:08.532172 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.532156 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 01:28:08.534612 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.534593 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 01:28:08.534775 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.534613 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 01:28:08.534775 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.534643 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 01:28:08.534885 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.534842 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-xccg8\"" Jun 09 01:28:08.534969 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.534952 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 01:28:08.550081 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.549264 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 01:28:08.618642 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.618605 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f0fc6dc7-4253-4431-90df-26b20d3799fc-test-realms\") pod \"maas-keycloak-0\" (UID: \"f0fc6dc7-4253-4431-90df-26b20d3799fc\") " pod="keycloak-system/maas-keycloak-0" Jun 09 01:28:08.618791 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.618669 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz2cq\" (UniqueName: \"kubernetes.io/projected/f0fc6dc7-4253-4431-90df-26b20d3799fc-kube-api-access-gz2cq\") pod \"maas-keycloak-0\" (UID: \"f0fc6dc7-4253-4431-90df-26b20d3799fc\") " pod="keycloak-system/maas-keycloak-0" Jun 09 01:28:08.719750 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.719705 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f0fc6dc7-4253-4431-90df-26b20d3799fc-test-realms\") pod \"maas-keycloak-0\" (UID: \"f0fc6dc7-4253-4431-90df-26b20d3799fc\") " pod="keycloak-system/maas-keycloak-0" Jun 09 01:28:08.719911 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.719764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz2cq\" (UniqueName: \"kubernetes.io/projected/f0fc6dc7-4253-4431-90df-26b20d3799fc-kube-api-access-gz2cq\") pod \"maas-keycloak-0\" (UID: \"f0fc6dc7-4253-4431-90df-26b20d3799fc\") " pod="keycloak-system/maas-keycloak-0" Jun 09 01:28:08.720423 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.720406 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f0fc6dc7-4253-4431-90df-26b20d3799fc-test-realms\") pod \"maas-keycloak-0\" (UID: \"f0fc6dc7-4253-4431-90df-26b20d3799fc\") " pod="keycloak-system/maas-keycloak-0" Jun 09 01:28:08.727785 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.727755 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz2cq\" (UniqueName: \"kubernetes.io/projected/f0fc6dc7-4253-4431-90df-26b20d3799fc-kube-api-access-gz2cq\") pod \"maas-keycloak-0\" (UID: \"f0fc6dc7-4253-4431-90df-26b20d3799fc\") " pod="keycloak-system/maas-keycloak-0" Jun 09 01:28:08.859329 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.859290 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 01:28:08.993490 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.993463 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 01:28:08.995545 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:28:08.995510 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0fc6dc7_4253_4431_90df_26b20d3799fc.slice/crio-8cfd56af32dcdbc7b49e371f29dc42cab380f88a18d55f44c201d6f6f25457fe WatchSource:0}: Error finding container 8cfd56af32dcdbc7b49e371f29dc42cab380f88a18d55f44c201d6f6f25457fe: Status 404 returned error can't find the container with id 8cfd56af32dcdbc7b49e371f29dc42cab380f88a18d55f44c201d6f6f25457fe Jun 09 01:28:08.997040 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:08.997018 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 01:28:09.209412 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:09.209337 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:28:09.209683 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:09.209653 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:28:09.210437 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:09.210419 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8pp8" Jun 09 01:28:09.344007 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:09.343967 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0598a975-b422-43af-9fd7-170ce7ec2102" path="/var/lib/kubelet/pods/0598a975-b422-43af-9fd7-170ce7ec2102/volumes" Jun 09 01:28:09.489718 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:09.489630 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f0fc6dc7-4253-4431-90df-26b20d3799fc","Type":"ContainerStarted","Data":"1d0885ec0bfb4cfb2fc17ea173fdcd4fabc05cabf23dd7df44c245ed69e69e76"} Jun 09 01:28:09.489718 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:09.489685 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f0fc6dc7-4253-4431-90df-26b20d3799fc","Type":"ContainerStarted","Data":"8cfd56af32dcdbc7b49e371f29dc42cab380f88a18d55f44c201d6f6f25457fe"} Jun 09 01:28:09.507958 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:09.507914 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.135392334 podStartE2EDuration="1.50790136s" totalImagesPullingTime="372.509026ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:28:09.506231352 +0000 UTC m=+752.618231204" watchObservedRunningTime="2026-06-09 01:28:09.50790136 +0000 UTC m=+752.619901211" Jun 09 01:28:09.859804 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:09.859765 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 01:28:09.861347 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:09.861307 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.37:9000/health/started\": dial tcp 10.132.0.37:9000: connect: connection refused" Jun 09 01:28:10.860016 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:10.859958 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.37:9000/health/started\": dial tcp 10.132.0.37:9000: connect: connection refused" Jun 09 01:28:11.860812 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:11.860759 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.37:9000/health/started\": dial tcp 10.132.0.37:9000: connect: connection refused" Jun 09 01:28:12.860386 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:12.860332 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.37:9000/health/started\": dial tcp 10.132.0.37:9000: connect: connection refused" Jun 09 01:28:13.860181 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:13.860123 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.37:9000/health/started\": dial tcp 10.132.0.37:9000: connect: connection refused" Jun 09 01:28:14.860177 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:14.860122 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.37:9000/health/started\": dial tcp 10.132.0.37:9000: connect: connection refused" Jun 09 01:28:15.860045 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:15.859987 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.37:9000/health/started\": dial tcp 10.132.0.37:9000: connect: connection refused" Jun 09 01:28:16.860042 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:16.859999 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.37:9000/health/started\": dial tcp 10.132.0.37:9000: connect: connection refused" Jun 09 01:28:17.860617 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:17.860561 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.37:9000/health/started\": dial tcp 10.132.0.37:9000: connect: connection refused" Jun 09 01:28:18.860055 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:18.860018 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 01:28:18.860362 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:18.860332 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.37:9000/health/started\": dial tcp 10.132.0.37:9000: connect: connection refused" Jun 09 01:28:19.859927 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:19.859865 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.37:9000/health/started\": dial tcp 10.132.0.37:9000: connect: connection refused" Jun 09 01:28:20.860605 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:20.860561 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.37:9000/health/started\": dial tcp 10.132.0.37:9000: connect: connection refused" Jun 09 01:28:21.860501 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:21.860450 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.37:9000/health/started\": dial tcp 10.132.0.37:9000: connect: connection refused" Jun 09 01:28:22.979201 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:22.979165 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 01:28:22.996360 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:22.996309 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 01:28:32.984335 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:32.984283 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f0fc6dc7-4253-4431-90df-26b20d3799fc" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 01:28:42.986101 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:42.986064 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 01:28:55.244379 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:55.244337 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:28:55.354201 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:55.354164 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:28:58.650824 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:58.650745 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:28:58.697039 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:58.697015 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:28:59.548429 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:59.548393 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:28:59.832294 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:28:59.832246 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:29:07.924337 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:29:07.924305 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:29:08.395934 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:29:08.395902 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:29:18.520514 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:29:18.520481 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:29:18.568048 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:29:18.568002 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:29:27.153182 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:29:27.153147 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:29:27.596355 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:29:27.596319 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:29:48.218788 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:29:48.218754 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:29:48.696494 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:29:48.696455 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:29:56.306048 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:29:56.306011 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:29:56.351977 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:29:56.351941 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:30:05.831982 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:05.831952 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:30:06.592199 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:06.592165 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:30:11.008356 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.008314 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw"] Jun 09 01:30:11.012097 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.012074 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.014335 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.014312 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 09 01:30:11.014452 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.014321 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 01:30:11.015324 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.015306 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 01:30:11.015415 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.015342 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xbzpq\"" Jun 09 01:30:11.019685 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.019310 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw"] Jun 09 01:30:11.034242 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.034215 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:30:11.143859 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.143830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49345975-4345-4a78-9505-9df092a1eac4-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.143999 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.143889 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc4gc\" (UniqueName: \"kubernetes.io/projected/49345975-4345-4a78-9505-9df092a1eac4-kube-api-access-kc4gc\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.143999 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.143910 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49345975-4345-4a78-9505-9df092a1eac4-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.143999 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.143933 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49345975-4345-4a78-9505-9df092a1eac4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.143999 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.143956 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49345975-4345-4a78-9505-9df092a1eac4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.143999 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.143971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49345975-4345-4a78-9505-9df092a1eac4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.245356 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.245321 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49345975-4345-4a78-9505-9df092a1eac4-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.245499 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.245405 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc4gc\" (UniqueName: \"kubernetes.io/projected/49345975-4345-4a78-9505-9df092a1eac4-kube-api-access-kc4gc\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.245499 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.245430 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49345975-4345-4a78-9505-9df092a1eac4-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.245499 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.245452 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49345975-4345-4a78-9505-9df092a1eac4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.245648 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.245510 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49345975-4345-4a78-9505-9df092a1eac4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.245648 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.245539 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49345975-4345-4a78-9505-9df092a1eac4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.245756 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.245701 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49345975-4345-4a78-9505-9df092a1eac4-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.245874 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.245851 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49345975-4345-4a78-9505-9df092a1eac4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.245938 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.245909 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49345975-4345-4a78-9505-9df092a1eac4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.247734 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.247709 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49345975-4345-4a78-9505-9df092a1eac4-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.247932 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.247916 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49345975-4345-4a78-9505-9df092a1eac4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.252422 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.252398 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc4gc\" (UniqueName: \"kubernetes.io/projected/49345975-4345-4a78-9505-9df092a1eac4-kube-api-access-kc4gc\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-htvxw\" (UID: \"49345975-4345-4a78-9505-9df092a1eac4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.323098 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.323075 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:11.457375 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:11.457350 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw"] Jun 09 01:30:11.459493 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:30:11.459460 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49345975_4345_4a78_9505_9df092a1eac4.slice/crio-b818e793bba10c62eb91b2b5c571080f189bf7bba7434a08f25163d2a07d5d44 WatchSource:0}: Error finding container b818e793bba10c62eb91b2b5c571080f189bf7bba7434a08f25163d2a07d5d44: Status 404 returned error can't find the container with id b818e793bba10c62eb91b2b5c571080f189bf7bba7434a08f25163d2a07d5d44 Jun 09 01:30:12.096829 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:12.096783 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" event={"ID":"49345975-4345-4a78-9505-9df092a1eac4","Type":"ContainerStarted","Data":"b818e793bba10c62eb91b2b5c571080f189bf7bba7434a08f25163d2a07d5d44"} Jun 09 01:30:12.202178 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:12.202143 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:30:16.121506 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:16.121469 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" event={"ID":"49345975-4345-4a78-9505-9df092a1eac4","Type":"ContainerStarted","Data":"e28f5d312defcfae5b01441365af4053f954bd5f73dd687cf19b3ec9fd247063"} Jun 09 01:30:18.132034 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:18.131950 2567 generic.go:356] "Generic (PLEG): container finished" podID="49345975-4345-4a78-9505-9df092a1eac4" containerID="e28f5d312defcfae5b01441365af4053f954bd5f73dd687cf19b3ec9fd247063" exitCode=0 Jun 09 01:30:18.132034 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:18.132027 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" event={"ID":"49345975-4345-4a78-9505-9df092a1eac4","Type":"ContainerDied","Data":"e28f5d312defcfae5b01441365af4053f954bd5f73dd687cf19b3ec9fd247063"} Jun 09 01:30:20.144266 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:20.144218 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" event={"ID":"49345975-4345-4a78-9505-9df092a1eac4","Type":"ContainerStarted","Data":"c4e7bc429e2dda1797bd44998cefd999187607ade1d5681265d4b8822bed8535"} Jun 09 01:30:20.163053 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:20.162990 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" podStartSLOduration=2.757434103 podStartE2EDuration="10.162974424s" totalImagesPullingTime="5.169495068s" totalInitContainerRuntime="2.236045253s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:30:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:30:20.161444755 +0000 UTC m=+883.273444596" watchObservedRunningTime="2026-06-09 01:30:20.162974424 +0000 UTC m=+883.274974275" Jun 09 01:30:21.323687 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:21.323643 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:21.323687 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:21.323699 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:21.336193 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:21.336172 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:22.164953 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:22.164919 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-htvxw" Jun 09 01:30:37.360580 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:37.360502 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:30:37.360959 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:30:37.360786 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:31:18.031503 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:31:18.031467 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:31:19.123120 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:31:19.123079 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:31:19.223709 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:31:19.223677 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:31:29.181470 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:31:29.181397 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:31:30.407218 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:31:30.407182 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:31:30.461049 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:31:30.461017 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:31:38.697518 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:31:38.697479 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:31:41.803040 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:31:41.802998 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:31:50.291324 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:31:50.291280 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:32:00.798510 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:32:00.798429 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:32:09.194950 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:32:09.194914 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:32:19.891207 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:32:19.891167 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:32:29.196630 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:32:29.196598 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:32:39.289405 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:32:39.289369 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:32:47.092880 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:32:47.092835 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:32:48.694188 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:32:48.694152 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:33:13.992156 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:33:13.992121 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:33:16.994550 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:33:16.994517 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:33:30.138426 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:33:30.138349 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:33:30.238448 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:33:30.238416 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:33:30.338776 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:33:30.338740 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:33:38.612139 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:33:38.612102 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:33:44.248181 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:33:44.248145 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:33:44.308158 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:33:44.308126 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:33:53.102897 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:33:53.102864 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:34:09.288142 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:34:09.288110 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:34:16.338862 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:34:16.338821 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:34:16.443367 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:34:16.443292 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:34:16.539354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:34:16.539326 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:34:40.280020 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:34:40.279988 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:34:46.008333 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:34:46.008301 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:34:46.108373 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:34:46.108331 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:34:46.206966 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:34:46.206935 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:34:46.373366 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:34:46.373337 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:34:46.473848 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:34:46.473820 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:34:47.494714 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:34:47.494675 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:34:54.000746 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:34:54.000699 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:35:02.838638 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:02.838547 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:35:02.946392 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:02.946351 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:35:03.060707 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:03.060673 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:35:04.596160 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:04.596125 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:35:08.788999 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:08.788967 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:35:08.889414 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:08.889383 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:35:16.929041 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:16.929004 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:35:17.029163 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:17.029133 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:35:17.127410 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:17.127376 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:35:17.227779 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:17.227688 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:35:18.298666 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:18.298636 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:35:33.642642 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:33.642606 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:35:33.749407 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:33.749374 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:35:33.859003 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:33.858963 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:35:34.591751 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:34.591714 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:35:37.390786 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:37.390758 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:35:37.391180 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:37.391028 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:35:39.552138 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:39.552102 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:35:39.600227 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:35:39.600192 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:36:00.090619 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:36:00.090581 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:36:00.189137 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:36:00.189106 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:36:00.298500 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:36:00.298469 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:36:05.892114 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:36:05.892084 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:36:05.941580 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:36:05.941553 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:36:06.012551 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:36:06.012499 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:36:06.109520 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:36:06.109492 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:36:06.238037 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:36:06.237968 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:36:12.042157 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:36:12.042125 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:36:12.089794 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:36:12.089757 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:36:13.095284 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:36:13.095233 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:36:16.092175 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:36:16.092136 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:36:38.322966 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:36:38.322889 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:36:47.396364 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:36:47.396331 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:37:03.788454 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:37:03.788411 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:37:12.790839 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:37:12.790804 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:37:29.591315 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:37:29.591278 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:37:38.599061 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:37:38.599015 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:38:09.734956 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:38:09.734873 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:38:10.789493 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:38:10.789460 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:38:18.591667 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:38:18.591635 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:38:21.092817 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:38:21.092781 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:38:27.789052 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:38:27.789016 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:38:35.593568 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:38:35.593535 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:38:44.092915 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:38:44.092882 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:38:52.393408 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:38:52.393375 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:38:54.596111 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:38:54.596074 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:38:58.812705 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:38:58.812626 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:38:58.858093 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:38:58.858065 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:39:01.089982 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:39:01.089946 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:39:05.211864 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:39:05.211819 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:39:05.259204 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:39:05.259171 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:39:12.289909 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:39:12.289874 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:39:49.387985 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:39:49.387947 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:39:51.394501 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:39:51.394469 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:39:58.988956 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:39:58.988921 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:40:01.792267 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:40:01.792166 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:40:10.389164 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:40:10.389129 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:40:19.089750 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:40:19.089715 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:40:28.994058 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:40:28.994022 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:40:37.419265 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:40:37.419223 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:40:37.422087 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:40:37.422065 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:40:37.588872 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:40:37.588842 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:40:45.696198 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:40:45.696162 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:40:49.188044 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:40:49.188009 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:40:54.191893 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:40:54.191859 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:41:03.191377 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:41:03.191294 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:41:10.920207 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:41:10.920166 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:41:11.691305 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:41:11.691244 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:41:20.693907 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:41:20.693875 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:41:29.596223 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:41:29.596187 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:41:32.914069 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:41:32.914026 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:41:38.129104 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:41:38.129067 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:41:46.796943 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:41:46.796908 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:41:56.090278 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:41:56.090217 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:42:03.797396 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:42:03.797366 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:42:13.294986 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:42:13.294949 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:42:21.689575 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:42:21.689540 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:43:13.458312 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.458276 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t"] Jun 09 01:43:13.458816 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.458466 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" podUID="97eb0195-555f-4018-9915-3cbd42d4d7fa" containerName="manager" containerID="cri-o://e6fbba4222b04e7adff82c672f57cd2be518b76317ce0e3c2da4b10d92a5a385" gracePeriod=10 Jun 09 01:43:13.698078 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.698056 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" Jun 09 01:43:13.724675 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.724608 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97eb0195-555f-4018-9915-3cbd42d4d7fa-extensions-socket-volume\") pod \"97eb0195-555f-4018-9915-3cbd42d4d7fa\" (UID: \"97eb0195-555f-4018-9915-3cbd42d4d7fa\") " Jun 09 01:43:13.724675 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.724639 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j7mc\" (UniqueName: \"kubernetes.io/projected/97eb0195-555f-4018-9915-3cbd42d4d7fa-kube-api-access-7j7mc\") pod \"97eb0195-555f-4018-9915-3cbd42d4d7fa\" (UID: \"97eb0195-555f-4018-9915-3cbd42d4d7fa\") " Jun 09 01:43:13.724957 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.724934 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97eb0195-555f-4018-9915-3cbd42d4d7fa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "97eb0195-555f-4018-9915-3cbd42d4d7fa" (UID: "97eb0195-555f-4018-9915-3cbd42d4d7fa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:43:13.726761 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.726728 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97eb0195-555f-4018-9915-3cbd42d4d7fa-kube-api-access-7j7mc" (OuterVolumeSpecName: "kube-api-access-7j7mc") pod "97eb0195-555f-4018-9915-3cbd42d4d7fa" (UID: "97eb0195-555f-4018-9915-3cbd42d4d7fa"). InnerVolumeSpecName "kube-api-access-7j7mc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:43:13.802492 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.802462 2567 generic.go:356] "Generic (PLEG): container finished" podID="97eb0195-555f-4018-9915-3cbd42d4d7fa" containerID="e6fbba4222b04e7adff82c672f57cd2be518b76317ce0e3c2da4b10d92a5a385" exitCode=0 Jun 09 01:43:13.802624 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.802507 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" Jun 09 01:43:13.802624 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.802539 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" event={"ID":"97eb0195-555f-4018-9915-3cbd42d4d7fa","Type":"ContainerDied","Data":"e6fbba4222b04e7adff82c672f57cd2be518b76317ce0e3c2da4b10d92a5a385"} Jun 09 01:43:13.802624 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.802590 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t" event={"ID":"97eb0195-555f-4018-9915-3cbd42d4d7fa","Type":"ContainerDied","Data":"1eb18684cee43891cfd72777cbb8d1a043e27c05a10af7a44d0f94d014b6344a"} Jun 09 01:43:13.802624 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.802613 2567 scope.go:117] "RemoveContainer" containerID="e6fbba4222b04e7adff82c672f57cd2be518b76317ce0e3c2da4b10d92a5a385" Jun 09 01:43:13.811455 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.811439 2567 scope.go:117] "RemoveContainer" containerID="e6fbba4222b04e7adff82c672f57cd2be518b76317ce0e3c2da4b10d92a5a385" Jun 09 01:43:13.811696 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:43:13.811679 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6fbba4222b04e7adff82c672f57cd2be518b76317ce0e3c2da4b10d92a5a385\": container with ID starting with e6fbba4222b04e7adff82c672f57cd2be518b76317ce0e3c2da4b10d92a5a385 not found: ID does not exist" containerID="e6fbba4222b04e7adff82c672f57cd2be518b76317ce0e3c2da4b10d92a5a385" Jun 09 01:43:13.811751 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.811705 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6fbba4222b04e7adff82c672f57cd2be518b76317ce0e3c2da4b10d92a5a385"} err="failed to get container status \"e6fbba4222b04e7adff82c672f57cd2be518b76317ce0e3c2da4b10d92a5a385\": rpc error: code = NotFound desc = could not find container \"e6fbba4222b04e7adff82c672f57cd2be518b76317ce0e3c2da4b10d92a5a385\": container with ID starting with e6fbba4222b04e7adff82c672f57cd2be518b76317ce0e3c2da4b10d92a5a385 not found: ID does not exist" Jun 09 01:43:13.822479 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.822458 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t"] Jun 09 01:43:13.825159 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.825141 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97eb0195-555f-4018-9915-3cbd42d4d7fa-extensions-socket-volume\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:43:13.825277 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.825161 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j7mc\" (UniqueName: \"kubernetes.io/projected/97eb0195-555f-4018-9915-3cbd42d4d7fa-kube-api-access-7j7mc\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:43:13.826463 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:13.826444 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ps24t"] Jun 09 01:43:15.343554 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:43:15.343526 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97eb0195-555f-4018-9915-3cbd42d4d7fa" path="/var/lib/kubelet/pods/97eb0195-555f-4018-9915-3cbd42d4d7fa/volumes" Jun 09 01:44:19.590713 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:19.590640 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4"] Jun 09 01:44:19.591143 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:19.591083 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97eb0195-555f-4018-9915-3cbd42d4d7fa" containerName="manager" Jun 09 01:44:19.591143 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:19.591098 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="97eb0195-555f-4018-9915-3cbd42d4d7fa" containerName="manager" Jun 09 01:44:19.591217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:19.591159 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="97eb0195-555f-4018-9915-3cbd42d4d7fa" containerName="manager" Jun 09 01:44:19.594121 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:19.594105 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4" Jun 09 01:44:19.597386 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:19.597367 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-std87\"" Jun 09 01:44:19.607712 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:19.607690 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4"] Jun 09 01:44:19.660002 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:19.659979 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e252a9fd-d149-428f-9820-ed3a4a0db98f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jrxp4\" (UID: \"e252a9fd-d149-428f-9820-ed3a4a0db98f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4" Jun 09 01:44:19.660135 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:19.660014 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9jpn\" (UniqueName: \"kubernetes.io/projected/e252a9fd-d149-428f-9820-ed3a4a0db98f-kube-api-access-z9jpn\") pod \"kuadrant-operator-controller-manager-86878c769f-jrxp4\" (UID: \"e252a9fd-d149-428f-9820-ed3a4a0db98f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4" Jun 09 01:44:19.761317 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:19.761276 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e252a9fd-d149-428f-9820-ed3a4a0db98f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jrxp4\" (UID: \"e252a9fd-d149-428f-9820-ed3a4a0db98f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4" Jun 09 01:44:19.761434 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:19.761330 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9jpn\" (UniqueName: \"kubernetes.io/projected/e252a9fd-d149-428f-9820-ed3a4a0db98f-kube-api-access-z9jpn\") pod \"kuadrant-operator-controller-manager-86878c769f-jrxp4\" (UID: \"e252a9fd-d149-428f-9820-ed3a4a0db98f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4" Jun 09 01:44:19.761679 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:19.761658 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e252a9fd-d149-428f-9820-ed3a4a0db98f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jrxp4\" (UID: \"e252a9fd-d149-428f-9820-ed3a4a0db98f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4" Jun 09 01:44:19.769443 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:19.769413 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9jpn\" (UniqueName: \"kubernetes.io/projected/e252a9fd-d149-428f-9820-ed3a4a0db98f-kube-api-access-z9jpn\") pod \"kuadrant-operator-controller-manager-86878c769f-jrxp4\" (UID: \"e252a9fd-d149-428f-9820-ed3a4a0db98f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4" Jun 09 01:44:19.904557 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:19.904493 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4" Jun 09 01:44:20.032909 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:20.032885 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4"] Jun 09 01:44:20.034727 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:44:20.034701 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode252a9fd_d149_428f_9820_ed3a4a0db98f.slice/crio-948a2d21dcad80551394fd75444a1fb1fa1725022fe2f093df385c8296fec93b WatchSource:0}: Error finding container 948a2d21dcad80551394fd75444a1fb1fa1725022fe2f093df385c8296fec93b: Status 404 returned error can't find the container with id 948a2d21dcad80551394fd75444a1fb1fa1725022fe2f093df385c8296fec93b Jun 09 01:44:20.099685 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:20.099654 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4" event={"ID":"e252a9fd-d149-428f-9820-ed3a4a0db98f","Type":"ContainerStarted","Data":"948a2d21dcad80551394fd75444a1fb1fa1725022fe2f093df385c8296fec93b"} Jun 09 01:44:21.105726 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:21.105691 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4" event={"ID":"e252a9fd-d149-428f-9820-ed3a4a0db98f","Type":"ContainerStarted","Data":"3986c52ada26e12284d23df593b3665366f7840daab877648eec9224003452e4"} Jun 09 01:44:21.106088 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:21.105778 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4" Jun 09 01:44:21.123895 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:21.123851 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4" podStartSLOduration=2.123836187 podStartE2EDuration="2.123836187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:44:21.122300486 +0000 UTC m=+1724.234300339" watchObservedRunningTime="2026-06-09 01:44:21.123836187 +0000 UTC m=+1724.235836036" Jun 09 01:44:32.112451 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:32.112423 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrxp4" Jun 09 01:44:39.496531 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:39.496496 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:44:44.590748 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:44:44.590708 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:45:10.195566 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:45:10.195531 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:45:14.797843 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:45:14.797807 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:45:24.291143 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:45:24.291101 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:45:34.894233 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:45:34.894195 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:45:37.453155 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:45:37.453125 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:45:37.456213 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:45:37.456191 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:45:43.393462 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:45:43.393428 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:45:54.491761 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:45:54.491726 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:46:02.889486 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:46:02.889449 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:46:13.497717 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:46:13.497682 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:46:22.201171 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:46:22.201134 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:46:32.796703 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:46:32.796665 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:46:42.204786 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:46:42.204751 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:46:46.008299 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:46:46.008268 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:47:15.154143 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:47:15.154048 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:47:45.742778 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:47:45.742735 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:47:57.899457 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:47:57.899426 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:48:06.425101 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:48:06.425065 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:48:14.899960 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:48:14.899927 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:48:23.989221 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:48:23.989182 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:48:32.206390 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:48:32.206311 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:48:38.178164 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:48:38.178125 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:48:38.279410 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:48:38.279382 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:48:42.897451 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:48:42.897418 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:48:51.996896 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:48:51.996860 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:48:54.777602 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:48:54.777563 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:48:54.878277 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:48:54.878197 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:48:59.398001 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:48:59.397968 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:49:08.198635 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:49:08.198598 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:49:16.502654 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:49:16.502623 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:49:24.788826 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:49:24.788793 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:49:35.197062 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:49:35.197024 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:49:52.910801 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:49:52.910764 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:50:01.392855 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:50:01.392785 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:50:09.998292 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:50:09.998259 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:50:13.740079 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:50:13.740039 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:50:18.293901 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:50:18.293868 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:50:35.494771 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:50:35.494736 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:50:37.482401 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:50:37.482374 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:50:37.487081 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:50:37.487063 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:50:43.801653 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:50:43.801619 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:50:52.693759 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:50:52.693720 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:51:01.099611 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:51:01.099574 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:51:10.191202 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:51:10.191163 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:51:18.595303 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:51:18.595271 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:51:27.908015 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:51:27.907921 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:51:38.910502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:51:38.910467 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:51:48.096918 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:51:48.096875 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:51:58.591989 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:51:58.591953 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:52:08.196033 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:52:08.195995 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:52:13.897208 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:52:13.897174 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:52:22.798392 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:52:22.798360 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:52:28.597107 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:52:28.597072 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:52:44.496643 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:52:44.496610 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:52:53.501467 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:52:53.501427 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:53:01.140764 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:01.140684 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:02.392931 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:02.392892 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:53:06.471646 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:06.471609 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:07.798247 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:07.798214 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:53:30.729956 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:30.729902 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:31.693584 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:31.693548 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:53:43.864014 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:43.863972 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:44.098545 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:44.098508 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:53:45.395281 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.395236 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx"] Jun 09 01:53:45.398908 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.398882 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.401299 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.401275 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d9890fd0-openshift-default-dockercfg-r2btk\"" Jun 09 01:53:45.418909 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.418886 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx"] Jun 09 01:53:45.425661 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.425639 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:45.441290 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.441262 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-credential-socket\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.441440 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.441310 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-workload-certs\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.441440 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.441339 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-workload-socket\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.441440 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.441392 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-podinfo\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.441440 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.441418 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/243d08d0-d02f-4630-b90c-e0016b6f23c1-istiod-ca-cert\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.441661 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.441458 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4pnv\" (UniqueName: \"kubernetes.io/projected/243d08d0-d02f-4630-b90c-e0016b6f23c1-kube-api-access-k4pnv\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.441661 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.441489 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-data\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.441661 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.441522 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-envoy\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.441661 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.441541 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-token\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.485549 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.485525 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:45.542977 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.542937 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4pnv\" (UniqueName: \"kubernetes.io/projected/243d08d0-d02f-4630-b90c-e0016b6f23c1-kube-api-access-k4pnv\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.543167 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.542988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-data\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.543167 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.543010 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-envoy\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.543167 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.543025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-token\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.543167 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.543050 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-credential-socket\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.543167 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.543080 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-workload-certs\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.543167 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.543115 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-workload-socket\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.543167 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.543153 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-podinfo\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.543570 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.543189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/243d08d0-d02f-4630-b90c-e0016b6f23c1-istiod-ca-cert\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.543570 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.543525 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-data\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.543903 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.543876 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/243d08d0-d02f-4630-b90c-e0016b6f23c1-istiod-ca-cert\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.544062 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.544007 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-workload-certs\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.544228 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.544209 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-credential-socket\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.544436 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.544413 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-workload-socket\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.545585 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.545564 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-envoy\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.546074 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.546052 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-podinfo\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.562949 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.562917 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4pnv\" (UniqueName: \"kubernetes.io/projected/243d08d0-d02f-4630-b90c-e0016b6f23c1-kube-api-access-k4pnv\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.571768 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.571740 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-token\") pod \"e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.624926 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.624903 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:45.708643 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.708566 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:45.710498 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.710478 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:45.856846 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.856819 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx"] Jun 09 01:53:45.858914 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:53:45.858887 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243d08d0_d02f_4630_b90c_e0016b6f23c1.slice/crio-a9684bb2878fca7d958cd3d23b0062a6596d961933a0a14991fd4396245098e0 WatchSource:0}: Error finding container a9684bb2878fca7d958cd3d23b0062a6596d961933a0a14991fd4396245098e0: Status 404 returned error can't find the container with id a9684bb2878fca7d958cd3d23b0062a6596d961933a0a14991fd4396245098e0 Jun 09 01:53:45.861049 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.861016 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:53:45.861129 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.861085 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:53:45.861129 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:45.861115 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:53:46.153173 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:46.153133 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:46.724387 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:46.724350 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" event={"ID":"243d08d0-d02f-4630-b90c-e0016b6f23c1","Type":"ContainerStarted","Data":"7af10d0cbe2c1362b9ec1aa0eaf0d2ce8a44209e0d281e5478dc7992e25d5763"} Jun 09 01:53:46.724769 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:46.724400 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" event={"ID":"243d08d0-d02f-4630-b90c-e0016b6f23c1","Type":"ContainerStarted","Data":"a9684bb2878fca7d958cd3d23b0062a6596d961933a0a14991fd4396245098e0"} Jun 09 01:53:46.766139 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:46.766088 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" podStartSLOduration=1.766071114 podStartE2EDuration="1.766071114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:53:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:53:46.76165404 +0000 UTC m=+2289.873653890" watchObservedRunningTime="2026-06-09 01:53:46.766071114 +0000 UTC m=+2289.878070963" Jun 09 01:53:46.899695 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:46.899654 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:47.122755 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:47.122718 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:47.223373 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:47.223338 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:47.493166 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:47.493084 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:47.711217 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:47.711189 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:47.716001 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:47.715975 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:47.728813 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:47.728791 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:47.729456 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:47.729440 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:47.805473 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:47.805440 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-644bg"] Jun 09 01:53:47.862878 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:47.862848 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:48.411980 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:48.411946 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:48.880483 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:48.880454 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:49.012593 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:49.012558 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:49.730987 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:49.730944 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:50.205434 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:50.205395 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:51.655799 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:51.655759 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:51.814405 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:51.814371 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx"] Jun 09 01:53:51.814600 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:51.814576 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" podUID="243d08d0-d02f-4630-b90c-e0016b6f23c1" containerName="istio-proxy" containerID="cri-o://7af10d0cbe2c1362b9ec1aa0eaf0d2ce8a44209e0d281e5478dc7992e25d5763" gracePeriod=30 Jun 09 01:53:51.839521 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:51.839488 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:51.942002 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:51.941867 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:54.168530 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:54.168497 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:55.368566 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.368544 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:55.433154 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433093 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-credential-socket\") pod \"243d08d0-d02f-4630-b90c-e0016b6f23c1\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " Jun 09 01:53:55.433154 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433148 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-workload-certs\") pod \"243d08d0-d02f-4630-b90c-e0016b6f23c1\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " Jun 09 01:53:55.433341 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433190 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-token\") pod \"243d08d0-d02f-4630-b90c-e0016b6f23c1\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " Jun 09 01:53:55.433341 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433234 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-envoy\") pod \"243d08d0-d02f-4630-b90c-e0016b6f23c1\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " Jun 09 01:53:55.433341 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433292 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4pnv\" (UniqueName: \"kubernetes.io/projected/243d08d0-d02f-4630-b90c-e0016b6f23c1-kube-api-access-k4pnv\") pod \"243d08d0-d02f-4630-b90c-e0016b6f23c1\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " Jun 09 01:53:55.433502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433343 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-podinfo\") pod \"243d08d0-d02f-4630-b90c-e0016b6f23c1\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " Jun 09 01:53:55.433502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433375 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/243d08d0-d02f-4630-b90c-e0016b6f23c1-istiod-ca-cert\") pod \"243d08d0-d02f-4630-b90c-e0016b6f23c1\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " Jun 09 01:53:55.433502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433408 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-workload-socket\") pod \"243d08d0-d02f-4630-b90c-e0016b6f23c1\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " Jun 09 01:53:55.433502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433390 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "243d08d0-d02f-4630-b90c-e0016b6f23c1" (UID: "243d08d0-d02f-4630-b90c-e0016b6f23c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:53:55.433502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433429 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-data\") pod \"243d08d0-d02f-4630-b90c-e0016b6f23c1\" (UID: \"243d08d0-d02f-4630-b90c-e0016b6f23c1\") " Jun 09 01:53:55.433502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433452 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "243d08d0-d02f-4630-b90c-e0016b6f23c1" (UID: "243d08d0-d02f-4630-b90c-e0016b6f23c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:53:55.433794 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433654 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "243d08d0-d02f-4630-b90c-e0016b6f23c1" (UID: "243d08d0-d02f-4630-b90c-e0016b6f23c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:53:55.433794 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433707 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-workload-certs\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:53:55.433794 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433725 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-credential-socket\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:53:55.433794 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.433732 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/243d08d0-d02f-4630-b90c-e0016b6f23c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "243d08d0-d02f-4630-b90c-e0016b6f23c1" (UID: "243d08d0-d02f-4630-b90c-e0016b6f23c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 01:53:55.434533 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.434500 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "243d08d0-d02f-4630-b90c-e0016b6f23c1" (UID: "243d08d0-d02f-4630-b90c-e0016b6f23c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:53:55.435625 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.435603 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "243d08d0-d02f-4630-b90c-e0016b6f23c1" (UID: "243d08d0-d02f-4630-b90c-e0016b6f23c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:53:55.435711 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.435654 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "243d08d0-d02f-4630-b90c-e0016b6f23c1" (UID: "243d08d0-d02f-4630-b90c-e0016b6f23c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 09 01:53:55.435755 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.435698 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/243d08d0-d02f-4630-b90c-e0016b6f23c1-kube-api-access-k4pnv" (OuterVolumeSpecName: "kube-api-access-k4pnv") pod "243d08d0-d02f-4630-b90c-e0016b6f23c1" (UID: "243d08d0-d02f-4630-b90c-e0016b6f23c1"). InnerVolumeSpecName "kube-api-access-k4pnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:53:55.435999 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.435981 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "243d08d0-d02f-4630-b90c-e0016b6f23c1" (UID: "243d08d0-d02f-4630-b90c-e0016b6f23c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:53:55.535125 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.535102 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-token\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:53:55.535125 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.535127 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-envoy\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:53:55.535354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.535140 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4pnv\" (UniqueName: \"kubernetes.io/projected/243d08d0-d02f-4630-b90c-e0016b6f23c1-kube-api-access-k4pnv\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:53:55.535354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.535153 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-podinfo\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:53:55.535354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.535166 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/243d08d0-d02f-4630-b90c-e0016b6f23c1-istiod-ca-cert\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:53:55.535354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.535177 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-workload-socket\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:53:55.535354 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.535187 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/243d08d0-d02f-4630-b90c-e0016b6f23c1-istio-data\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:53:55.775418 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.775345 2567 generic.go:356] "Generic (PLEG): container finished" podID="243d08d0-d02f-4630-b90c-e0016b6f23c1" containerID="7af10d0cbe2c1362b9ec1aa0eaf0d2ce8a44209e0d281e5478dc7992e25d5763" exitCode=0 Jun 09 01:53:55.775418 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.775391 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" Jun 09 01:53:55.775568 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.775404 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" event={"ID":"243d08d0-d02f-4630-b90c-e0016b6f23c1","Type":"ContainerDied","Data":"7af10d0cbe2c1362b9ec1aa0eaf0d2ce8a44209e0d281e5478dc7992e25d5763"} Jun 09 01:53:55.775568 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.775512 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx" event={"ID":"243d08d0-d02f-4630-b90c-e0016b6f23c1","Type":"ContainerDied","Data":"a9684bb2878fca7d958cd3d23b0062a6596d961933a0a14991fd4396245098e0"} Jun 09 01:53:55.775568 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.775534 2567 scope.go:117] "RemoveContainer" containerID="7af10d0cbe2c1362b9ec1aa0eaf0d2ce8a44209e0d281e5478dc7992e25d5763" Jun 09 01:53:55.784221 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.784206 2567 scope.go:117] "RemoveContainer" containerID="7af10d0cbe2c1362b9ec1aa0eaf0d2ce8a44209e0d281e5478dc7992e25d5763" Jun 09 01:53:55.784491 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:53:55.784467 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7af10d0cbe2c1362b9ec1aa0eaf0d2ce8a44209e0d281e5478dc7992e25d5763\": container with ID starting with 7af10d0cbe2c1362b9ec1aa0eaf0d2ce8a44209e0d281e5478dc7992e25d5763 not found: ID does not exist" containerID="7af10d0cbe2c1362b9ec1aa0eaf0d2ce8a44209e0d281e5478dc7992e25d5763" Jun 09 01:53:55.784579 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.784496 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7af10d0cbe2c1362b9ec1aa0eaf0d2ce8a44209e0d281e5478dc7992e25d5763"} err="failed to get container status \"7af10d0cbe2c1362b9ec1aa0eaf0d2ce8a44209e0d281e5478dc7992e25d5763\": rpc error: code = NotFound desc = could not find container \"7af10d0cbe2c1362b9ec1aa0eaf0d2ce8a44209e0d281e5478dc7992e25d5763\": container with ID starting with 7af10d0cbe2c1362b9ec1aa0eaf0d2ce8a44209e0d281e5478dc7992e25d5763 not found: ID does not exist" Jun 09 01:53:55.796829 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.796802 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx"] Jun 09 01:53:55.800225 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:55.800206 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d9890fd0-openshift-default-b76b77454-2fgvx"] Jun 09 01:53:57.344144 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:57.344114 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="243d08d0-d02f-4630-b90c-e0016b6f23c1" path="/var/lib/kubelet/pods/243d08d0-d02f-4630-b90c-e0016b6f23c1/volumes" Jun 09 01:53:57.773851 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:57.773773 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:57.876424 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:57.876396 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:57.946940 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:57.946908 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l"] Jun 09 01:53:57.947555 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:57.947531 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243d08d0-d02f-4630-b90c-e0016b6f23c1" containerName="istio-proxy" Jun 09 01:53:57.947555 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:57.947552 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="243d08d0-d02f-4630-b90c-e0016b6f23c1" containerName="istio-proxy" Jun 09 01:53:57.947748 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:57.947643 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="243d08d0-d02f-4630-b90c-e0016b6f23c1" containerName="istio-proxy" Jun 09 01:53:57.952523 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:57.952501 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:57.954918 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:57.954883 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5929b614-openshift-default-dockercfg-sl4s6\"" Jun 09 01:53:57.964708 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:57.964682 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l"] Jun 09 01:53:57.987116 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:57.987089 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:58.056271 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.056170 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-podinfo\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.056271 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.056219 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-token\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.056467 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.056275 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-data\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.056467 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.056327 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-credential-socket\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.056467 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.056395 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-workload-socket\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.056467 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.056449 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istiod-ca-cert\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.056683 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.056467 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfhnf\" (UniqueName: \"kubernetes.io/projected/c23ed8b5-fa32-4bd0-974d-f45201e6248f-kube-api-access-lfhnf\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.056683 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.056505 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-workload-certs\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.056683 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.056529 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-envoy\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.083889 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.083859 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:58.157146 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.157115 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-podinfo\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.157283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.157155 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-token\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.157283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.157178 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-data\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.157406 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.157307 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-credential-socket\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.157406 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.157378 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-workload-socket\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.157507 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.157447 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istiod-ca-cert\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.157569 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.157513 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfhnf\" (UniqueName: \"kubernetes.io/projected/c23ed8b5-fa32-4bd0-974d-f45201e6248f-kube-api-access-lfhnf\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.157625 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.157567 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-workload-certs\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.157625 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.157592 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-envoy\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.157625 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.157605 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-data\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.157763 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.157680 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-credential-socket\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.157810 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.157758 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-workload-socket\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.158194 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.158141 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-workload-certs\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.158194 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.158163 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istiod-ca-cert\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.160002 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.159976 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-podinfo\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.160113 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.160007 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-envoy\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.166596 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.166574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-token\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.167168 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.167149 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfhnf\" (UniqueName: \"kubernetes.io/projected/c23ed8b5-fa32-4bd0-974d-f45201e6248f-kube-api-access-lfhnf\") pod \"e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.190101 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.190074 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:58.267069 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.267040 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:58.284492 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.284370 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:58.403291 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.403240 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l"] Jun 09 01:53:58.404398 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:53:58.404366 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23ed8b5_fa32_4bd0_974d_f45201e6248f.slice/crio-48950e549bae025c2792dc7940a5000181bb41f5a4ebd5f3db7e83caddd86548 WatchSource:0}: Error finding container 48950e549bae025c2792dc7940a5000181bb41f5a4ebd5f3db7e83caddd86548: Status 404 returned error can't find the container with id 48950e549bae025c2792dc7940a5000181bb41f5a4ebd5f3db7e83caddd86548 Jun 09 01:53:58.407091 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.407059 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:53:58.407192 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.407136 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:53:58.407192 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.407169 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 01:53:58.567785 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.567749 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:58.777171 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.777086 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:58.792771 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.792741 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" event={"ID":"c23ed8b5-fa32-4bd0-974d-f45201e6248f","Type":"ContainerStarted","Data":"dbc0d58fcdf64cc588d8dfb94157c17a4b38c8d5d4b4661271b3edac183ac09d"} Jun 09 01:53:58.792893 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.792796 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" event={"ID":"c23ed8b5-fa32-4bd0-974d-f45201e6248f","Type":"ContainerStarted","Data":"48950e549bae025c2792dc7940a5000181bb41f5a4ebd5f3db7e83caddd86548"} Jun 09 01:53:58.812296 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.812239 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" podStartSLOduration=1.81222543 podStartE2EDuration="1.81222543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 01:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:53:58.810584911 +0000 UTC m=+2301.922584762" watchObservedRunningTime="2026-06-09 01:53:58.81222543 +0000 UTC m=+2301.924225279" Jun 09 01:53:58.931285 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:58.931236 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:59.129660 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:59.129616 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:59.267796 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:59.267766 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:59.276801 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:59.276777 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:59.550774 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:59.550697 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:53:59.799489 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:59.799458 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:53:59.800357 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:53:59.800334 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:54:00.357005 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:00.356966 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:54:00.744051 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:00.743957 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:54:01.346755 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:01.346718 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:54:01.557114 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:01.557076 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:54:01.947604 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:01.947512 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:54:02.549502 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:02.549463 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:54:04.254891 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:04.254798 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:54:05.380036 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:05.380005 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l"] Jun 09 01:54:05.380470 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:05.380174 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" podUID="c23ed8b5-fa32-4bd0-974d-f45201e6248f" containerName="istio-proxy" containerID="cri-o://dbc0d58fcdf64cc588d8dfb94157c17a4b38c8d5d4b4661271b3edac183ac09d" gracePeriod=30 Jun 09 01:54:05.396637 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:05.396606 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:54:05.497503 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:05.497466 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:54:06.823052 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.823026 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:54:06.833713 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.833690 2567 generic.go:356] "Generic (PLEG): container finished" podID="c23ed8b5-fa32-4bd0-974d-f45201e6248f" containerID="dbc0d58fcdf64cc588d8dfb94157c17a4b38c8d5d4b4661271b3edac183ac09d" exitCode=0 Jun 09 01:54:06.833813 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.833728 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" Jun 09 01:54:06.833813 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.833770 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" event={"ID":"c23ed8b5-fa32-4bd0-974d-f45201e6248f","Type":"ContainerDied","Data":"dbc0d58fcdf64cc588d8dfb94157c17a4b38c8d5d4b4661271b3edac183ac09d"} Jun 09 01:54:06.833887 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.833823 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l" event={"ID":"c23ed8b5-fa32-4bd0-974d-f45201e6248f","Type":"ContainerDied","Data":"48950e549bae025c2792dc7940a5000181bb41f5a4ebd5f3db7e83caddd86548"} Jun 09 01:54:06.833887 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.833847 2567 scope.go:117] "RemoveContainer" containerID="dbc0d58fcdf64cc588d8dfb94157c17a4b38c8d5d4b4661271b3edac183ac09d" Jun 09 01:54:06.843706 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.843657 2567 scope.go:117] "RemoveContainer" containerID="dbc0d58fcdf64cc588d8dfb94157c17a4b38c8d5d4b4661271b3edac183ac09d" Jun 09 01:54:06.844387 ip-10-0-137-100 kubenswrapper[2567]: E0609 01:54:06.844313 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbc0d58fcdf64cc588d8dfb94157c17a4b38c8d5d4b4661271b3edac183ac09d\": container with ID starting with dbc0d58fcdf64cc588d8dfb94157c17a4b38c8d5d4b4661271b3edac183ac09d not found: ID does not exist" containerID="dbc0d58fcdf64cc588d8dfb94157c17a4b38c8d5d4b4661271b3edac183ac09d" Jun 09 01:54:06.844387 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.844353 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc0d58fcdf64cc588d8dfb94157c17a4b38c8d5d4b4661271b3edac183ac09d"} err="failed to get container status \"dbc0d58fcdf64cc588d8dfb94157c17a4b38c8d5d4b4661271b3edac183ac09d\": rpc error: code = NotFound desc = could not find container \"dbc0d58fcdf64cc588d8dfb94157c17a4b38c8d5d4b4661271b3edac183ac09d\": container with ID starting with dbc0d58fcdf64cc588d8dfb94157c17a4b38c8d5d4b4661271b3edac183ac09d not found: ID does not exist" Jun 09 01:54:06.935595 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.935563 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istiod-ca-cert\") pod \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " Jun 09 01:54:06.935750 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.935617 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfhnf\" (UniqueName: \"kubernetes.io/projected/c23ed8b5-fa32-4bd0-974d-f45201e6248f-kube-api-access-lfhnf\") pod \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " Jun 09 01:54:06.935750 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.935692 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-envoy\") pod \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " Jun 09 01:54:06.935750 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.935725 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-token\") pod \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " Jun 09 01:54:06.935750 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.935744 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-workload-socket\") pod \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " Jun 09 01:54:06.935962 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.935775 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-workload-certs\") pod \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " Jun 09 01:54:06.935962 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.935829 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-data\") pod \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " Jun 09 01:54:06.935962 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.935873 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-credential-socket\") pod \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " Jun 09 01:54:06.935962 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.935893 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c23ed8b5-fa32-4bd0-974d-f45201e6248f" (UID: "c23ed8b5-fa32-4bd0-974d-f45201e6248f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 01:54:06.935962 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.935926 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-podinfo\") pod \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\" (UID: \"c23ed8b5-fa32-4bd0-974d-f45201e6248f\") " Jun 09 01:54:06.936184 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.936021 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c23ed8b5-fa32-4bd0-974d-f45201e6248f" (UID: "c23ed8b5-fa32-4bd0-974d-f45201e6248f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:54:06.936184 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.936050 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c23ed8b5-fa32-4bd0-974d-f45201e6248f" (UID: "c23ed8b5-fa32-4bd0-974d-f45201e6248f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:54:06.936297 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.936170 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c23ed8b5-fa32-4bd0-974d-f45201e6248f" (UID: "c23ed8b5-fa32-4bd0-974d-f45201e6248f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:54:06.936353 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.936339 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-credential-socket\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:54:06.936398 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.936359 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istiod-ca-cert\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:54:06.936398 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.936373 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-workload-socket\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:54:06.936398 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.936386 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-workload-certs\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:54:06.936686 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.936667 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c23ed8b5-fa32-4bd0-974d-f45201e6248f" (UID: "c23ed8b5-fa32-4bd0-974d-f45201e6248f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:54:06.938160 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.938111 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c23ed8b5-fa32-4bd0-974d-f45201e6248f" (UID: "c23ed8b5-fa32-4bd0-974d-f45201e6248f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 01:54:06.938318 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.938183 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c23ed8b5-fa32-4bd0-974d-f45201e6248f" (UID: "c23ed8b5-fa32-4bd0-974d-f45201e6248f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 09 01:54:06.938318 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.938244 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c23ed8b5-fa32-4bd0-974d-f45201e6248f" (UID: "c23ed8b5-fa32-4bd0-974d-f45201e6248f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:54:06.938411 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:06.938365 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c23ed8b5-fa32-4bd0-974d-f45201e6248f-kube-api-access-lfhnf" (OuterVolumeSpecName: "kube-api-access-lfhnf") pod "c23ed8b5-fa32-4bd0-974d-f45201e6248f" (UID: "c23ed8b5-fa32-4bd0-974d-f45201e6248f"). InnerVolumeSpecName "kube-api-access-lfhnf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 01:54:07.037318 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:07.037295 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfhnf\" (UniqueName: \"kubernetes.io/projected/c23ed8b5-fa32-4bd0-974d-f45201e6248f-kube-api-access-lfhnf\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:54:07.037318 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:07.037315 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-envoy\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:54:07.037473 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:07.037324 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-token\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:54:07.037473 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:07.037331 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-data\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:54:07.037473 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:07.037339 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23ed8b5-fa32-4bd0-974d-f45201e6248f-istio-podinfo\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jun 09 01:54:07.155936 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:07.155877 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l"] Jun 09 01:54:07.161546 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:07.161523 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5929b614-openshift-default-844fc6f6d6-kcb6l"] Jun 09 01:54:07.345216 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:07.345174 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c23ed8b5-fa32-4bd0-974d-f45201e6248f" path="/var/lib/kubelet/pods/c23ed8b5-fa32-4bd0-974d-f45201e6248f/volumes" Jun 09 01:54:07.441205 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:07.441177 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:54:11.551181 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:11.551143 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:54:11.663335 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:11.663301 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:54:22.196231 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:22.196199 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-98cf8ddb4-5797p_17afa3bd-1c71-49b8-9553-f058894fc9e2/nginx/0.log" Jun 09 01:54:23.232672 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:23.232640 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c5668658c-zmgwp_4ac092af-bc80-4ed7-8311-9c65e03cc6e4/copy-manifests/0.log" Jun 09 01:54:23.245409 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:23.245378 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c5668658c-zmgwp_4ac092af-bc80-4ed7-8311-9c65e03cc6e4/manager/0.log" Jun 09 01:54:24.633472 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:24.633445 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hspz7_1b3d5473-e10d-4cab-b1b9-53a5bc2004c7/manager/0.log" Jun 09 01:54:24.964746 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:24.964652 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mbd5p_95c4d7bb-7427-4ce1-b61e-52e81bc8a664/registry-server/0.log" Jun 09 01:54:25.095320 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:25.095293 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jrxp4_e252a9fd-d149-428f-9820-ed3a4a0db98f/manager/0.log" Jun 09 01:54:25.215061 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:25.214994 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-644bg_0655ab64-7f63-49d5-ace9-90feb49dfec1/limitador/0.log" Jun 09 01:54:25.678949 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:25.678920 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcppmwh_f986edbd-5967-4354-8898-33da15d1ba21/istio-proxy/0.log" Jun 09 01:54:26.134585 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:26.134559 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8pp8_f2d85acc-f111-4852-96bf-17ae3a89b667/istio-proxy/1.log" Jun 09 01:54:26.246060 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:26.246036 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-869b67fc67-xvnq5_3d113498-e382-4fea-b9ea-f8ff5ce8c48c/router/0.log" Jun 09 01:54:27.177998 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:27.177974 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-htvxw_49345975-4345-4a78-9505-9df092a1eac4/storage-initializer/0.log" Jun 09 01:54:27.185341 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:27.185321 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-htvxw_49345975-4345-4a78-9505-9df092a1eac4/main/0.log" Jun 09 01:54:31.332514 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:31.332484 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:54:31.431718 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:31.431687 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" limit=1024 Jun 09 01:54:34.577882 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:34.577852 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tg2cl_9e4e5081-32c3-4d3c-b0ad-4ca5d0e7c721/global-pull-secret-syncer/0.log" Jun 09 01:54:34.660610 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:34.660581 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5fxhf_c80624d4-fc4d-4c5c-88c9-1ddab7ec542d/konnectivity-agent/0.log" Jun 09 01:54:34.771361 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:34.771332 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-100.ec2.internal_bd84badc95e7565ce7045e885393d462/haproxy/0.log" Jun 09 01:54:39.067379 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:39.067349 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hspz7_1b3d5473-e10d-4cab-b1b9-53a5bc2004c7/manager/0.log" Jun 09 01:54:39.174688 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:39.174662 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mbd5p_95c4d7bb-7427-4ce1-b61e-52e81bc8a664/registry-server/0.log" Jun 09 01:54:39.254286 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:39.254245 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jrxp4_e252a9fd-d149-428f-9820-ed3a4a0db98f/manager/0.log" Jun 09 01:54:39.280779 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:39.280742 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-644bg_0655ab64-7f63-49d5-ace9-90feb49dfec1/limitador/0.log" Jun 09 01:54:41.457747 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:41.457717 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-lckmh_8be19231-6a85-4f7b-8154-0581fbe26cc3/cluster-monitoring-operator/0.log" Jun 09 01:54:41.590381 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:41.590336 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-57bd4f5c75-kdpd8_39582a5d-5d18-4856-972a-2542fd4312cf/metrics-server/0.log" Jun 09 01:54:41.631940 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:41.631914 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-d88lz_6c24c8a8-0959-4392-94da-56359f317adf/monitoring-plugin/0.log" Jun 09 01:54:41.829661 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:41.829637 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scvp5_89e36459-f8c2-4aad-83e3-0ff8418874d7/node-exporter/0.log" Jun 09 01:54:41.854010 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:41.853987 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scvp5_89e36459-f8c2-4aad-83e3-0ff8418874d7/kube-rbac-proxy/0.log" Jun 09 01:54:41.876117 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:41.876095 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scvp5_89e36459-f8c2-4aad-83e3-0ff8418874d7/init-textfile/0.log" Jun 09 01:54:41.992707 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:41.992681 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3796e0c-9b63-4555-bf0e-ac6064b8c425/prometheus/0.log" Jun 09 01:54:42.021213 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.021138 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3796e0c-9b63-4555-bf0e-ac6064b8c425/config-reloader/0.log" Jun 09 01:54:42.044176 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.044158 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3796e0c-9b63-4555-bf0e-ac6064b8c425/thanos-sidecar/0.log" Jun 09 01:54:42.067748 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.067731 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3796e0c-9b63-4555-bf0e-ac6064b8c425/kube-rbac-proxy-web/0.log" Jun 09 01:54:42.093349 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.093322 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3796e0c-9b63-4555-bf0e-ac6064b8c425/kube-rbac-proxy/0.log" Jun 09 01:54:42.119767 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.119745 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3796e0c-9b63-4555-bf0e-ac6064b8c425/kube-rbac-proxy-thanos/0.log" Jun 09 01:54:42.141936 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.141918 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3796e0c-9b63-4555-bf0e-ac6064b8c425/init-config-reloader/0.log" Jun 09 01:54:42.235618 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.235600 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-6hd76_35ccd0af-e016-4b21-96ad-64f26efd2e2c/prometheus-operator-admission-webhook/0.log" Jun 09 01:54:42.268101 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.268078 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-594566b867-mwrx8_cd3479eb-3b38-4555-8838-b4e045775022/telemeter-client/0.log" Jun 09 01:54:42.293025 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.292975 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-594566b867-mwrx8_cd3479eb-3b38-4555-8838-b4e045775022/reload/0.log" Jun 09 01:54:42.316700 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.316681 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-594566b867-mwrx8_cd3479eb-3b38-4555-8838-b4e045775022/kube-rbac-proxy/0.log" Jun 09 01:54:42.346407 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.346381 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d77d55c84-ltwgx_398bc3a8-352c-4016-a226-45f16699cb3a/thanos-query/0.log" Jun 09 01:54:42.371166 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.371132 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d77d55c84-ltwgx_398bc3a8-352c-4016-a226-45f16699cb3a/kube-rbac-proxy-web/0.log" Jun 09 01:54:42.391922 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.391904 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d77d55c84-ltwgx_398bc3a8-352c-4016-a226-45f16699cb3a/kube-rbac-proxy/0.log" Jun 09 01:54:42.415287 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.415272 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d77d55c84-ltwgx_398bc3a8-352c-4016-a226-45f16699cb3a/prom-label-proxy/0.log" Jun 09 01:54:42.438057 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.438038 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d77d55c84-ltwgx_398bc3a8-352c-4016-a226-45f16699cb3a/kube-rbac-proxy-rules/0.log" Jun 09 01:54:42.469489 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:42.469472 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d77d55c84-ltwgx_398bc3a8-352c-4016-a226-45f16699cb3a/kube-rbac-proxy-metrics/0.log" Jun 09 01:54:46.876955 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:46.876924 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r"] Jun 09 01:54:46.877407 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:46.877389 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c23ed8b5-fa32-4bd0-974d-f45201e6248f" containerName="istio-proxy" Jun 09 01:54:46.877456 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:46.877410 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c23ed8b5-fa32-4bd0-974d-f45201e6248f" containerName="istio-proxy" Jun 09 01:54:46.877519 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:46.877507 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c23ed8b5-fa32-4bd0-974d-f45201e6248f" containerName="istio-proxy" Jun 09 01:54:46.881094 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:46.881074 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:46.883351 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:46.883330 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4cwjw\"/\"default-dockercfg-5b7d7\"" Jun 09 01:54:46.883498 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:46.883480 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4cwjw\"/\"kube-root-ca.crt\"" Jun 09 01:54:46.884283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:46.884242 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4cwjw\"/\"openshift-service-ca.crt\"" Jun 09 01:54:46.889550 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:46.889525 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r"] Jun 09 01:54:46.971607 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:46.971574 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-sys\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:46.971779 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:46.971632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-lib-modules\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:46.971779 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:46.971667 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-podres\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:46.971779 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:46.971749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-proc\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:46.971779 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:46.971771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zftl\" (UniqueName: \"kubernetes.io/projected/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-kube-api-access-8zftl\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:47.072507 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.072471 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-proc\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:47.072507 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.072508 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zftl\" (UniqueName: \"kubernetes.io/projected/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-kube-api-access-8zftl\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:47.072725 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.072605 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-proc\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:47.072725 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.072634 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-sys\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:47.072802 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.072725 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-lib-modules\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:47.072802 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.072737 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-sys\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:47.072802 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.072775 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-podres\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:47.072910 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.072843 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-podres\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:47.072910 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.072850 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-lib-modules\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:47.080882 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.080841 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zftl\" (UniqueName: \"kubernetes.io/projected/8cbe46fd-87d4-4734-9fec-6ae150d4d1c4-kube-api-access-8zftl\") pod \"perf-node-gather-daemonset-vcz9r\" (UID: \"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4\") " pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:47.191779 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.191703 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:47.321939 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.321908 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r"] Jun 09 01:54:47.324783 ip-10-0-137-100 kubenswrapper[2567]: W0609 01:54:47.324753 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8cbe46fd_87d4_4734_9fec_6ae150d4d1c4.slice/crio-b256a7874b6c77e158cbfe45ab8e68ff2db7630dc56dcfab1f9dbdfc1e8246bd WatchSource:0}: Error finding container b256a7874b6c77e158cbfe45ab8e68ff2db7630dc56dcfab1f9dbdfc1e8246bd: Status 404 returned error can't find the container with id b256a7874b6c77e158cbfe45ab8e68ff2db7630dc56dcfab1f9dbdfc1e8246bd Jun 09 01:54:47.526437 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.526414 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mg45n_567d595f-9152-43ac-9850-1f7f4b48653e/dns/0.log" Jun 09 01:54:47.549720 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.549699 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mg45n_567d595f-9152-43ac-9850-1f7f4b48653e/kube-rbac-proxy/0.log" Jun 09 01:54:47.593443 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:47.593420 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nxwz8_932b1521-314f-43d5-ba5a-1f0975868d6c/dns-node-resolver/0.log" Jun 09 01:54:48.028413 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:48.028377 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" event={"ID":"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4","Type":"ContainerStarted","Data":"d8b48cbaa88de961b71c26620b3883b1e541088b38647f68f29c23562affad64"} Jun 09 01:54:48.028869 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:48.028432 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" event={"ID":"8cbe46fd-87d4-4734-9fec-6ae150d4d1c4","Type":"ContainerStarted","Data":"b256a7874b6c77e158cbfe45ab8e68ff2db7630dc56dcfab1f9dbdfc1e8246bd"} Jun 09 01:54:48.028869 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:48.028486 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:48.044445 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:48.044386 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" podStartSLOduration=2.044362841 podStartE2EDuration="2.044362841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 01:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 01:54:48.043629734 +0000 UTC m=+2351.155629583" watchObservedRunningTime="2026-06-09 01:54:48.044362841 +0000 UTC m=+2351.156362693" Jun 09 01:54:48.158670 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:48.158642 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2rbzj_cba164a9-697b-4cec-9ed7-8ca4efb6d492/node-ca/0.log" Jun 09 01:54:49.112828 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:49.112800 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcppmwh_f986edbd-5967-4354-8898-33da15d1ba21/istio-proxy/0.log" Jun 09 01:54:49.304469 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:49.304403 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8pp8_f2d85acc-f111-4852-96bf-17ae3a89b667/istio-proxy/0.log" Jun 09 01:54:49.337043 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:49.337015 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8pp8_f2d85acc-f111-4852-96bf-17ae3a89b667/istio-proxy/1.log" Jun 09 01:54:49.359901 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:49.359882 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-869b67fc67-xvnq5_3d113498-e382-4fea-b9ea-f8ff5ce8c48c/router/0.log" Jun 09 01:54:49.939988 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:49.939961 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qggcv_f9227a10-ee0f-43f7-8b6a-b0106eb47e65/serve-healthcheck-canary/0.log" Jun 09 01:54:50.507912 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:50.507879 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f5szf_a9231f26-1e00-420f-864b-2ee278d8e23b/kube-rbac-proxy/0.log" Jun 09 01:54:50.528224 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:50.528197 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f5szf_a9231f26-1e00-420f-864b-2ee278d8e23b/exporter/0.log" Jun 09 01:54:50.548555 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:50.548524 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f5szf_a9231f26-1e00-420f-864b-2ee278d8e23b/extractor/0.log" Jun 09 01:54:52.815243 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:52.815216 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-98cf8ddb4-5797p_17afa3bd-1c71-49b8-9553-f058894fc9e2/nginx/0.log" Jun 09 01:54:53.373935 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:53.373904 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c5668658c-zmgwp_4ac092af-bc80-4ed7-8311-9c65e03cc6e4/manager/0.log" Jun 09 01:54:53.395580 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:53.395555 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c5668658c-zmgwp_4ac092af-bc80-4ed7-8311-9c65e03cc6e4/copy-manifests/0.log" Jun 09 01:54:54.042094 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:54.042070 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4cwjw/perf-node-gather-daemonset-vcz9r" Jun 09 01:54:54.802359 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:54.802327 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-586b6bddf9-sqzwq_11eb56b4-8c0f-4798-9def-942124eb1e0b/manager/0.log" Jun 09 01:54:59.729891 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:59.729860 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcppmwh_f986edbd-5967-4354-8898-33da15d1ba21/istio-proxy/0.log" Jun 09 01:54:59.905216 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:59.905190 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8pp8_f2d85acc-f111-4852-96bf-17ae3a89b667/istio-proxy/0.log" Jun 09 01:54:59.944174 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:59.944141 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8pp8_f2d85acc-f111-4852-96bf-17ae3a89b667/istio-proxy/1.log" Jun 09 01:54:59.966133 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:54:59.966106 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-869b67fc67-xvnq5_3d113498-e382-4fea-b9ea-f8ff5ce8c48c/router/0.log" Jun 09 01:55:00.340929 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:00.340897 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-xs5sz_f6fab47f-fe88-4274-aa49-e90d32735eb8/migrator/0.log" Jun 09 01:55:00.368775 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:00.368751 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-xs5sz_f6fab47f-fe88-4274-aa49-e90d32735eb8/graceful-termination/0.log" Jun 09 01:55:01.033576 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:01.033545 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcppmwh_f986edbd-5967-4354-8898-33da15d1ba21/istio-proxy/0.log" Jun 09 01:55:01.196805 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:01.196776 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8pp8_f2d85acc-f111-4852-96bf-17ae3a89b667/istio-proxy/0.log" Jun 09 01:55:01.231229 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:01.231198 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8pp8_f2d85acc-f111-4852-96bf-17ae3a89b667/istio-proxy/1.log" Jun 09 01:55:01.248967 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:01.248945 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-869b67fc67-xvnq5_3d113498-e382-4fea-b9ea-f8ff5ce8c48c/router/0.log" Jun 09 01:55:02.287668 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:02.287641 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tv9m6_f0aa8715-5d8f-495e-a638-eeb6b312dfe1/kube-multus-additional-cni-plugins/0.log" Jun 09 01:55:02.310785 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:02.310761 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tv9m6_f0aa8715-5d8f-495e-a638-eeb6b312dfe1/egress-router-binary-copy/0.log" Jun 09 01:55:02.333323 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:02.333303 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tv9m6_f0aa8715-5d8f-495e-a638-eeb6b312dfe1/cni-plugins/0.log" Jun 09 01:55:02.356588 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:02.356565 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tv9m6_f0aa8715-5d8f-495e-a638-eeb6b312dfe1/bond-cni-plugin/0.log" Jun 09 01:55:02.380489 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:02.380467 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tv9m6_f0aa8715-5d8f-495e-a638-eeb6b312dfe1/routeoverride-cni/0.log" Jun 09 01:55:02.402568 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:02.402549 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tv9m6_f0aa8715-5d8f-495e-a638-eeb6b312dfe1/whereabouts-cni-bincopy/0.log" Jun 09 01:55:02.429558 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:02.429531 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tv9m6_f0aa8715-5d8f-495e-a638-eeb6b312dfe1/whereabouts-cni/0.log" Jun 09 01:55:02.527909 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:02.527889 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zwb2p_b31c6811-7aca-474e-9b5e-e89eec2deff7/kube-multus/0.log" Jun 09 01:55:02.652270 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:02.652230 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tkpd9_b149e648-ac8f-4faf-82f1-a48fcce0e32c/network-metrics-daemon/0.log" Jun 09 01:55:02.675374 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:02.675351 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tkpd9_b149e648-ac8f-4faf-82f1-a48fcce0e32c/kube-rbac-proxy/0.log" Jun 09 01:55:02.818697 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:02.818670 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcppmwh_f986edbd-5967-4354-8898-33da15d1ba21/istio-proxy/0.log" Jun 09 01:55:02.976111 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:02.976024 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8pp8_f2d85acc-f111-4852-96bf-17ae3a89b667/istio-proxy/0.log" Jun 09 01:55:03.016051 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:03.016012 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8pp8_f2d85acc-f111-4852-96bf-17ae3a89b667/istio-proxy/1.log" Jun 09 01:55:03.030026 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:03.030004 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-869b67fc67-xvnq5_3d113498-e382-4fea-b9ea-f8ff5ce8c48c/router/0.log" Jun 09 01:55:03.801283 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:03.801235 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-controller/0.log" Jun 09 01:55:03.824652 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:03.824622 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/0.log" Jun 09 01:55:03.824807 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:03.824770 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/ovn-acl-logging/1.log" Jun 09 01:55:03.851810 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:03.851783 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/kube-rbac-proxy-node/0.log" Jun 09 01:55:03.874749 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:03.874721 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 01:55:03.892717 ip-10-0-137-100 kubenswrapper[2567]: I0609 01:55:03.892696 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67sfl_2a9587dd-afda-456c-8b3f-456328625388/northd/0.log"