Jun 09 13:45:05.451290 ip-10-0-136-4 systemd[1]: Starting Kubernetes Kubelet... Jun 09 13:45:05.790296 ip-10-0-136-4 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 13:45:05.790296 ip-10-0-136-4 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 13:45:05.790296 ip-10-0-136-4 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 13:45:05.790296 ip-10-0-136-4 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 13:45:05.790296 ip-10-0-136-4 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 13:45:05.791269 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.791178 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 13:45:05.796097 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796080 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:45:05.796097 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796097 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:45:05.796097 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796100 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796104 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796107 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796110 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796114 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796117 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796120 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796123 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796126 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796128 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796131 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796134 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796137 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796140 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796142 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796145 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796148 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796150 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796153 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796162 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:45:05.796199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796164 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796167 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796169 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796172 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796174 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796177 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796179 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796182 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796184 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796189 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796193 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796196 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796199 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796202 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796205 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796209 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796211 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796214 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796217 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796219 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:45:05.796762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796222 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796224 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796227 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796229 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796232 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796234 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796237 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796245 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796248 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796250 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796253 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796256 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796259 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796261 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796265 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796267 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796270 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796272 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796275 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796278 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:45:05.797504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796280 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796283 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796287 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796291 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796294 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796297 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796300 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796302 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796305 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796307 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796310 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796313 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796315 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796319 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796321 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796324 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796327 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796329 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796332 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:45:05.798042 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796334 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796337 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796339 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796342 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796344 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796347 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796352 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796356 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796360 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796362 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796365 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796368 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796371 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796373 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796376 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796378 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796381 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:45:05.798504 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.796384 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798820 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798831 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798835 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798838 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798840 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798843 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798846 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798849 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798851 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798854 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798857 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798860 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798864 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798868 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798871 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798873 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798876 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798878 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798881 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:45:05.798928 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798883 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798886 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798889 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798891 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798894 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798897 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798899 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798903 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798908 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798911 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798914 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798924 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798928 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798931 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798934 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798939 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798942 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798945 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798948 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:45:05.799464 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798951 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798953 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798956 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798958 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798961 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798963 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798966 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798968 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798971 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798974 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798991 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798994 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.798998 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799001 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799004 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799009 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799012 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799015 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799017 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799020 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:45:05.799922 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799023 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799025 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799028 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799031 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799033 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799036 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799038 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799041 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799044 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799046 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799049 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799052 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799054 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799057 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799060 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799062 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799065 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799067 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799070 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799073 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:45:05.800425 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799076 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799079 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799081 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799084 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799086 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799090 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799093 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799096 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799099 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799102 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799104 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799107 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799110 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799112 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799115 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799117 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799120 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799123 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799125 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:45:05.800934 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799128 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799130 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799510 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799517 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799521 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799524 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799527 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799530 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799533 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799536 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799538 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799541 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799544 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799546 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799549 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799552 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799555 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799557 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799560 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:45:05.801407 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799563 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799567 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799570 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799573 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799575 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799578 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799580 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799583 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799586 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799589 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799592 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799594 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799597 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799599 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799602 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799604 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799607 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799609 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799612 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799614 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:45:05.801875 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799617 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799619 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799622 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799624 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799627 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799629 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799632 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799634 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799637 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799639 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799642 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799645 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799649 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799653 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799656 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799658 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799661 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799663 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799666 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799669 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:45:05.802402 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799671 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799673 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799676 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799679 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799681 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799684 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799687 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799689 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799693 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799695 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799698 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799700 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799703 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799706 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799708 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799711 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799713 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799716 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799718 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799721 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:45:05.802974 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799723 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799725 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799728 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799730 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799734 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799739 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799742 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799745 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799748 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799751 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799753 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799756 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799758 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799761 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799763 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799766 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799768 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799771 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799773 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:45:05.803498 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799776 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799778 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.799781 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799856 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799864 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799870 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799874 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799878 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799881 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799885 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799890 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799893 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799896 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799899 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799903 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799906 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799909 2558 flags.go:64] FLAG: --cgroup-root="" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799911 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799915 2558 flags.go:64] FLAG: --client-ca-file="" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799920 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799923 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799929 2558 flags.go:64] FLAG: --cluster-domain="" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799932 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 13:45:05.803954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799935 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799939 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799942 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799945 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799948 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799951 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799954 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799957 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799975 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799993 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.799997 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800000 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800004 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800007 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800010 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800013 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800016 2558 flags.go:64] FLAG: --enable-server="true" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800019 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800026 2558 flags.go:64] FLAG: --event-burst="100" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800029 2558 flags.go:64] FLAG: --event-qps="50" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800032 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800035 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800037 2558 flags.go:64] FLAG: --eviction-hard="" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800041 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 13:45:05.804561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800044 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800047 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800051 2558 flags.go:64] FLAG: --eviction-soft="" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800055 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800058 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800067 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800070 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800073 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800076 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800078 2558 flags.go:64] FLAG: --feature-gates="" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800082 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800085 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800088 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800091 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800094 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800097 2558 flags.go:64] FLAG: --help="false" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800100 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-136-4.ec2.internal" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800103 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800106 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800108 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800112 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800115 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800118 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 13:45:05.805146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800120 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800123 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800126 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800128 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800132 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800134 2558 flags.go:64] FLAG: --kube-reserved="" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800137 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800140 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800143 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800146 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800149 2558 flags.go:64] FLAG: --lock-file="" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800152 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800155 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800158 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800164 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800167 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800170 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800173 2558 flags.go:64] FLAG: --logging-format="text" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800176 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800179 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800182 2558 flags.go:64] FLAG: --manifest-url="" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800185 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800189 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800192 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800196 2558 flags.go:64] FLAG: --max-pods="110" Jun 09 13:45:05.805723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800199 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800202 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800204 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800207 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800210 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800214 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800217 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800224 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800227 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800232 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800235 2558 flags.go:64] FLAG: --pod-cidr="" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800238 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800243 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800246 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800249 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800252 2558 flags.go:64] FLAG: --port="10250" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800255 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800258 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bdfd94f287bc7327" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800261 2558 flags.go:64] FLAG: --qos-reserved="" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800264 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800267 2558 flags.go:64] FLAG: --register-node="true" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800270 2558 flags.go:64] FLAG: --register-with-taints="" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800273 2558 flags.go:64] FLAG: --registry-burst="10" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800277 2558 flags.go:64] FLAG: --registry-qps="5" Jun 09 13:45:05.806353 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800280 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800283 2558 flags.go:64] FLAG: --reserved-memory="" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800286 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800289 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800298 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800302 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800305 2558 flags.go:64] FLAG: --runonce="false" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800308 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800311 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800314 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800317 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800320 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800323 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800326 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800329 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800332 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800334 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800339 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800342 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800345 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800348 2558 flags.go:64] FLAG: --system-cgroups="" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800351 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800356 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800359 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800365 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 13:45:05.806957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800369 2558 flags.go:64] FLAG: --tls-min-version="" Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800373 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800375 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800378 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800382 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800385 2558 flags.go:64] FLAG: --v="2" Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800389 2558 flags.go:64] FLAG: --version="false" Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800393 2558 flags.go:64] FLAG: --vmodule="" Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800397 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.800401 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800522 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800526 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800529 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800532 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800535 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800538 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800540 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800543 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800546 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800548 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800551 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800553 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:45:05.807573 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800556 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800560 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800565 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800568 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800570 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800573 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800576 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800579 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800581 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800586 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800589 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800591 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800594 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800596 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800599 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800602 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800604 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800607 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800610 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:45:05.808153 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800613 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800615 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800618 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800620 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800623 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800626 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800630 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800633 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800635 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800638 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800641 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800643 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800646 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800649 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800651 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800655 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800658 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800660 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800663 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800665 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:45:05.808615 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800667 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800670 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800674 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800677 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800679 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800681 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800684 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800686 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800689 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800691 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800694 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800697 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800700 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800703 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800720 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800724 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800727 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800730 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800733 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800736 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:45:05.809128 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800739 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800742 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800745 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800747 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800750 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800752 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800755 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800759 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800761 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800764 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800766 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800769 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800772 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800774 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800778 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800780 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800783 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800786 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800788 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800791 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:45:05.809618 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800793 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:45:05.810132 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800798 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:45:05.810132 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800801 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:45:05.810132 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800804 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:45:05.810132 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800807 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:45:05.810132 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800810 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:45:05.810132 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800813 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:45:05.810132 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.800816 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:45:05.810132 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.801294 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 13:45:05.810132 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.807905 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 13:45:05.810132 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.807922 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 13:45:05.810132 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.807946 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 13:45:05.810132 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.807952 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 13:45:05.810132 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808031 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:45:05.810132 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808037 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808040 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808043 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808047 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808051 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808054 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808056 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808060 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808062 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808065 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808068 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808071 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808073 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808076 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808079 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808081 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808084 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808086 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808089 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808092 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:45:05.810478 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808095 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808097 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808100 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808104 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808107 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808110 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808113 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808115 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808118 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808121 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808123 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808127 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808129 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808132 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808134 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808137 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808139 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808142 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808144 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808147 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:45:05.810967 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808149 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808152 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808155 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808157 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808160 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808163 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808166 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808169 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808171 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808174 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808177 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808180 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808183 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808185 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808189 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808193 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808197 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808200 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808203 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808205 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:45:05.811465 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808209 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808212 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808228 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808232 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808236 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808239 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808242 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808245 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808248 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808250 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808253 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808256 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808258 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808261 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808264 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808266 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808269 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808272 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808274 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:45:05.811949 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808277 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808279 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808282 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808284 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808287 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808290 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808292 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808295 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808297 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808300 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808303 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808306 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808309 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808312 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808314 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808317 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808320 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808323 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:45:05.812417 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808327 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:45:05.812847 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.808333 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 13:45:05.812847 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808446 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:45:05.812847 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808450 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:45:05.812847 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808453 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:45:05.812847 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808457 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:45:05.812847 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808459 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:45:05.812847 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808462 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:45:05.812847 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808465 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:45:05.812847 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808467 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:45:05.812847 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808470 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:45:05.812847 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808473 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:45:05.812847 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808477 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:45:05.812847 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808480 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:45:05.812847 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808483 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808486 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808489 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808492 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808496 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808500 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808503 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808505 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808508 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808511 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808513 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808516 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808519 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808522 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808525 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808527 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808530 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808532 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808535 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808537 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:45:05.813242 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808540 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808542 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808545 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808548 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808550 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808553 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808555 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808558 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808560 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808563 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808565 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808568 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808570 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808573 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808575 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808578 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808580 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808584 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808587 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808589 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:45:05.813720 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808593 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808596 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808599 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808602 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808606 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808609 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808612 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808614 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808617 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808620 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808623 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808626 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808629 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808631 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808634 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808636 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808639 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808641 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808644 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808646 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:45:05.814246 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808649 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808651 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808654 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808657 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808659 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808662 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808664 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808666 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808669 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808671 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808674 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808677 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808679 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808682 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808684 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808687 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.808689 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.809078 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.809083 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.809086 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:45:05.814725 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.809088 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:45:05.815424 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.809091 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:45:05.815424 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.809094 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:45:05.815424 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.809096 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:45:05.815424 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.809099 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:45:05.815424 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.809102 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:45:05.815424 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:05.809104 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:45:05.815424 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.809110 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 13:45:05.815424 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.809226 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 13:45:05.815424 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.811112 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 13:45:05.815424 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.812085 2558 server.go:1019] "Starting client certificate rotation" Jun 09 13:45:05.815424 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.812185 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 13:45:05.815424 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.812223 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 13:45:05.815424 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.814164 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 13:45:05.817021 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.817003 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 13:45:05.826204 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.826179 2558 log.go:25] "Validated CRI v1 runtime API" Jun 09 13:45:05.830198 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.830174 2558 log.go:25] "Validated CRI v1 image API" Jun 09 13:45:05.831019 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.830997 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 13:45:05.833101 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.833079 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ceb20900-2bd7-4ec3-8a0d-b2d613408709:/dev/nvme0n1p4 e7772f88-5b05-471f-9581-9ddb7329c5ed:/dev/nvme0n1p3] Jun 09 13:45:05.833185 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.833099 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 13:45:05.839132 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.839004 2558 manager.go:216] Machine: {Timestamp:2026-06-09 13:45:05.836809474 +0000 UTC m=+0.284531822 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3119005 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d2764b858a16c4193b5c9bae80787 SystemUUID:ec2d2764-b858-a16c-4193-b5c9bae80787 BootID:877b40f2-beab-4d71-85ea-c1d280194b81 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ef:58:f0:f7:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ef:58:f0:f7:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:e4:26:21:2f:a8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 13:45:05.839132 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.839131 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 13:45:05.839241 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.839224 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 13:45:05.840443 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.840427 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 13:45:05.841529 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.841498 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 13:45:05.841669 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.841531 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 13:45:05.842151 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.842140 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 13:45:05.842183 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.842154 2558 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 13:45:05.842183 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.842162 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 13:45:05.842671 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.842661 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 13:45:05.843412 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.843402 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 13:45:05.845871 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.845860 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 09 13:45:05.846002 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.845992 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 13:45:05.846038 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.846022 2558 kubelet.go:486] "Attempting to sync node with API server" Jun 09 13:45:05.846038 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.846032 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 13:45:05.846092 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.846049 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 13:45:05.846092 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.846059 2558 kubelet.go:398] "Adding apiserver pod source" Jun 09 13:45:05.846092 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.846068 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 13:45:05.846515 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.846504 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 13:45:05.846549 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.846523 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 13:45:05.848881 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.848865 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 13:45:05.850135 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.850122 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 13:45:05.850200 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.850152 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 13:45:05.851069 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.851058 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 13:45:05.851106 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.851075 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 13:45:05.851106 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.851082 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 13:45:05.851106 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.851087 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 13:45:05.851106 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.851097 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 13:45:05.851218 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.851110 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 13:45:05.851218 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.851125 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 13:45:05.851218 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.851130 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 13:45:05.851218 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.851138 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 13:45:05.851218 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.851143 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 13:45:05.851218 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.851156 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 13:45:05.851218 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.851161 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 13:45:05.851773 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.851763 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 13:45:05.851773 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.851772 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 13:45:05.855229 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.855215 2558 server.go:1268] "Started kubelet" Jun 09 13:45:05.855372 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.855345 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 13:45:05.855445 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.855432 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-4.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 13:45:05.855559 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:05.855534 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 13:45:05.855672 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:05.855622 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 13:45:05.855726 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.855668 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 13:45:05.855774 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.855732 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 13:45:05.856691 ip-10-0-136-4 systemd[1]: Started Kubernetes Kubelet. Jun 09 13:45:05.857329 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.857268 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 13:45:05.857395 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.857331 2558 server.go:310] "Adding debug handlers to kubelet server" Jun 09 13:45:05.862778 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:05.859266 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-4.ec2.internal.18b76d9ea8f4af83 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-4.ec2.internal,UID:ip-10-0-136-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-4.ec2.internal,},FirstTimestamp:2026-06-09 13:45:05.855188867 +0000 UTC m=+0.302911214,LastTimestamp:2026-06-09 13:45:05.855188867 +0000 UTC m=+0.302911214,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-4.ec2.internal,}" Jun 09 13:45:05.862937 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.862922 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 13:45:05.863054 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.863035 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 13:45:05.863364 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:05.863343 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-4.ec2.internal\" not found" Jun 09 13:45:05.863457 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.863424 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 13:45:05.863457 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.863429 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 13:45:05.863457 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.863449 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 13:45:05.863576 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.863564 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 09 13:45:05.863576 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.863571 2558 reconciler.go:29] "Reconciler: start to sync state" Jun 09 13:45:05.864243 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:05.864215 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 13:45:05.864431 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.864413 2558 factory.go:55] Registering systemd factory Jun 09 13:45:05.864496 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.864432 2558 factory.go:223] Registration of the systemd container factory successfully Jun 09 13:45:05.864544 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.864514 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7nj9s" Jun 09 13:45:05.864649 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.864638 2558 factory.go:153] Registering CRI-O factory Jun 09 13:45:05.864688 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.864653 2558 factory.go:223] Registration of the crio container factory successfully Jun 09 13:45:05.864727 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.864705 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 13:45:05.864763 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.864730 2558 factory.go:103] Registering Raw factory Jun 09 13:45:05.864763 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.864744 2558 manager.go:1196] Started watching for new ooms in manager Jun 09 13:45:05.865148 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:05.865114 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 13:45:05.865242 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.865172 2558 manager.go:349] Starting recovery of all containers Jun 09 13:45:05.865396 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:05.865370 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 13:45:05.869687 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.869664 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7nj9s" Jun 09 13:45:05.875257 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.875080 2558 manager.go:354] Recovery completed Jun 09 13:45:05.876630 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:05.876603 2558 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 09 13:45:05.879553 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.879541 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:45:05.881521 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.881505 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:45:05.881593 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.881533 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:45:05.881593 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.881544 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:45:05.883238 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.883220 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 13:45:05.883238 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.883234 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:45:05.883369 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.883236 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 13:45:05.883369 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.883310 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 09 13:45:05.884763 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.884750 2558 policy_none.go:49] "None policy: Start" Jun 09 13:45:05.884827 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.884768 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 13:45:05.884827 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.884783 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 13:45:05.886040 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.886025 2558 policy_none.go:47] "Start" Jun 09 13:45:05.886636 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.886615 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:45:05.886727 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.886654 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:45:05.886727 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.886669 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:45:05.923647 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.923631 2558 manager.go:337] "Starting Device Plugin manager" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:05.923671 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.923683 2558 server.go:87] "Starting device plugin registration server" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.924140 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.924153 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.924296 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.924394 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.924404 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:05.925200 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:05.925244 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-4.ec2.internal\" not found" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.937703 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.939001 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.939032 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.939064 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:05.939098 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 13:45:05.948446 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:05.941148 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:45:06.024422 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.024374 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:45:06.025423 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.025403 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:45:06.025543 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.025443 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:45:06.025543 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.025458 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:45:06.025543 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.025487 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.034486 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.034460 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.034486 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:06.034486 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-4.ec2.internal\": node \"ip-10-0-136-4.ec2.internal\" not found" Jun 09 13:45:06.039842 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.039820 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-4.ec2.internal"] Jun 09 13:45:06.039931 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.039880 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:45:06.040814 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.040749 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:45:06.040814 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.040776 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:45:06.040814 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.040786 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:45:06.043291 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.043279 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:45:06.043402 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.043387 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.043449 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.043418 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:45:06.043941 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.043927 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:45:06.044027 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.043951 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:45:06.044027 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.043966 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:45:06.044107 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.044037 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:45:06.044107 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.044054 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:45:06.044107 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.044066 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:45:06.046263 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.046246 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.046316 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.046282 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:45:06.046942 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.046924 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:45:06.047029 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.046956 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:45:06.047029 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.046971 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:45:06.058535 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:06.058512 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-4.ec2.internal\" not found" node="ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.062350 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:06.062334 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-4.ec2.internal\" not found" node="ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.063334 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:06.063320 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-4.ec2.internal\" not found" Jun 09 13:45:06.164140 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:06.164103 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-4.ec2.internal\" not found" Jun 09 13:45:06.165315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.165296 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0aff424d0f29020893887d0322a1d75-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal\" (UID: \"a0aff424d0f29020893887d0322a1d75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.165400 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.165333 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0aff424d0f29020893887d0322a1d75-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal\" (UID: \"a0aff424d0f29020893887d0322a1d75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.165400 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.165360 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b15aebb8a62392542274bac25b50b144-config\") pod \"kube-apiserver-proxy-ip-10-0-136-4.ec2.internal\" (UID: \"b15aebb8a62392542274bac25b50b144\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.264288 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:06.264255 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-4.ec2.internal\" not found" Jun 09 13:45:06.266467 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.266444 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0aff424d0f29020893887d0322a1d75-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal\" (UID: \"a0aff424d0f29020893887d0322a1d75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.266519 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.266476 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b15aebb8a62392542274bac25b50b144-config\") pod \"kube-apiserver-proxy-ip-10-0-136-4.ec2.internal\" (UID: \"b15aebb8a62392542274bac25b50b144\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.266519 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.266496 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0aff424d0f29020893887d0322a1d75-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal\" (UID: \"a0aff424d0f29020893887d0322a1d75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.266582 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.266523 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0aff424d0f29020893887d0322a1d75-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal\" (UID: \"a0aff424d0f29020893887d0322a1d75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.266582 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.266547 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0aff424d0f29020893887d0322a1d75-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal\" (UID: \"a0aff424d0f29020893887d0322a1d75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.266582 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.266547 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b15aebb8a62392542274bac25b50b144-config\") pod \"kube-apiserver-proxy-ip-10-0-136-4.ec2.internal\" (UID: \"b15aebb8a62392542274bac25b50b144\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.365110 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:06.365031 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-4.ec2.internal\" not found" Jun 09 13:45:06.365110 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.365030 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.369882 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.369865 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.465682 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:06.465646 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-4.ec2.internal\" not found" Jun 09 13:45:06.566153 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:06.566109 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-4.ec2.internal\" not found" Jun 09 13:45:06.666634 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:06.666558 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-4.ec2.internal\" not found" Jun 09 13:45:06.767083 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:06.767050 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-4.ec2.internal\" not found" Jun 09 13:45:06.812399 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.812367 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 13:45:06.812836 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.812569 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 13:45:06.850401 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.850376 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:45:06.864187 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.864161 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.864187 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.864173 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 13:45:06.872972 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.872944 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 13:40:05 +0000 UTC" deadline="2028-03-07 04:52:22.2356331 +0000 UTC" Jun 09 13:45:06.872972 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.872970 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15279h7m15.362666344s" Jun 09 13:45:06.876177 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.876163 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 13:45:06.878293 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.878279 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal" Jun 09 13:45:06.881745 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.881726 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 13:45:06.894120 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.894103 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 13:45:06.915332 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.915312 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-57nqn" Jun 09 13:45:06.925732 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.925674 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-57nqn" Jun 09 13:45:06.983797 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:06.983756 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15aebb8a62392542274bac25b50b144.slice/crio-271db374e913299a09788491fab7f1d87c213cb15164076cb0982b07dcabb489 WatchSource:0}: Error finding container 271db374e913299a09788491fab7f1d87c213cb15164076cb0982b07dcabb489: Status 404 returned error can't find the container with id 271db374e913299a09788491fab7f1d87c213cb15164076cb0982b07dcabb489 Jun 09 13:45:06.984215 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:06.984189 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0aff424d0f29020893887d0322a1d75.slice/crio-094b4b0174f4abe0ac80d00ee7d50b6fa5f7170da463dc56c631c1716c925cde WatchSource:0}: Error finding container 094b4b0174f4abe0ac80d00ee7d50b6fa5f7170da463dc56c631c1716c925cde: Status 404 returned error can't find the container with id 094b4b0174f4abe0ac80d00ee7d50b6fa5f7170da463dc56c631c1716c925cde Jun 09 13:45:06.990187 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:06.990171 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 13:45:07.405917 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.405881 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:45:07.435299 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.435266 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:45:07.722608 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.722522 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:45:07.847533 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.847504 2558 apiserver.go:52] "Watching apiserver" Jun 09 13:45:07.856650 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.856620 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 13:45:07.857065 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.857041 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv","openshift-cluster-node-tuning-operator/tuned-fh94h","openshift-dns/node-resolver-96ng8","openshift-multus/multus-additional-cni-plugins-6xk9k","openshift-multus/multus-jf4fg","openshift-image-registry/node-ca-b5lp8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal","openshift-multus/network-metrics-daemon-5rz5l","openshift-network-diagnostics/network-check-target-ckbj8","openshift-network-operator/iptables-alerter-96hz6","openshift-ovn-kubernetes/ovnkube-node-gp8mh","kube-system/global-pull-secret-syncer-hbqlt","kube-system/konnectivity-agent-2d8tz","kube-system/kube-apiserver-proxy-ip-10-0-136-4.ec2.internal"] Jun 09 13:45:07.859944 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.859838 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.862261 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.862236 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.862499 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.862481 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 13:45:07.862686 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.862670 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 13:45:07.863231 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.863194 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 13:45:07.867361 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.863578 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-54nvn\"" Jun 09 13:45:07.867361 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.865372 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-64w2k\"" Jun 09 13:45:07.867361 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.865840 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:45:07.867361 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.866072 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 13:45:07.867361 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.866329 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-96ng8" Jun 09 13:45:07.869211 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.869152 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 13:45:07.869311 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.869296 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 13:45:07.869488 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.869470 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:07.869685 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.869664 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j2gnl\"" Jun 09 13:45:07.870276 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.870258 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.871617 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.871597 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 13:45:07.871839 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.871820 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b5lp8" Jun 09 13:45:07.872206 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.871970 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 13:45:07.872206 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.872009 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gkd8r\"" Jun 09 13:45:07.872374 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.872268 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 13:45:07.875021 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.872757 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d6fbd\"" Jun 09 13:45:07.875021 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.872912 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 13:45:07.875021 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.872958 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 13:45:07.875021 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.872944 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 13:45:07.875021 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.874028 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 13:45:07.875021 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.874278 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 13:45:07.875021 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.874300 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:07.875021 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.874310 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s5fwv\"" Jun 09 13:45:07.875021 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.874317 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 13:45:07.875021 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:07.874393 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875330 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-sysctl-d\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875368 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-sys\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875395 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-lib-modules\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875418 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47cvz\" (UniqueName: \"kubernetes.io/projected/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-kube-api-access-47cvz\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875444 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3156ddf-2573-4c42-8de4-c0c79ebd8f80-hosts-file\") pod \"node-resolver-96ng8\" (UID: \"f3156ddf-2573-4c42-8de4-c0c79ebd8f80\") " pod="openshift-dns/node-resolver-96ng8" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875471 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875494 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-sys-fs\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-modprobe-d\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875537 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-sysconfig\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875558 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-tuned\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875580 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-tmp\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875601 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3156ddf-2573-4c42-8de4-c0c79ebd8f80-tmp-dir\") pod \"node-resolver-96ng8\" (UID: \"f3156ddf-2573-4c42-8de4-c0c79ebd8f80\") " pod="openshift-dns/node-resolver-96ng8" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875623 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-socket-dir\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875645 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-registration-dir\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875669 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-device-dir\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.876044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875693 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-sysctl-conf\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.876663 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-host\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.876663 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875741 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdcsf\" (UniqueName: \"kubernetes.io/projected/5deb9474-9b35-49b0-99ce-52460fae8f28-kube-api-access-jdcsf\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.876663 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875789 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-systemd\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.876663 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875811 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-run\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.876663 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875834 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-var-lib-kubelet\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.876663 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875857 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsrgr\" (UniqueName: \"kubernetes.io/projected/f3156ddf-2573-4c42-8de4-c0c79ebd8f80-kube-api-access-fsrgr\") pod \"node-resolver-96ng8\" (UID: \"f3156ddf-2573-4c42-8de4-c0c79ebd8f80\") " pod="openshift-dns/node-resolver-96ng8" Jun 09 13:45:07.876663 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875883 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-etc-selinux\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.876663 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.875907 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-kubernetes\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.876663 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.876470 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:07.876663 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:07.876527 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:07.879395 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.878600 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-96hz6" Jun 09 13:45:07.880782 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.880761 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 13:45:07.880925 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.880880 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 13:45:07.881027 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.880964 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.881174 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.881154 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ldddr\"" Jun 09 13:45:07.882654 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.881451 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:45:07.884955 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.883212 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 13:45:07.884955 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.883284 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:07.884955 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:07.883368 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:07.884955 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.883534 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 13:45:07.884955 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.883542 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2vrk8\"" Jun 09 13:45:07.884955 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.883691 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 13:45:07.884955 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.883788 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 13:45:07.885719 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.885702 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 13:45:07.886054 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.886038 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 13:45:07.886197 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.886177 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2d8tz" Jun 09 13:45:07.888882 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.888862 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 13:45:07.889004 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.888894 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p92jd\"" Jun 09 13:45:07.889132 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.889117 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 13:45:07.929312 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.929269 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 13:40:06 +0000 UTC" deadline="2028-03-12 00:46:42.966247348 +0000 UTC" Jun 09 13:45:07.929312 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.929309 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15395h1m35.036940571s" Jun 09 13:45:07.944865 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.944817 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal" event={"ID":"a0aff424d0f29020893887d0322a1d75","Type":"ContainerStarted","Data":"094b4b0174f4abe0ac80d00ee7d50b6fa5f7170da463dc56c631c1716c925cde"} Jun 09 13:45:07.946399 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.946369 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-4.ec2.internal" event={"ID":"b15aebb8a62392542274bac25b50b144","Type":"ContainerStarted","Data":"271db374e913299a09788491fab7f1d87c213cb15164076cb0982b07dcabb489"} Jun 09 13:45:07.965493 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.965473 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 13:45:07.976481 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976404 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-registration-dir\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.976481 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-kubelet\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.976481 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976477 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-run-systemd\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.976705 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976503 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-run-openvswitch\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.976705 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-cni-bin\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.976705 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976555 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-var-lib-kubelet\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.976705 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976565 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-registration-dir\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.976705 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a078366e-c775-4814-add1-59e187ad45ff-os-release\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:07.976705 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976605 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-multus-conf-dir\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.976705 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976653 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-kubernetes\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.976705 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976673 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-var-lib-kubelet\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.976705 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976679 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3156ddf-2573-4c42-8de4-c0c79ebd8f80-hosts-file\") pod \"node-resolver-96ng8\" (UID: \"f3156ddf-2573-4c42-8de4-c0c79ebd8f80\") " pod="openshift-dns/node-resolver-96ng8" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976729 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a078366e-c775-4814-add1-59e187ad45ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976782 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3156ddf-2573-4c42-8de4-c0c79ebd8f80-hosts-file\") pod \"node-resolver-96ng8\" (UID: \"f3156ddf-2573-4c42-8de4-c0c79ebd8f80\") " pod="openshift-dns/node-resolver-96ng8" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976800 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-kubernetes\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976812 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a078366e-c775-4814-add1-59e187ad45ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976843 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-var-lib-cni-bin\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976867 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e6de29a5-52d3-4e8c-b5a6-f283b237e186-konnectivity-ca\") pod \"konnectivity-agent-2d8tz\" (UID: \"e6de29a5-52d3-4e8c-b5a6-f283b237e186\") " pod="kube-system/konnectivity-agent-2d8tz" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976891 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-run-ovn-kubernetes\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976920 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-sys-fs\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-modprobe-d\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.976968 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-sysconfig\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977011 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a078366e-c775-4814-add1-59e187ad45ff-cnibin\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977035 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-multus-cni-dir\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977059 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-cnibin\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977082 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-multus-socket-dir-parent\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977115 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s49cw\" (UniqueName: \"kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw\") pod \"network-check-target-ckbj8\" (UID: \"b9b3c957-c2a5-4f7f-966a-4ea80823ca1e\") " pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977140 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-device-dir\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.977196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977166 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-sysctl-conf\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977190 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-hostroot\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977241 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-run-ovn\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977263 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-node-log\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977290 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94fe717f-e61a-483a-bac8-be82ca3c7dc2-ovnkube-script-lib\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977313 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8z7l\" (UniqueName: \"kubernetes.io/projected/94fe717f-e61a-483a-bac8-be82ca3c7dc2-kube-api-access-c8z7l\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977339 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdcsf\" (UniqueName: \"kubernetes.io/projected/5deb9474-9b35-49b0-99ce-52460fae8f28-kube-api-access-jdcsf\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977369 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-cni-netd\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977398 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-sysctl-d\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977422 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-lib-modules\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977446 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47cvz\" (UniqueName: \"kubernetes.io/projected/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-kube-api-access-47cvz\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977478 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44f2fe44-5b07-4d88-8271-081c442714f6-dbus\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977502 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-var-lib-kubelet\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977527 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977559 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-tuned\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977583 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a078366e-c775-4814-add1-59e187ad45ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:07.977994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977616 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-run-k8s-cni-cncf-io\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977642 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-etc-kubernetes\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977666 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50528af2-db53-4024-bfe0-3a0ec40c3259-serviceca\") pod \"node-ca-b5lp8\" (UID: \"50528af2-db53-4024-bfe0-3a0ec40c3259\") " pod="openshift-image-registry/node-ca-b5lp8" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977693 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzbsh\" (UniqueName: \"kubernetes.io/projected/41c2bd6b-6311-4748-bdd0-45e75bb77ee1-kube-api-access-fzbsh\") pod \"iptables-alerter-96hz6\" (UID: \"41c2bd6b-6311-4748-bdd0-45e75bb77ee1\") " pod="openshift-network-operator/iptables-alerter-96hz6" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977715 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-systemd-units\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977740 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-run-netns\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977776 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-etc-openvswitch\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977801 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-systemd\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977827 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsrgr\" (UniqueName: \"kubernetes.io/projected/f3156ddf-2573-4c42-8de4-c0c79ebd8f80-kube-api-access-fsrgr\") pod \"node-resolver-96ng8\" (UID: \"f3156ddf-2573-4c42-8de4-c0c79ebd8f80\") " pod="openshift-dns/node-resolver-96ng8" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977856 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-os-release\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977891 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-etc-selinux\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977916 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3156ddf-2573-4c42-8de4-c0c79ebd8f80-tmp-dir\") pod \"node-resolver-96ng8\" (UID: \"f3156ddf-2573-4c42-8de4-c0c79ebd8f80\") " pod="openshift-dns/node-resolver-96ng8" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977947 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.977972 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41c2bd6b-6311-4748-bdd0-45e75bb77ee1-iptables-alerter-script\") pod \"iptables-alerter-96hz6\" (UID: \"41c2bd6b-6311-4748-bdd0-45e75bb77ee1\") " pod="openshift-network-operator/iptables-alerter-96hz6" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978015 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e6de29a5-52d3-4e8c-b5a6-f283b237e186-agent-certs\") pod \"konnectivity-agent-2d8tz\" (UID: \"e6de29a5-52d3-4e8c-b5a6-f283b237e186\") " pod="kube-system/konnectivity-agent-2d8tz" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978038 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-slash\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-log-socket\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.978807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978098 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-tmp\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978124 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c578f83b-1d7a-4005-86bd-81363e3b25b6-cni-binary-copy\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978149 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94fe717f-e61a-483a-bac8-be82ca3c7dc2-ovnkube-config\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978173 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-host\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978205 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44f2fe44-5b07-4d88-8271-081c442714f6-kubelet-config\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978231 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-system-cni-dir\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978256 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-var-lib-cni-multus\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978280 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-run-multus-certs\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978307 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94fe717f-e61a-483a-bac8-be82ca3c7dc2-env-overrides\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978332 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94fe717f-e61a-483a-bac8-be82ca3c7dc2-ovn-node-metrics-cert\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978361 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-run\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978387 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a078366e-c775-4814-add1-59e187ad45ff-system-cni-dir\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978413 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a078366e-c775-4814-add1-59e187ad45ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978440 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-run-netns\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978464 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp2dz\" (UniqueName: \"kubernetes.io/projected/c578f83b-1d7a-4005-86bd-81363e3b25b6-kube-api-access-bp2dz\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978490 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqqqr\" (UniqueName: \"kubernetes.io/projected/9d2e9f3f-f036-427f-85ac-33212870137f-kube-api-access-dqqqr\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978518 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41c2bd6b-6311-4748-bdd0-45e75bb77ee1-host-slash\") pod \"iptables-alerter-96hz6\" (UID: \"41c2bd6b-6311-4748-bdd0-45e75bb77ee1\") " pod="openshift-network-operator/iptables-alerter-96hz6" Jun 09 13:45:07.979552 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978543 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-sys\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978571 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-545kn\" (UniqueName: \"kubernetes.io/projected/a078366e-c775-4814-add1-59e187ad45ff-kube-api-access-545kn\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978599 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-627b8\" (UniqueName: \"kubernetes.io/projected/50528af2-db53-4024-bfe0-3a0ec40c3259-kube-api-access-627b8\") pod \"node-ca-b5lp8\" (UID: \"50528af2-db53-4024-bfe0-3a0ec40c3259\") " pod="openshift-image-registry/node-ca-b5lp8" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978625 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-var-lib-openvswitch\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978669 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c578f83b-1d7a-4005-86bd-81363e3b25b6-multus-daemon-config\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978694 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50528af2-db53-4024-bfe0-3a0ec40c3259-host\") pod \"node-ca-b5lp8\" (UID: \"50528af2-db53-4024-bfe0-3a0ec40c3259\") " pod="openshift-image-registry/node-ca-b5lp8" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978725 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978755 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-socket-dir\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.978931 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-socket-dir\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.979022 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-sys-fs\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.979127 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-modprobe-d\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.979179 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-sysconfig\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.979311 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-device-dir\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.979462 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-sysctl-conf\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.979885 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-sysctl-d\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.980340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.980061 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-lib-modules\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.980942 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.980369 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.981099 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.981057 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 13:45:07.981174 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.981131 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-systemd\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.981374 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.981346 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5deb9474-9b35-49b0-99ce-52460fae8f28-etc-selinux\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.981497 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.981467 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-host\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.981563 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.981525 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-sys\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.981563 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.981532 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-run\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.981664 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.981639 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3156ddf-2573-4c42-8de4-c0c79ebd8f80-tmp-dir\") pod \"node-resolver-96ng8\" (UID: \"f3156ddf-2573-4c42-8de4-c0c79ebd8f80\") " pod="openshift-dns/node-resolver-96ng8" Jun 09 13:45:07.985344 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.985319 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-tmp\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.985449 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.985346 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-etc-tuned\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:07.992653 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.992550 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsrgr\" (UniqueName: \"kubernetes.io/projected/f3156ddf-2573-4c42-8de4-c0c79ebd8f80-kube-api-access-fsrgr\") pod \"node-resolver-96ng8\" (UID: \"f3156ddf-2573-4c42-8de4-c0c79ebd8f80\") " pod="openshift-dns/node-resolver-96ng8" Jun 09 13:45:07.992653 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.992550 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdcsf\" (UniqueName: \"kubernetes.io/projected/5deb9474-9b35-49b0-99ce-52460fae8f28-kube-api-access-jdcsf\") pod \"aws-ebs-csi-driver-node-dpmkv\" (UID: \"5deb9474-9b35-49b0-99ce-52460fae8f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:07.992653 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:07.992557 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47cvz\" (UniqueName: \"kubernetes.io/projected/2f773273-9023-4a7a-a4dd-e024ac8ac0ed-kube-api-access-47cvz\") pod \"tuned-fh94h\" (UID: \"2f773273-9023-4a7a-a4dd-e024ac8ac0ed\") " pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:08.080490 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.080351 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a078366e-c775-4814-add1-59e187ad45ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.080490 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.080403 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-run-k8s-cni-cncf-io\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.080490 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.080433 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-etc-kubernetes\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.080490 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.080463 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50528af2-db53-4024-bfe0-3a0ec40c3259-serviceca\") pod \"node-ca-b5lp8\" (UID: \"50528af2-db53-4024-bfe0-3a0ec40c3259\") " pod="openshift-image-registry/node-ca-b5lp8" Jun 09 13:45:08.080805 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.080536 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-run-k8s-cni-cncf-io\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.080960 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.080939 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50528af2-db53-4024-bfe0-3a0ec40c3259-serviceca\") pod \"node-ca-b5lp8\" (UID: \"50528af2-db53-4024-bfe0-3a0ec40c3259\") " pod="openshift-image-registry/node-ca-b5lp8" Jun 09 13:45:08.081064 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081043 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-etc-kubernetes\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.081116 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081094 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzbsh\" (UniqueName: \"kubernetes.io/projected/41c2bd6b-6311-4748-bdd0-45e75bb77ee1-kube-api-access-fzbsh\") pod \"iptables-alerter-96hz6\" (UID: \"41c2bd6b-6311-4748-bdd0-45e75bb77ee1\") " pod="openshift-network-operator/iptables-alerter-96hz6" Jun 09 13:45:08.081161 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-systemd-units\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.081214 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081161 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-run-netns\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.081214 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081188 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-etc-openvswitch\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.081276 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081233 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a078366e-c775-4814-add1-59e187ad45ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.081276 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081253 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-etc-openvswitch\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.081276 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081210 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-systemd-units\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.081276 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-os-release\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.081417 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081276 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-run-netns\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.081417 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081306 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:08.081417 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081340 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-os-release\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.081417 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081361 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41c2bd6b-6311-4748-bdd0-45e75bb77ee1-iptables-alerter-script\") pod \"iptables-alerter-96hz6\" (UID: \"41c2bd6b-6311-4748-bdd0-45e75bb77ee1\") " pod="openshift-network-operator/iptables-alerter-96hz6" Jun 09 13:45:08.081417 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081388 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e6de29a5-52d3-4e8c-b5a6-f283b237e186-agent-certs\") pod \"konnectivity-agent-2d8tz\" (UID: \"e6de29a5-52d3-4e8c-b5a6-f283b237e186\") " pod="kube-system/konnectivity-agent-2d8tz" Jun 09 13:45:08.081417 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.081402 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:08.081417 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081411 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-slash\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.081884 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.081866 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs podName:9d2e9f3f-f036-427f-85ac-33212870137f nodeName:}" failed. No retries permitted until 2026-06-09 13:45:08.581466956 +0000 UTC m=+3.029189309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs") pod "network-metrics-daemon-5rz5l" (UID: "9d2e9f3f-f036-427f-85ac-33212870137f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:08.081884 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081874 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-slash\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.082048 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081897 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-log-socket\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.082048 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081930 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c578f83b-1d7a-4005-86bd-81363e3b25b6-cni-binary-copy\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.082048 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081954 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94fe717f-e61a-483a-bac8-be82ca3c7dc2-ovnkube-config\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.082048 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.081997 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44f2fe44-5b07-4d88-8271-081c442714f6-kubelet-config\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:08.082048 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082021 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-system-cni-dir\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.082258 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082074 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-log-socket\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.082258 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082084 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-system-cni-dir\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.082258 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082108 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-var-lib-cni-multus\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.082258 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-run-multus-certs\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.082258 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082156 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94fe717f-e61a-483a-bac8-be82ca3c7dc2-env-overrides\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.082258 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082180 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94fe717f-e61a-483a-bac8-be82ca3c7dc2-ovn-node-metrics-cert\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.082258 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082199 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44f2fe44-5b07-4d88-8271-081c442714f6-kubelet-config\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:08.082258 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082231 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-run-multus-certs\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082271 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a078366e-c775-4814-add1-59e187ad45ff-system-cni-dir\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082303 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a078366e-c775-4814-add1-59e187ad45ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082334 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-run-netns\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082355 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp2dz\" (UniqueName: \"kubernetes.io/projected/c578f83b-1d7a-4005-86bd-81363e3b25b6-kube-api-access-bp2dz\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082378 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqqqr\" (UniqueName: \"kubernetes.io/projected/9d2e9f3f-f036-427f-85ac-33212870137f-kube-api-access-dqqqr\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082405 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41c2bd6b-6311-4748-bdd0-45e75bb77ee1-host-slash\") pod \"iptables-alerter-96hz6\" (UID: \"41c2bd6b-6311-4748-bdd0-45e75bb77ee1\") " pod="openshift-network-operator/iptables-alerter-96hz6" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082430 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-545kn\" (UniqueName: \"kubernetes.io/projected/a078366e-c775-4814-add1-59e187ad45ff-kube-api-access-545kn\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082435 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41c2bd6b-6311-4748-bdd0-45e75bb77ee1-iptables-alerter-script\") pod \"iptables-alerter-96hz6\" (UID: \"41c2bd6b-6311-4748-bdd0-45e75bb77ee1\") " pod="openshift-network-operator/iptables-alerter-96hz6" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082455 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-627b8\" (UniqueName: \"kubernetes.io/projected/50528af2-db53-4024-bfe0-3a0ec40c3259-kube-api-access-627b8\") pod \"node-ca-b5lp8\" (UID: \"50528af2-db53-4024-bfe0-3a0ec40c3259\") " pod="openshift-image-registry/node-ca-b5lp8" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082478 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-var-lib-openvswitch\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082501 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c578f83b-1d7a-4005-86bd-81363e3b25b6-multus-daemon-config\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082524 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50528af2-db53-4024-bfe0-3a0ec40c3259-host\") pod \"node-ca-b5lp8\" (UID: \"50528af2-db53-4024-bfe0-3a0ec40c3259\") " pod="openshift-image-registry/node-ca-b5lp8" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082549 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082551 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c578f83b-1d7a-4005-86bd-81363e3b25b6-cni-binary-copy\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082575 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-kubelet\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082598 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-run-systemd\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.082631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082620 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-run-openvswitch\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082628 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41c2bd6b-6311-4748-bdd0-45e75bb77ee1-host-slash\") pod \"iptables-alerter-96hz6\" (UID: \"41c2bd6b-6311-4748-bdd0-45e75bb77ee1\") " pod="openshift-network-operator/iptables-alerter-96hz6" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082640 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-cni-bin\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082666 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a078366e-c775-4814-add1-59e187ad45ff-os-release\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082668 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-var-lib-cni-multus\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082679 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94fe717f-e61a-483a-bac8-be82ca3c7dc2-ovnkube-config\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082691 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-multus-conf-dir\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082707 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a078366e-c775-4814-add1-59e187ad45ff-system-cni-dir\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a078366e-c775-4814-add1-59e187ad45ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a078366e-c775-4814-add1-59e187ad45ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082799 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-var-lib-cni-bin\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082821 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e6de29a5-52d3-4e8c-b5a6-f283b237e186-konnectivity-ca\") pod \"konnectivity-agent-2d8tz\" (UID: \"e6de29a5-52d3-4e8c-b5a6-f283b237e186\") " pod="kube-system/konnectivity-agent-2d8tz" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082847 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-run-ovn-kubernetes\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082881 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a078366e-c775-4814-add1-59e187ad45ff-cnibin\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082904 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-multus-cni-dir\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-cnibin\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.082972 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-multus-socket-dir-parent\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.083315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083027 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s49cw\" (UniqueName: \"kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw\") pod \"network-check-target-ckbj8\" (UID: \"b9b3c957-c2a5-4f7f-966a-4ea80823ca1e\") " pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083067 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083072 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-var-lib-openvswitch\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083097 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-hostroot\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083127 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-run-ovn\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083130 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-run-netns\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083174 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-run-ovn\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083184 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-kubelet\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083211 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083231 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-run-systemd\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083243 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-node-log\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083250 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-run-ovn-kubernetes\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083270 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94fe717f-e61a-483a-bac8-be82ca3c7dc2-ovnkube-script-lib\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083274 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-run-openvswitch\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083295 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8z7l\" (UniqueName: \"kubernetes.io/projected/94fe717f-e61a-483a-bac8-be82ca3c7dc2-kube-api-access-c8z7l\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083298 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a078366e-c775-4814-add1-59e187ad45ff-cnibin\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083316 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-cni-bin\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083320 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-cni-netd\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083352 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44f2fe44-5b07-4d88-8271-081c442714f6-dbus\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083361 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-multus-cni-dir\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083376 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-var-lib-kubelet\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083378 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a078366e-c775-4814-add1-59e187ad45ff-os-release\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083391 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e6de29a5-52d3-4e8c-b5a6-f283b237e186-konnectivity-ca\") pod \"konnectivity-agent-2d8tz\" (UID: \"e6de29a5-52d3-4e8c-b5a6-f283b237e186\") " pod="kube-system/konnectivity-agent-2d8tz" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083407 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-cnibin\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083444 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-node-log\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083460 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50528af2-db53-4024-bfe0-3a0ec40c3259-host\") pod \"node-ca-b5lp8\" (UID: \"50528af2-db53-4024-bfe0-3a0ec40c3259\") " pod="openshift-image-registry/node-ca-b5lp8" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083499 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-multus-socket-dir-parent\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.083512 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083558 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44f2fe44-5b07-4d88-8271-081c442714f6-dbus\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.083567 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret podName:44f2fe44-5b07-4d88-8271-081c442714f6 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:08.583551776 +0000 UTC m=+3.031274116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret") pod "global-pull-secret-syncer-hbqlt" (UID: "44f2fe44-5b07-4d88-8271-081c442714f6") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083599 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-var-lib-kubelet\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083603 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a078366e-c775-4814-add1-59e187ad45ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083626 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-host-var-lib-cni-bin\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083656 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94fe717f-e61a-483a-bac8-be82ca3c7dc2-host-cni-netd\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083668 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-hostroot\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.084816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083688 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c578f83b-1d7a-4005-86bd-81363e3b25b6-multus-conf-dir\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.085430 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083692 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a078366e-c775-4814-add1-59e187ad45ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.085430 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.083771 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c578f83b-1d7a-4005-86bd-81363e3b25b6-multus-daemon-config\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.085430 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.084087 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a078366e-c775-4814-add1-59e187ad45ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.085430 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.084388 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94fe717f-e61a-483a-bac8-be82ca3c7dc2-ovnkube-script-lib\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.085430 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.084497 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94fe717f-e61a-483a-bac8-be82ca3c7dc2-env-overrides\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.085430 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.084765 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94fe717f-e61a-483a-bac8-be82ca3c7dc2-ovn-node-metrics-cert\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.086460 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.086439 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e6de29a5-52d3-4e8c-b5a6-f283b237e186-agent-certs\") pod \"konnectivity-agent-2d8tz\" (UID: \"e6de29a5-52d3-4e8c-b5a6-f283b237e186\") " pod="kube-system/konnectivity-agent-2d8tz" Jun 09 13:45:08.092330 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.092306 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzbsh\" (UniqueName: \"kubernetes.io/projected/41c2bd6b-6311-4748-bdd0-45e75bb77ee1-kube-api-access-fzbsh\") pod \"iptables-alerter-96hz6\" (UID: \"41c2bd6b-6311-4748-bdd0-45e75bb77ee1\") " pod="openshift-network-operator/iptables-alerter-96hz6" Jun 09 13:45:08.095254 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.094759 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:45:08.095254 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.094783 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:45:08.095254 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.094796 2558 projected.go:196] Error preparing data for projected volume kube-api-access-s49cw for pod openshift-network-diagnostics/network-check-target-ckbj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:08.095254 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.094870 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw podName:b9b3c957-c2a5-4f7f-966a-4ea80823ca1e nodeName:}" failed. No retries permitted until 2026-06-09 13:45:08.594851989 +0000 UTC m=+3.042574344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s49cw" (UniqueName: "kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw") pod "network-check-target-ckbj8" (UID: "b9b3c957-c2a5-4f7f-966a-4ea80823ca1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:08.096688 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.096522 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp2dz\" (UniqueName: \"kubernetes.io/projected/c578f83b-1d7a-4005-86bd-81363e3b25b6-kube-api-access-bp2dz\") pod \"multus-jf4fg\" (UID: \"c578f83b-1d7a-4005-86bd-81363e3b25b6\") " pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.096688 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.096623 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-627b8\" (UniqueName: \"kubernetes.io/projected/50528af2-db53-4024-bfe0-3a0ec40c3259-kube-api-access-627b8\") pod \"node-ca-b5lp8\" (UID: \"50528af2-db53-4024-bfe0-3a0ec40c3259\") " pod="openshift-image-registry/node-ca-b5lp8" Jun 09 13:45:08.097267 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.097249 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqqqr\" (UniqueName: \"kubernetes.io/projected/9d2e9f3f-f036-427f-85ac-33212870137f-kube-api-access-dqqqr\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:08.097488 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.097468 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-545kn\" (UniqueName: \"kubernetes.io/projected/a078366e-c775-4814-add1-59e187ad45ff-kube-api-access-545kn\") pod \"multus-additional-cni-plugins-6xk9k\" (UID: \"a078366e-c775-4814-add1-59e187ad45ff\") " pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.097541 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.097514 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8z7l\" (UniqueName: \"kubernetes.io/projected/94fe717f-e61a-483a-bac8-be82ca3c7dc2-kube-api-access-c8z7l\") pod \"ovnkube-node-gp8mh\" (UID: \"94fe717f-e61a-483a-bac8-be82ca3c7dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.178387 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.178345 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" Jun 09 13:45:08.186104 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.186079 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fh94h" Jun 09 13:45:08.195904 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.195886 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-96ng8" Jun 09 13:45:08.202336 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.202317 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2d8tz" Jun 09 13:45:08.209881 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.209857 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6xk9k" Jun 09 13:45:08.218351 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.218329 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jf4fg" Jun 09 13:45:08.225921 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.225894 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b5lp8" Jun 09 13:45:08.234608 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.234586 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-96hz6" Jun 09 13:45:08.239296 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.239280 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:08.586931 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.586900 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:08.587119 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.586948 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:08.587119 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.587074 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:08.587119 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.587082 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:08.587213 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.587134 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret podName:44f2fe44-5b07-4d88-8271-081c442714f6 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:09.587119612 +0000 UTC m=+4.034841948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret") pod "global-pull-secret-syncer-hbqlt" (UID: "44f2fe44-5b07-4d88-8271-081c442714f6") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:08.587213 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.587157 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs podName:9d2e9f3f-f036-427f-85ac-33212870137f nodeName:}" failed. No retries permitted until 2026-06-09 13:45:09.587140045 +0000 UTC m=+4.034862399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs") pod "network-metrics-daemon-5rz5l" (UID: "9d2e9f3f-f036-427f-85ac-33212870137f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:08.688255 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.688213 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s49cw\" (UniqueName: \"kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw\") pod \"network-check-target-ckbj8\" (UID: \"b9b3c957-c2a5-4f7f-966a-4ea80823ca1e\") " pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:08.688425 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.688359 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:45:08.688425 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.688379 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:45:08.688425 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.688391 2558 projected.go:196] Error preparing data for projected volume kube-api-access-s49cw for pod openshift-network-diagnostics/network-check-target-ckbj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:08.688549 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:08.688440 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw podName:b9b3c957-c2a5-4f7f-966a-4ea80823ca1e nodeName:}" failed. No retries permitted until 2026-06-09 13:45:09.688427232 +0000 UTC m=+4.136149566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s49cw" (UniqueName: "kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw") pod "network-check-target-ckbj8" (UID: "b9b3c957-c2a5-4f7f-966a-4ea80823ca1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:08.928762 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:08.928456 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc578f83b_1d7a_4005_86bd_81363e3b25b6.slice/crio-eb7dddc4f3b22b5f504d572e4fadc9e72cfaabf0aff7cdc1df597fc7e309fab3 WatchSource:0}: Error finding container eb7dddc4f3b22b5f504d572e4fadc9e72cfaabf0aff7cdc1df597fc7e309fab3: Status 404 returned error can't find the container with id eb7dddc4f3b22b5f504d572e4fadc9e72cfaabf0aff7cdc1df597fc7e309fab3 Jun 09 13:45:08.929618 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.929562 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 13:40:06 +0000 UTC" deadline="2027-12-23 04:33:24.775470359 +0000 UTC" Jun 09 13:45:08.929618 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.929618 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13478h48m15.845856063s" Jun 09 13:45:08.932457 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:08.932432 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3156ddf_2573_4c42_8de4_c0c79ebd8f80.slice/crio-69aa5cfa5ebf1fee0d2788f1eec6fe6df9c275947f6358d123b3a404a86a959b WatchSource:0}: Error finding container 69aa5cfa5ebf1fee0d2788f1eec6fe6df9c275947f6358d123b3a404a86a959b: Status 404 returned error can't find the container with id 69aa5cfa5ebf1fee0d2788f1eec6fe6df9c275947f6358d123b3a404a86a959b Jun 09 13:45:08.937205 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:08.937072 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f773273_9023_4a7a_a4dd_e024ac8ac0ed.slice/crio-fa27103bce0bf0ad587a57c8b35be6b7b34b84899b655995d1c54e5b297c9ded WatchSource:0}: Error finding container fa27103bce0bf0ad587a57c8b35be6b7b34b84899b655995d1c54e5b297c9ded: Status 404 returned error can't find the container with id fa27103bce0bf0ad587a57c8b35be6b7b34b84899b655995d1c54e5b297c9ded Jun 09 13:45:08.938826 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:08.938802 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5deb9474_9b35_49b0_99ce_52460fae8f28.slice/crio-e26b7a2e75dd41ba0d195a7720f26a3099ccb441f41570f587f2ea8a0f5b1389 WatchSource:0}: Error finding container e26b7a2e75dd41ba0d195a7720f26a3099ccb441f41570f587f2ea8a0f5b1389: Status 404 returned error can't find the container with id e26b7a2e75dd41ba0d195a7720f26a3099ccb441f41570f587f2ea8a0f5b1389 Jun 09 13:45:08.939524 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:08.939505 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda078366e_c775_4814_add1_59e187ad45ff.slice/crio-a047ced433d6961f51236081943ac24b6abf37eaa1c95bf19638f58df05ce582 WatchSource:0}: Error finding container a047ced433d6961f51236081943ac24b6abf37eaa1c95bf19638f58df05ce582: Status 404 returned error can't find the container with id a047ced433d6961f51236081943ac24b6abf37eaa1c95bf19638f58df05ce582 Jun 09 13:45:08.942339 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:08.941670 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50528af2_db53_4024_bfe0_3a0ec40c3259.slice/crio-fefda0ad2573920e34d549563ed94e204d33e8389d6ebb58825fefebb50a4bda WatchSource:0}: Error finding container fefda0ad2573920e34d549563ed94e204d33e8389d6ebb58825fefebb50a4bda: Status 404 returned error can't find the container with id fefda0ad2573920e34d549563ed94e204d33e8389d6ebb58825fefebb50a4bda Jun 09 13:45:08.942835 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:08.942527 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94fe717f_e61a_483a_bac8_be82ca3c7dc2.slice/crio-f1fe373758b3a175b20efb0ab1f6eeac04d9925aec10d27e38cdee1aa3498d94 WatchSource:0}: Error finding container f1fe373758b3a175b20efb0ab1f6eeac04d9925aec10d27e38cdee1aa3498d94: Status 404 returned error can't find the container with id f1fe373758b3a175b20efb0ab1f6eeac04d9925aec10d27e38cdee1aa3498d94 Jun 09 13:45:08.948841 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.948812 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b5lp8" event={"ID":"50528af2-db53-4024-bfe0-3a0ec40c3259","Type":"ContainerStarted","Data":"fefda0ad2573920e34d549563ed94e204d33e8389d6ebb58825fefebb50a4bda"} Jun 09 13:45:08.950048 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.950024 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" event={"ID":"5deb9474-9b35-49b0-99ce-52460fae8f28","Type":"ContainerStarted","Data":"e26b7a2e75dd41ba0d195a7720f26a3099ccb441f41570f587f2ea8a0f5b1389"} Jun 09 13:45:08.951300 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.951176 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fh94h" event={"ID":"2f773273-9023-4a7a-a4dd-e024ac8ac0ed","Type":"ContainerStarted","Data":"fa27103bce0bf0ad587a57c8b35be6b7b34b84899b655995d1c54e5b297c9ded"} Jun 09 13:45:08.952361 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.952334 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jf4fg" event={"ID":"c578f83b-1d7a-4005-86bd-81363e3b25b6","Type":"ContainerStarted","Data":"eb7dddc4f3b22b5f504d572e4fadc9e72cfaabf0aff7cdc1df597fc7e309fab3"} Jun 09 13:45:08.953577 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.953549 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" event={"ID":"94fe717f-e61a-483a-bac8-be82ca3c7dc2","Type":"ContainerStarted","Data":"f1fe373758b3a175b20efb0ab1f6eeac04d9925aec10d27e38cdee1aa3498d94"} Jun 09 13:45:08.954769 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.954750 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xk9k" event={"ID":"a078366e-c775-4814-add1-59e187ad45ff","Type":"ContainerStarted","Data":"a047ced433d6961f51236081943ac24b6abf37eaa1c95bf19638f58df05ce582"} Jun 09 13:45:08.956024 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.956000 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-96ng8" event={"ID":"f3156ddf-2573-4c42-8de4-c0c79ebd8f80","Type":"ContainerStarted","Data":"69aa5cfa5ebf1fee0d2788f1eec6fe6df9c275947f6358d123b3a404a86a959b"} Jun 09 13:45:08.957438 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.957419 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2d8tz" event={"ID":"e6de29a5-52d3-4e8c-b5a6-f283b237e186","Type":"ContainerStarted","Data":"70145d6c0c6110c060e60cfae1ee87dd5ca4ab4104c258c442de7633e81712b1"} Jun 09 13:45:08.958624 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:08.958595 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-96hz6" event={"ID":"41c2bd6b-6311-4748-bdd0-45e75bb77ee1","Type":"ContainerStarted","Data":"c979a6fcd465d21bf096babf61d4a928d00f5533697d3b739656d3cc1c8dcd59"} Jun 09 13:45:09.595253 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:09.595210 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:09.595444 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:09.595306 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:09.595444 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:09.595427 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:09.595550 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:09.595490 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret podName:44f2fe44-5b07-4d88-8271-081c442714f6 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:11.595469717 +0000 UTC m=+6.043192056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret") pod "global-pull-secret-syncer-hbqlt" (UID: "44f2fe44-5b07-4d88-8271-081c442714f6") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:09.595904 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:09.595882 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:09.596019 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:09.595942 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs podName:9d2e9f3f-f036-427f-85ac-33212870137f nodeName:}" failed. No retries permitted until 2026-06-09 13:45:11.595924085 +0000 UTC m=+6.043646424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs") pod "network-metrics-daemon-5rz5l" (UID: "9d2e9f3f-f036-427f-85ac-33212870137f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:09.697015 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:09.696363 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s49cw\" (UniqueName: \"kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw\") pod \"network-check-target-ckbj8\" (UID: \"b9b3c957-c2a5-4f7f-966a-4ea80823ca1e\") " pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:09.697015 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:09.696554 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:45:09.697015 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:09.696576 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:45:09.697015 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:09.696588 2558 projected.go:196] Error preparing data for projected volume kube-api-access-s49cw for pod openshift-network-diagnostics/network-check-target-ckbj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:09.697015 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:09.696647 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw podName:b9b3c957-c2a5-4f7f-966a-4ea80823ca1e nodeName:}" failed. No retries permitted until 2026-06-09 13:45:11.696627333 +0000 UTC m=+6.144349670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s49cw" (UniqueName: "kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw") pod "network-check-target-ckbj8" (UID: "b9b3c957-c2a5-4f7f-966a-4ea80823ca1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:09.940228 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:09.940143 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:09.940228 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:09.940189 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:09.941021 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:09.940297 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:09.941021 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:09.940661 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:09.941021 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:09.940763 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:09.941021 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:09.940810 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:09.991111 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:09.990840 2558 generic.go:356] "Generic (PLEG): container finished" podID="a0aff424d0f29020893887d0322a1d75" containerID="fa92f288af94e52c56c9fc0e31a7a2a23a4ddfb485d426a92decbd30f79511e0" exitCode=0 Jun 09 13:45:09.991111 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:09.991041 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal" event={"ID":"a0aff424d0f29020893887d0322a1d75","Type":"ContainerDied","Data":"fa92f288af94e52c56c9fc0e31a7a2a23a4ddfb485d426a92decbd30f79511e0"} Jun 09 13:45:10.002247 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:10.002107 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-4.ec2.internal" event={"ID":"b15aebb8a62392542274bac25b50b144","Type":"ContainerStarted","Data":"76b8f2a73825b0051de9201a053a66435dd373703c088c4c6ede94d4dbd2c2a5"} Jun 09 13:45:10.023240 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:10.022208 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-4.ec2.internal" podStartSLOduration=4.022187396 podStartE2EDuration="4.022187396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:10.021954307 +0000 UTC m=+4.469676665" watchObservedRunningTime="2026-06-09 13:45:10.022187396 +0000 UTC m=+4.469909755" Jun 09 13:45:11.037079 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:11.036994 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal" event={"ID":"a0aff424d0f29020893887d0322a1d75","Type":"ContainerStarted","Data":"c179725ce48e3905605a608bc2e4116a4ff39f663503ff44ecf60c7c6aa4ff58"} Jun 09 13:45:11.054080 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:11.054019 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-4.ec2.internal" podStartSLOduration=5.053998014 podStartE2EDuration="5.053998014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:11.052941943 +0000 UTC m=+5.500664300" watchObservedRunningTime="2026-06-09 13:45:11.053998014 +0000 UTC m=+5.501720372" Jun 09 13:45:11.614467 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:11.614100 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:11.614467 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:11.614195 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:11.614467 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:11.614280 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:11.614467 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:11.614339 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:11.614467 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:11.614361 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs podName:9d2e9f3f-f036-427f-85ac-33212870137f nodeName:}" failed. No retries permitted until 2026-06-09 13:45:15.614341846 +0000 UTC m=+10.062064180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs") pod "network-metrics-daemon-5rz5l" (UID: "9d2e9f3f-f036-427f-85ac-33212870137f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:11.614467 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:11.614389 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret podName:44f2fe44-5b07-4d88-8271-081c442714f6 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:15.614374235 +0000 UTC m=+10.062096582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret") pod "global-pull-secret-syncer-hbqlt" (UID: "44f2fe44-5b07-4d88-8271-081c442714f6") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:11.716005 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:11.715357 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s49cw\" (UniqueName: \"kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw\") pod \"network-check-target-ckbj8\" (UID: \"b9b3c957-c2a5-4f7f-966a-4ea80823ca1e\") " pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:11.716005 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:11.715535 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:45:11.716005 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:11.715556 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:45:11.716005 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:11.715568 2558 projected.go:196] Error preparing data for projected volume kube-api-access-s49cw for pod openshift-network-diagnostics/network-check-target-ckbj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:11.716005 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:11.715622 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw podName:b9b3c957-c2a5-4f7f-966a-4ea80823ca1e nodeName:}" failed. No retries permitted until 2026-06-09 13:45:15.715605651 +0000 UTC m=+10.163327993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s49cw" (UniqueName: "kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw") pod "network-check-target-ckbj8" (UID: "b9b3c957-c2a5-4f7f-966a-4ea80823ca1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:11.941136 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:11.940311 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:11.941136 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:11.940457 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:11.941136 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:11.940814 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:11.941136 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:11.940901 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:11.941136 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:11.940951 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:11.941136 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:11.941025 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:13.940239 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:13.939589 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:13.940239 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:13.939736 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:13.940239 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:13.940079 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:13.940239 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:13.940175 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:13.940822 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:13.940350 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:13.940822 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:13.940450 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:15.651239 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:15.650994 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:15.651239 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:15.651078 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:15.651239 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:15.651092 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:15.651239 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:15.651151 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs podName:9d2e9f3f-f036-427f-85ac-33212870137f nodeName:}" failed. No retries permitted until 2026-06-09 13:45:23.651133714 +0000 UTC m=+18.098856058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs") pod "network-metrics-daemon-5rz5l" (UID: "9d2e9f3f-f036-427f-85ac-33212870137f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:15.651239 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:15.651178 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:15.651239 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:15.651210 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret podName:44f2fe44-5b07-4d88-8271-081c442714f6 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:23.651199762 +0000 UTC m=+18.098922096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret") pod "global-pull-secret-syncer-hbqlt" (UID: "44f2fe44-5b07-4d88-8271-081c442714f6") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:15.752757 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:15.752160 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s49cw\" (UniqueName: \"kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw\") pod \"network-check-target-ckbj8\" (UID: \"b9b3c957-c2a5-4f7f-966a-4ea80823ca1e\") " pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:15.752757 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:15.752331 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:45:15.752757 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:15.752348 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:45:15.752757 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:15.752362 2558 projected.go:196] Error preparing data for projected volume kube-api-access-s49cw for pod openshift-network-diagnostics/network-check-target-ckbj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:15.752757 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:15.752425 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw podName:b9b3c957-c2a5-4f7f-966a-4ea80823ca1e nodeName:}" failed. No retries permitted until 2026-06-09 13:45:23.752408137 +0000 UTC m=+18.200130477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s49cw" (UniqueName: "kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw") pod "network-check-target-ckbj8" (UID: "b9b3c957-c2a5-4f7f-966a-4ea80823ca1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:15.943772 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:15.943508 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:15.943772 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:15.943672 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:15.944073 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:15.944035 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:15.944242 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:15.944192 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:15.944242 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:15.944242 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:15.944430 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:15.944371 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:17.940303 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:17.940262 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:17.940741 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:17.940398 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:17.940802 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:17.940743 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:17.940875 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:17.940853 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:17.940955 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:17.940933 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:17.941058 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:17.941021 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:19.939554 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:19.939466 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:19.939554 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:19.939507 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:19.940081 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:19.939465 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:19.940081 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:19.939587 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:19.940081 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:19.939645 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:19.940081 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:19.939715 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:21.943317 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:21.943284 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:21.943774 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:21.943394 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:21.943774 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:21.943403 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:21.943774 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:21.943444 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:21.943774 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:21.943534 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:21.943774 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:21.943609 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:23.719170 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:23.718895 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:23.719170 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:23.719152 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:23.719664 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:23.719078 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:23.719664 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:23.719265 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:23.719664 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:23.719272 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret podName:44f2fe44-5b07-4d88-8271-081c442714f6 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:39.719248163 +0000 UTC m=+34.166970512 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret") pod "global-pull-secret-syncer-hbqlt" (UID: "44f2fe44-5b07-4d88-8271-081c442714f6") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:23.719664 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:23.719311 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs podName:9d2e9f3f-f036-427f-85ac-33212870137f nodeName:}" failed. No retries permitted until 2026-06-09 13:45:39.719299109 +0000 UTC m=+34.167021443 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs") pod "network-metrics-daemon-5rz5l" (UID: "9d2e9f3f-f036-427f-85ac-33212870137f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:23.819490 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:23.819450 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s49cw\" (UniqueName: \"kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw\") pod \"network-check-target-ckbj8\" (UID: \"b9b3c957-c2a5-4f7f-966a-4ea80823ca1e\") " pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:23.819661 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:23.819633 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:45:23.819661 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:23.819660 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:45:23.819849 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:23.819673 2558 projected.go:196] Error preparing data for projected volume kube-api-access-s49cw for pod openshift-network-diagnostics/network-check-target-ckbj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:23.819849 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:23.819743 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw podName:b9b3c957-c2a5-4f7f-966a-4ea80823ca1e nodeName:}" failed. No retries permitted until 2026-06-09 13:45:39.819723978 +0000 UTC m=+34.267446312 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s49cw" (UniqueName: "kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw") pod "network-check-target-ckbj8" (UID: "b9b3c957-c2a5-4f7f-966a-4ea80823ca1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:23.939691 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:23.939652 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:23.939691 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:23.939697 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:23.939939 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:23.939652 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:23.939939 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:23.939769 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:23.939939 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:23.939843 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:23.939939 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:23.939931 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:25.940427 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:25.940390 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:25.940965 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:25.940482 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:25.940965 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:25.940494 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:25.940965 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:25.940618 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:25.940965 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:25.940676 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:25.940965 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:25.940720 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:27.939343 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:27.939308 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:27.939703 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:27.939308 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:27.939703 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:27.939428 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:27.939703 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:27.939308 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:27.939703 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:27.939496 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:27.939703 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:27.939576 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:29.077584 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.077411 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gp8mh_94fe717f-e61a-483a-bac8-be82ca3c7dc2/ovn-acl-logging/0.log" Jun 09 13:45:29.078329 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.077927 2558 generic.go:356] "Generic (PLEG): container finished" podID="94fe717f-e61a-483a-bac8-be82ca3c7dc2" containerID="aa898444f6d4ba91235ebb1547b9484f1b1f5edf06dfe1ae9fb384fe61ff6908" exitCode=1 Jun 09 13:45:29.078329 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.078013 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" event={"ID":"94fe717f-e61a-483a-bac8-be82ca3c7dc2","Type":"ContainerStarted","Data":"6942db00f081102824d7be5bb87cf5db2161ef18d0d9a5ec01ceefba32bf07f3"} Jun 09 13:45:29.078329 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.078133 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" event={"ID":"94fe717f-e61a-483a-bac8-be82ca3c7dc2","Type":"ContainerStarted","Data":"65f86ec300c079ba73c44aa8a0036a9078b1b6af024f98d7ab5db7e4d7bff6c3"} Jun 09 13:45:29.078329 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.078181 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" event={"ID":"94fe717f-e61a-483a-bac8-be82ca3c7dc2","Type":"ContainerStarted","Data":"23580a3bad4d713c5e2f249c7ba2e01a0f7f1fe4f43d4b6c66c1305df00424e1"} Jun 09 13:45:29.078329 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.078224 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" event={"ID":"94fe717f-e61a-483a-bac8-be82ca3c7dc2","Type":"ContainerStarted","Data":"2133ace92dac84f729101dfd0afd0fdd6bebff6fc6760afc1f7527fd8111dca9"} Jun 09 13:45:29.078329 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.078265 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" event={"ID":"94fe717f-e61a-483a-bac8-be82ca3c7dc2","Type":"ContainerDied","Data":"aa898444f6d4ba91235ebb1547b9484f1b1f5edf06dfe1ae9fb384fe61ff6908"} Jun 09 13:45:29.078329 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.078313 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" event={"ID":"94fe717f-e61a-483a-bac8-be82ca3c7dc2","Type":"ContainerStarted","Data":"0570eace67f82b9c4a6bff46dd67863eed7cefbd939aa22deb95ffdb46bf62af"} Jun 09 13:45:29.079524 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.079503 2558 generic.go:356] "Generic (PLEG): container finished" podID="a078366e-c775-4814-add1-59e187ad45ff" containerID="6c244ca0d98b8daa39f2894fa5a415e0adab36c03d8e78af3a0147dfb273e889" exitCode=0 Jun 09 13:45:29.079729 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.079583 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xk9k" event={"ID":"a078366e-c775-4814-add1-59e187ad45ff","Type":"ContainerDied","Data":"6c244ca0d98b8daa39f2894fa5a415e0adab36c03d8e78af3a0147dfb273e889"} Jun 09 13:45:29.083266 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.081995 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-96ng8" event={"ID":"f3156ddf-2573-4c42-8de4-c0c79ebd8f80","Type":"ContainerStarted","Data":"995501ab533af955c7b0e1cd57e8e8a24549c9b10f362a748351c5e87cefb730"} Jun 09 13:45:29.084501 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.084463 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2d8tz" event={"ID":"e6de29a5-52d3-4e8c-b5a6-f283b237e186","Type":"ContainerStarted","Data":"745a014eeab67fd5b756ec57a7ca5646ceb911d3757cb0999a3acdd383362545"} Jun 09 13:45:29.085785 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.085760 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b5lp8" event={"ID":"50528af2-db53-4024-bfe0-3a0ec40c3259","Type":"ContainerStarted","Data":"805f1f4e35c2c8d01b30da69b9461bec13d888cd7507eb5946e896fd4d6b9b1a"} Jun 09 13:45:29.087233 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.087214 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" event={"ID":"5deb9474-9b35-49b0-99ce-52460fae8f28","Type":"ContainerStarted","Data":"9a75b0b4481d8fefaa9cecacb1f8680c217388767d8fb778b71d782ae3586ddc"} Jun 09 13:45:29.088704 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.088679 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fh94h" event={"ID":"2f773273-9023-4a7a-a4dd-e024ac8ac0ed","Type":"ContainerStarted","Data":"f918aad368560eff5d65be9696d93942dfceeb5176e037c151b10d952a07d940"} Jun 09 13:45:29.090022 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.090002 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jf4fg" event={"ID":"c578f83b-1d7a-4005-86bd-81363e3b25b6","Type":"ContainerStarted","Data":"b6a5d0fadb79a83f6535e3d4300e5ca35ee2e9f220e77ed3e5e2b2a2e9f54c44"} Jun 09 13:45:29.118956 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.118911 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-96ng8" podStartSLOduration=4.016760753 podStartE2EDuration="23.118896567s" totalImagesPullingTime="19.102135814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:29.118645359 +0000 UTC m=+23.566367715" watchObservedRunningTime="2026-06-09 13:45:29.118896567 +0000 UTC m=+23.566618922" Jun 09 13:45:29.133007 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.132945 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b5lp8" podStartSLOduration=4.069464173 podStartE2EDuration="23.132930637s" totalImagesPullingTime="19.063466464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:29.132758662 +0000 UTC m=+23.580481019" watchObservedRunningTime="2026-06-09 13:45:29.132930637 +0000 UTC m=+23.580653034" Jun 09 13:45:29.149308 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.149264 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fh94h" podStartSLOduration=4.058312404 podStartE2EDuration="23.149249833s" totalImagesPullingTime="19.090937429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:29.148821397 +0000 UTC m=+23.596543752" watchObservedRunningTime="2026-06-09 13:45:29.149249833 +0000 UTC m=+23.596972188" Jun 09 13:45:29.165231 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.165192 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jf4fg" podStartSLOduration=4.04634055 podStartE2EDuration="23.165178654s" totalImagesPullingTime="19.118838104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:29.164961381 +0000 UTC m=+23.612683737" watchObservedRunningTime="2026-06-09 13:45:29.165178654 +0000 UTC m=+23.612901010" Jun 09 13:45:29.179604 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.179568 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2d8tz" podStartSLOduration=4.115641462 podStartE2EDuration="23.179552892s" totalImagesPullingTime="19.06391143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:29.179308294 +0000 UTC m=+23.627030650" watchObservedRunningTime="2026-06-09 13:45:29.179552892 +0000 UTC m=+23.627275441" Jun 09 13:45:29.230380 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.230339 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:29.287474 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.287444 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:29.389117 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.388940 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:29.498654 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.498625 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 13:45:29.939464 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.939285 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T13:45:29.498646594Z","UUID":"3cfa5f2b-4c1b-4b30-9ed6-009d47728338","Handler":null,"Name":"","Endpoint":""} Jun 09 13:45:29.941196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.941173 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 13:45:29.941342 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.941212 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 13:45:29.943110 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.943086 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:29.943278 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.943170 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:29.943278 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:29.943177 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:29.943278 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:29.943194 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:29.943278 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:29.943269 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:29.943534 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:29.943354 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:30.093749 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:30.093700 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-96hz6" event={"ID":"41c2bd6b-6311-4748-bdd0-45e75bb77ee1","Type":"ContainerStarted","Data":"9bb7e912d41cab65308224e5165b37b0348a17e431fc1241270a7ecd0eb4ea5e"} Jun 09 13:45:30.098830 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:30.098784 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" event={"ID":"5deb9474-9b35-49b0-99ce-52460fae8f28","Type":"ContainerStarted","Data":"c21083c8e2c62eb5d62c4473c09665e54df5ee2d311e0e2c65373d437e727da8"} Jun 09 13:45:30.110465 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:30.110420 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-96hz6" podStartSLOduration=5.046444823 podStartE2EDuration="24.110406095s" totalImagesPullingTime="19.063961272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:30.110017933 +0000 UTC m=+24.557740290" watchObservedRunningTime="2026-06-09 13:45:30.110406095 +0000 UTC m=+24.558128451" Jun 09 13:45:30.229623 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:30.229543 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:30.329338 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:30.329305 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:30.429894 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:30.429868 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:31.105144 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:31.105110 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gp8mh_94fe717f-e61a-483a-bac8-be82ca3c7dc2/ovn-acl-logging/0.log" Jun 09 13:45:31.105581 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:31.105553 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" event={"ID":"94fe717f-e61a-483a-bac8-be82ca3c7dc2","Type":"ContainerStarted","Data":"b0f0377c685a9fe7114c47c014388460eb6013c0cad1288445e7ec09a0a26c0d"} Jun 09 13:45:31.107868 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:31.107839 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" event={"ID":"5deb9474-9b35-49b0-99ce-52460fae8f28","Type":"ContainerStarted","Data":"ac27a9e6610437a844e74b49312340051570a1ad1ccb8794ba8e20bb38e0ea4d"} Jun 09 13:45:31.130415 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:31.130334 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmkv" podStartSLOduration=4.046903762 podStartE2EDuration="25.130319364s" totalImagesPullingTime="21.083415602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:31.129745869 +0000 UTC m=+25.577468224" watchObservedRunningTime="2026-06-09 13:45:31.130319364 +0000 UTC m=+25.578041719" Jun 09 13:45:31.404097 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:31.404012 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:31.469844 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:31.469812 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:31.939702 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:31.939663 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:31.939702 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:31.939680 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:31.939921 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:31.939667 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:31.939921 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:31.939772 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:31.939921 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:31.939854 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:31.939921 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:31.939911 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:32.443676 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:32.443645 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2d8tz" Jun 09 13:45:32.444294 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:32.444278 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2d8tz" Jun 09 13:45:33.119075 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:33.119043 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gp8mh_94fe717f-e61a-483a-bac8-be82ca3c7dc2/ovn-acl-logging/0.log" Jun 09 13:45:33.120297 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:33.120267 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" event={"ID":"94fe717f-e61a-483a-bac8-be82ca3c7dc2","Type":"ContainerStarted","Data":"5ebbe2829763004d28abf51c796fd345ca685aeed2c04ac93eb8aee66bd3e2b6"} Jun 09 13:45:33.120426 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:33.120361 2558 scope.go:117] "RemoveContainer" containerID="aa898444f6d4ba91235ebb1547b9484f1b1f5edf06dfe1ae9fb384fe61ff6908" Jun 09 13:45:33.120426 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:33.120382 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2d8tz" Jun 09 13:45:33.120549 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:33.120535 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:33.120687 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:33.120672 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:33.120865 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:33.120852 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2d8tz" Jun 09 13:45:33.121074 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:33.120973 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:33.139660 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:33.139637 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:33.141379 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:33.141358 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:45:33.190882 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:33.190828 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:33.940172 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:33.940139 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:33.940813 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:33.940139 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:33.940813 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:33.940271 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:33.940813 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:33.940139 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:33.940813 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:33.940353 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:33.940813 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:33.940445 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:34.126525 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:34.126497 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gp8mh_94fe717f-e61a-483a-bac8-be82ca3c7dc2/ovn-acl-logging/0.log" Jun 09 13:45:34.126920 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:34.126884 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" event={"ID":"94fe717f-e61a-483a-bac8-be82ca3c7dc2","Type":"ContainerStarted","Data":"efc0322143b51886312d8cf9e75c4c84ffd472de02c7599af8974f0cba307ea6"} Jun 09 13:45:34.157276 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:34.157228 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" podStartSLOduration=9.009133378 podStartE2EDuration="28.157211801s" totalImagesPullingTime="19.148078423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:34.156744856 +0000 UTC m=+28.604467233" watchObservedRunningTime="2026-06-09 13:45:34.157211801 +0000 UTC m=+28.604934157" Jun 09 13:45:34.977972 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:34.977819 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hbqlt"] Jun 09 13:45:34.978761 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:34.978005 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:34.978761 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:34.978115 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:34.980957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:34.980927 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5rz5l"] Jun 09 13:45:34.981154 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:34.981094 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:34.981285 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:34.981250 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:34.981743 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:34.981719 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ckbj8"] Jun 09 13:45:34.981834 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:34.981822 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:34.981934 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:34.981914 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:36.133532 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:36.133341 2558 generic.go:356] "Generic (PLEG): container finished" podID="a078366e-c775-4814-add1-59e187ad45ff" containerID="99464c745ca1ffb5adbb27edf123f3f085cedfdf50f483751aeead34358239e4" exitCode=0 Jun 09 13:45:36.133532 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:36.133430 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xk9k" event={"ID":"a078366e-c775-4814-add1-59e187ad45ff","Type":"ContainerDied","Data":"99464c745ca1ffb5adbb27edf123f3f085cedfdf50f483751aeead34358239e4"} Jun 09 13:45:36.939707 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:36.939681 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:36.939856 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:36.939685 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:36.939856 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:36.939790 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:36.939948 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:36.939686 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:36.939948 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:36.939886 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:36.940042 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:36.939997 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:37.137598 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:37.137560 2558 generic.go:356] "Generic (PLEG): container finished" podID="a078366e-c775-4814-add1-59e187ad45ff" containerID="5f4a6badf78d749c84e3be3079629f609522a21cadb43cc0b921306359ceeb83" exitCode=0 Jun 09 13:45:37.137964 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:37.137604 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xk9k" event={"ID":"a078366e-c775-4814-add1-59e187ad45ff","Type":"ContainerDied","Data":"5f4a6badf78d749c84e3be3079629f609522a21cadb43cc0b921306359ceeb83"} Jun 09 13:45:38.142209 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:38.142127 2558 generic.go:356] "Generic (PLEG): container finished" podID="a078366e-c775-4814-add1-59e187ad45ff" containerID="fdcd07ad77b1c3e52c08094f8cf4e72bba333530b16da9aeae756a567cbc4a84" exitCode=0 Jun 09 13:45:38.142209 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:38.142174 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xk9k" event={"ID":"a078366e-c775-4814-add1-59e187ad45ff","Type":"ContainerDied","Data":"fdcd07ad77b1c3e52c08094f8cf4e72bba333530b16da9aeae756a567cbc4a84"} Jun 09 13:45:38.940200 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:38.940158 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:38.940392 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:38.940272 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:38.940392 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:38.940284 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:38.940392 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:38.940299 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:38.940392 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:38.940359 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:38.940582 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:38.940426 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:39.738364 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:39.738328 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:39.738820 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:39.738376 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:39.738820 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:39.738476 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:39.738820 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:39.738492 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:39.738820 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:39.738534 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs podName:9d2e9f3f-f036-427f-85ac-33212870137f nodeName:}" failed. No retries permitted until 2026-06-09 13:46:11.738519898 +0000 UTC m=+66.186242232 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs") pod "network-metrics-daemon-5rz5l" (UID: "9d2e9f3f-f036-427f-85ac-33212870137f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:39.738820 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:39.738561 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret podName:44f2fe44-5b07-4d88-8271-081c442714f6 nodeName:}" failed. No retries permitted until 2026-06-09 13:46:11.738543491 +0000 UTC m=+66.186265827 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret") pod "global-pull-secret-syncer-hbqlt" (UID: "44f2fe44-5b07-4d88-8271-081c442714f6") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:39.839262 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:39.839220 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s49cw\" (UniqueName: \"kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw\") pod \"network-check-target-ckbj8\" (UID: \"b9b3c957-c2a5-4f7f-966a-4ea80823ca1e\") " pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:39.839439 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:39.839387 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:45:39.839439 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:39.839405 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:45:39.839439 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:39.839416 2558 projected.go:196] Error preparing data for projected volume kube-api-access-s49cw for pod openshift-network-diagnostics/network-check-target-ckbj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:39.839549 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:39.839481 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw podName:b9b3c957-c2a5-4f7f-966a-4ea80823ca1e nodeName:}" failed. No retries permitted until 2026-06-09 13:46:11.839463632 +0000 UTC m=+66.287185979 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s49cw" (UniqueName: "kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw") pod "network-check-target-ckbj8" (UID: "b9b3c957-c2a5-4f7f-966a-4ea80823ca1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:40.521115 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:40.521082 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:40.574261 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:40.574217 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:40.939806 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:40.939723 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:40.939806 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:40.939764 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:40.940241 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:40.939831 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:40.940241 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:40.939847 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ckbj8" podUID="b9b3c957-c2a5-4f7f-966a-4ea80823ca1e" Jun 09 13:45:40.940241 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:40.939894 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbqlt" podUID="44f2fe44-5b07-4d88-8271-081c442714f6" Jun 09 13:45:40.940241 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:40.940003 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:45:41.873289 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.873259 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-4.ec2.internal" event="NodeReady" Jun 09 13:45:41.873482 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.873402 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 13:45:41.925212 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.925114 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ppk28"] Jun 09 13:45:41.958364 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.958333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:41.961198 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.961170 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 13:45:41.961480 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.961465 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7smxg\"" Jun 09 13:45:41.961791 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.961772 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 13:45:41.962182 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.962156 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8w6fp"] Jun 09 13:45:41.978711 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.978686 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ppk28"] Jun 09 13:45:41.978711 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.978711 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8w6fp" Jun 09 13:45:41.978905 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.978745 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8w6fp"] Jun 09 13:45:41.982029 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.982005 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 13:45:41.982745 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.982463 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-d6s2d\"" Jun 09 13:45:41.982745 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.982543 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 13:45:41.982745 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:41.982548 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 13:45:42.025312 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.025268 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:42.057559 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.057519 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d086613-2feb-4bf5-bcc3-488f6e280503-cert\") pod \"ingress-canary-8w6fp\" (UID: \"0d086613-2feb-4bf5-bcc3-488f6e280503\") " pod="openshift-ingress-canary/ingress-canary-8w6fp" Jun 09 13:45:42.057559 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.057568 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/32cb4473-dcd4-49a0-a77b-947ef606801b-config-volume\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:42.057802 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.057598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4d6m\" (UniqueName: \"kubernetes.io/projected/32cb4473-dcd4-49a0-a77b-947ef606801b-kube-api-access-v4d6m\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:42.057802 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.057716 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:42.057802 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.057750 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcgqt\" (UniqueName: \"kubernetes.io/projected/0d086613-2feb-4bf5-bcc3-488f6e280503-kube-api-access-wcgqt\") pod \"ingress-canary-8w6fp\" (UID: \"0d086613-2feb-4bf5-bcc3-488f6e280503\") " pod="openshift-ingress-canary/ingress-canary-8w6fp" Jun 09 13:45:42.057802 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.057790 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32cb4473-dcd4-49a0-a77b-947ef606801b-tmp-dir\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:42.088651 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.088611 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:42.159149 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.159114 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d086613-2feb-4bf5-bcc3-488f6e280503-cert\") pod \"ingress-canary-8w6fp\" (UID: \"0d086613-2feb-4bf5-bcc3-488f6e280503\") " pod="openshift-ingress-canary/ingress-canary-8w6fp" Jun 09 13:45:42.159149 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.159158 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/32cb4473-dcd4-49a0-a77b-947ef606801b-config-volume\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:42.159399 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.159189 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4d6m\" (UniqueName: \"kubernetes.io/projected/32cb4473-dcd4-49a0-a77b-947ef606801b-kube-api-access-v4d6m\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:42.159399 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.159236 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:42.159399 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.159264 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcgqt\" (UniqueName: \"kubernetes.io/projected/0d086613-2feb-4bf5-bcc3-488f6e280503-kube-api-access-wcgqt\") pod \"ingress-canary-8w6fp\" (UID: \"0d086613-2feb-4bf5-bcc3-488f6e280503\") " pod="openshift-ingress-canary/ingress-canary-8w6fp" Jun 09 13:45:42.159525 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.159465 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32cb4473-dcd4-49a0-a77b-947ef606801b-tmp-dir\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:42.159662 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:42.159637 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:45:42.159904 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:42.159703 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls podName:32cb4473-dcd4-49a0-a77b-947ef606801b nodeName:}" failed. No retries permitted until 2026-06-09 13:45:42.659682621 +0000 UTC m=+37.107404959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls") pod "dns-default-ppk28" (UID: "32cb4473-dcd4-49a0-a77b-947ef606801b") : secret "dns-default-metrics-tls" not found Jun 09 13:45:42.160026 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.159780 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32cb4473-dcd4-49a0-a77b-947ef606801b-tmp-dir\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:42.160026 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.159972 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/32cb4473-dcd4-49a0-a77b-947ef606801b-config-volume\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:42.164420 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.164395 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d086613-2feb-4bf5-bcc3-488f6e280503-cert\") pod \"ingress-canary-8w6fp\" (UID: \"0d086613-2feb-4bf5-bcc3-488f6e280503\") " pod="openshift-ingress-canary/ingress-canary-8w6fp" Jun 09 13:45:42.169428 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.169401 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4d6m\" (UniqueName: \"kubernetes.io/projected/32cb4473-dcd4-49a0-a77b-947ef606801b-kube-api-access-v4d6m\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:42.169616 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.169510 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcgqt\" (UniqueName: \"kubernetes.io/projected/0d086613-2feb-4bf5-bcc3-488f6e280503-kube-api-access-wcgqt\") pod \"ingress-canary-8w6fp\" (UID: \"0d086613-2feb-4bf5-bcc3-488f6e280503\") " pod="openshift-ingress-canary/ingress-canary-8w6fp" Jun 09 13:45:42.289068 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.289028 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8w6fp" Jun 09 13:45:42.664649 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.664552 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:42.664795 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:42.664685 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:45:42.664795 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:42.664766 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls podName:32cb4473-dcd4-49a0-a77b-947ef606801b nodeName:}" failed. No retries permitted until 2026-06-09 13:45:43.664743568 +0000 UTC m=+38.112465907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls") pod "dns-default-ppk28" (UID: "32cb4473-dcd4-49a0-a77b-947ef606801b") : secret "dns-default-metrics-tls" not found Jun 09 13:45:42.939434 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.939406 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:45:42.939578 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.939450 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:45:42.939578 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.939481 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:45:42.942628 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.942608 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 13:45:42.943791 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.943664 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 13:45:42.943791 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.943687 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h4kfs\"" Jun 09 13:45:42.943791 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.943733 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 13:45:42.943791 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.943750 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 13:45:42.943791 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.943756 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-htm2v\"" Jun 09 13:45:42.997572 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:42.997529 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8w6fp"] Jun 09 13:45:43.026313 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:45:43.026275 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d086613_2feb_4bf5_bcc3_488f6e280503.slice/crio-0f32f3e7b27de1ebfb89afad1ba059c36716a42f24271615274951992a926993 WatchSource:0}: Error finding container 0f32f3e7b27de1ebfb89afad1ba059c36716a42f24271615274951992a926993: Status 404 returned error can't find the container with id 0f32f3e7b27de1ebfb89afad1ba059c36716a42f24271615274951992a926993 Jun 09 13:45:43.155322 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:43.155295 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8w6fp" event={"ID":"0d086613-2feb-4bf5-bcc3-488f6e280503","Type":"ContainerStarted","Data":"0f32f3e7b27de1ebfb89afad1ba059c36716a42f24271615274951992a926993"} Jun 09 13:45:43.675204 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:43.675169 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:43.675353 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:43.675307 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:45:43.675389 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:43.675369 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls podName:32cb4473-dcd4-49a0-a77b-947ef606801b nodeName:}" failed. No retries permitted until 2026-06-09 13:45:45.675352138 +0000 UTC m=+40.123074477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls") pod "dns-default-ppk28" (UID: "32cb4473-dcd4-49a0-a77b-947ef606801b") : secret "dns-default-metrics-tls" not found Jun 09 13:45:44.163787 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:44.163756 2558 generic.go:356] "Generic (PLEG): container finished" podID="a078366e-c775-4814-add1-59e187ad45ff" containerID="28004c8fa02858149afb910f194a6ef90872fc5148efb4c6dcea05081d0b5a2f" exitCode=0 Jun 09 13:45:44.164293 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:44.163813 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xk9k" event={"ID":"a078366e-c775-4814-add1-59e187ad45ff","Type":"ContainerDied","Data":"28004c8fa02858149afb910f194a6ef90872fc5148efb4c6dcea05081d0b5a2f"} Jun 09 13:45:45.169745 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:45.169713 2558 generic.go:356] "Generic (PLEG): container finished" podID="a078366e-c775-4814-add1-59e187ad45ff" containerID="0b108230b9989b1342e378c041fde76e6882a99ca1be5a4ce9cc53a525af6ded" exitCode=0 Jun 09 13:45:45.170272 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:45.169763 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xk9k" event={"ID":"a078366e-c775-4814-add1-59e187ad45ff","Type":"ContainerDied","Data":"0b108230b9989b1342e378c041fde76e6882a99ca1be5a4ce9cc53a525af6ded"} Jun 09 13:45:45.691748 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:45.691708 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:45.691905 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:45.691851 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:45:45.691954 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:45.691913 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls podName:32cb4473-dcd4-49a0-a77b-947ef606801b nodeName:}" failed. No retries permitted until 2026-06-09 13:45:49.691895334 +0000 UTC m=+44.139617668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls") pod "dns-default-ppk28" (UID: "32cb4473-dcd4-49a0-a77b-947ef606801b") : secret "dns-default-metrics-tls" not found Jun 09 13:45:46.143494 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:46.143402 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:46.175709 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:46.175675 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8w6fp" event={"ID":"0d086613-2feb-4bf5-bcc3-488f6e280503","Type":"ContainerStarted","Data":"426f9a2e823fc54a8e552264a9da4f037a6eba26d4a93ef196b5eb90b9a817e3"} Jun 09 13:45:46.179174 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:46.179145 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xk9k" event={"ID":"a078366e-c775-4814-add1-59e187ad45ff","Type":"ContainerStarted","Data":"ebe968c4b6e0456faec616e53d1d00425bead731842683f5d5c0acd0e6f6761f"} Jun 09 13:45:46.192050 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:46.191969 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8w6fp" podStartSLOduration=2.355757195 podStartE2EDuration="5.191947621s" totalImagesPullingTime="2.836190426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:46.191870897 +0000 UTC m=+40.639593253" watchObservedRunningTime="2026-06-09 13:45:46.191947621 +0000 UTC m=+40.639669979" Jun 09 13:45:46.213551 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:46.213497 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6xk9k" podStartSLOduration=8.32220744 podStartE2EDuration="40.213482705s" totalImagesPullingTime="31.891275265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:46.211735247 +0000 UTC m=+40.659457602" watchObservedRunningTime="2026-06-09 13:45:46.213482705 +0000 UTC m=+40.661205061" Jun 09 13:45:46.344791 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:46.344715 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:46.411012 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:46.410887 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:45:49.722934 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:49.722895 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:49.723342 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:49.723082 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:45:49.723342 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:49.723153 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls podName:32cb4473-dcd4-49a0-a77b-947ef606801b nodeName:}" failed. No retries permitted until 2026-06-09 13:45:57.723135269 +0000 UTC m=+52.170857624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls") pod "dns-default-ppk28" (UID: "32cb4473-dcd4-49a0-a77b-947ef606801b") : secret "dns-default-metrics-tls" not found Jun 09 13:45:57.772554 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:45:57.772508 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:45:57.773125 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:57.772642 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:45:57.773125 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:45:57.772702 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls podName:32cb4473-dcd4-49a0-a77b-947ef606801b nodeName:}" failed. No retries permitted until 2026-06-09 13:46:13.77268465 +0000 UTC m=+68.220406983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls") pod "dns-default-ppk28" (UID: "32cb4473-dcd4-49a0-a77b-947ef606801b") : secret "dns-default-metrics-tls" not found Jun 09 13:46:05.140844 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:05.140812 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp8mh" Jun 09 13:46:05.256782 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:05.256737 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:46:05.317266 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:05.317239 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:46:11.765158 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:11.765101 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:46:11.765158 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:11.765164 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:46:11.768180 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:11.768155 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 13:46:11.768180 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:11.768172 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 13:46:11.776288 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:46:11.776272 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 13:46:11.776372 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:46:11.776358 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs podName:9d2e9f3f-f036-427f-85ac-33212870137f nodeName:}" failed. No retries permitted until 2026-06-09 13:47:15.77633429 +0000 UTC m=+130.224056641 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs") pod "network-metrics-daemon-5rz5l" (UID: "9d2e9f3f-f036-427f-85ac-33212870137f") : secret "metrics-daemon-secret" not found Jun 09 13:46:11.779688 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:11.779664 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44f2fe44-5b07-4d88-8271-081c442714f6-original-pull-secret\") pod \"global-pull-secret-syncer-hbqlt\" (UID: \"44f2fe44-5b07-4d88-8271-081c442714f6\") " pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:46:11.866298 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:11.866242 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s49cw\" (UniqueName: \"kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw\") pod \"network-check-target-ckbj8\" (UID: \"b9b3c957-c2a5-4f7f-966a-4ea80823ca1e\") " pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:46:11.869279 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:11.869255 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 13:46:11.879167 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:11.879137 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 13:46:11.889659 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:11.889635 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s49cw\" (UniqueName: \"kubernetes.io/projected/b9b3c957-c2a5-4f7f-966a-4ea80823ca1e-kube-api-access-s49cw\") pod \"network-check-target-ckbj8\" (UID: \"b9b3c957-c2a5-4f7f-966a-4ea80823ca1e\") " pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:46:12.055330 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:12.055236 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h4kfs\"" Jun 09 13:46:12.058637 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:12.058619 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbqlt" Jun 09 13:46:12.062206 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:12.062177 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:46:12.194256 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:12.194224 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ckbj8"] Jun 09 13:46:12.197054 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:46:12.197026 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b3c957_c2a5_4f7f_966a_4ea80823ca1e.slice/crio-d4b0d26a4314bed6c2e72291b5043d42af53a361836405fdc990a24f4626519e WatchSource:0}: Error finding container d4b0d26a4314bed6c2e72291b5043d42af53a361836405fdc990a24f4626519e: Status 404 returned error can't find the container with id d4b0d26a4314bed6c2e72291b5043d42af53a361836405fdc990a24f4626519e Jun 09 13:46:12.205882 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:12.205833 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hbqlt"] Jun 09 13:46:12.210290 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:46:12.210263 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44f2fe44_5b07_4d88_8271_081c442714f6.slice/crio-fc3871b186937bc5767e63f37d8c8cc88efb238f7809938ef35c91c94e21ba8d WatchSource:0}: Error finding container fc3871b186937bc5767e63f37d8c8cc88efb238f7809938ef35c91c94e21ba8d: Status 404 returned error can't find the container with id fc3871b186937bc5767e63f37d8c8cc88efb238f7809938ef35c91c94e21ba8d Jun 09 13:46:12.245418 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:12.245379 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hbqlt" event={"ID":"44f2fe44-5b07-4d88-8271-081c442714f6","Type":"ContainerStarted","Data":"fc3871b186937bc5767e63f37d8c8cc88efb238f7809938ef35c91c94e21ba8d"} Jun 09 13:46:12.246497 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:12.246473 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ckbj8" event={"ID":"b9b3c957-c2a5-4f7f-966a-4ea80823ca1e","Type":"ContainerStarted","Data":"d4b0d26a4314bed6c2e72291b5043d42af53a361836405fdc990a24f4626519e"} Jun 09 13:46:13.780309 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:13.780262 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:46:13.780750 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:46:13.780423 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:46:13.780750 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:46:13.780487 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls podName:32cb4473-dcd4-49a0-a77b-947ef606801b nodeName:}" failed. No retries permitted until 2026-06-09 13:46:45.7804685 +0000 UTC m=+100.228190861 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls") pod "dns-default-ppk28" (UID: "32cb4473-dcd4-49a0-a77b-947ef606801b") : secret "dns-default-metrics-tls" not found Jun 09 13:46:17.262180 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:17.262136 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hbqlt" event={"ID":"44f2fe44-5b07-4d88-8271-081c442714f6","Type":"ContainerStarted","Data":"e4b6e8277c5982961f67e04c09c7e7dcbe464a21178fd2fe9036c7decfc7b55b"} Jun 09 13:46:17.263611 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:17.263587 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ckbj8" event={"ID":"b9b3c957-c2a5-4f7f-966a-4ea80823ca1e","Type":"ContainerStarted","Data":"76778989500b0cd8092d482b203c610bd2ec693804a83aac22feb6965e1757a7"} Jun 09 13:46:17.263728 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:17.263711 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:46:17.280014 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:17.279951 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hbqlt" podStartSLOduration=66.548844391 podStartE2EDuration="1m11.279936801s" totalImagesPullingTime="4.73109241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:46:17.278933014 +0000 UTC m=+71.726655383" watchObservedRunningTime="2026-06-09 13:46:17.279936801 +0000 UTC m=+71.727659149" Jun 09 13:46:17.293068 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:17.293020 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ckbj8" podStartSLOduration=66.560015415 podStartE2EDuration="1m11.293005992s" totalImagesPullingTime="4.732990577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:46:17.2919448 +0000 UTC m=+71.739667168" watchObservedRunningTime="2026-06-09 13:46:17.293005992 +0000 UTC m=+71.740728339" Jun 09 13:46:45.795295 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:45.795250 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:46:45.795711 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:46:45.795424 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:46:45.795711 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:46:45.795513 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls podName:32cb4473-dcd4-49a0-a77b-947ef606801b nodeName:}" failed. No retries permitted until 2026-06-09 13:47:49.795495854 +0000 UTC m=+164.243218191 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls") pod "dns-default-ppk28" (UID: "32cb4473-dcd4-49a0-a77b-947ef606801b") : secret "dns-default-metrics-tls" not found Jun 09 13:46:48.269371 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:46:48.269338 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ckbj8" Jun 09 13:47:15.796888 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:47:15.796820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:47:15.797448 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:47:15.796996 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 13:47:15.797448 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:47:15.797082 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs podName:9d2e9f3f-f036-427f-85ac-33212870137f nodeName:}" failed. No retries permitted until 2026-06-09 13:49:17.797059724 +0000 UTC m=+252.244782065 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs") pod "network-metrics-daemon-5rz5l" (UID: "9d2e9f3f-f036-427f-85ac-33212870137f") : secret "metrics-daemon-secret" not found Jun 09 13:47:44.970411 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:47:44.970312 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ppk28" podUID="32cb4473-dcd4-49a0-a77b-947ef606801b" Jun 09 13:47:45.468621 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:47:45.468591 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ppk28" Jun 09 13:47:45.963350 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:47:45.963310 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5rz5l" podUID="9d2e9f3f-f036-427f-85ac-33212870137f" Jun 09 13:47:49.817939 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:47:49.817882 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:47:49.818477 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:47:49.818074 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:47:49.818477 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:47:49.818162 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls podName:32cb4473-dcd4-49a0-a77b-947ef606801b nodeName:}" failed. No retries permitted until 2026-06-09 13:49:51.818135996 +0000 UTC m=+286.265858330 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls") pod "dns-default-ppk28" (UID: "32cb4473-dcd4-49a0-a77b-947ef606801b") : secret "dns-default-metrics-tls" not found Jun 09 13:47:51.175743 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:47:51.175696 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:00.940307 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:00.940216 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:48:14.482439 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.482394 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r"] Jun 09 13:48:14.484127 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.484110 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" Jun 09 13:48:14.486870 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.486848 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:48:14.488566 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.488538 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 13:48:14.488955 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.488583 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gd9fc\"" Jun 09 13:48:14.489136 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.488608 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 13:48:14.489448 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.488666 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 13:48:14.492303 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.491749 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk"] Jun 09 13:48:14.493912 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.493891 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-668858dbc7-7wp8j"] Jun 09 13:48:14.494039 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.494021 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" Jun 09 13:48:14.495878 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.495861 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:14.496787 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.496765 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 13:48:14.497083 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.497065 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pqzpp\"" Jun 09 13:48:14.497262 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.497242 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r"] Jun 09 13:48:14.497339 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.497280 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:48:14.497339 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.497292 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 13:48:14.497339 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.497316 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 13:48:14.498300 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.498282 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 09 13:48:14.498586 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.498555 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jftw7\"" Jun 09 13:48:14.498676 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.498573 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 09 13:48:14.498735 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.498673 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 13:48:14.499009 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.498972 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 09 13:48:14.499115 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.498994 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 09 13:48:14.499115 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.498997 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 13:48:14.506906 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.506881 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk"] Jun 09 13:48:14.511031 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.511008 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-668858dbc7-7wp8j"] Jun 09 13:48:14.583838 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.583806 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/835718d8-f0eb-43eb-abf2-bb692fed6a79-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tczfk\" (UID: \"835718d8-f0eb-43eb-abf2-bb692fed6a79\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" Jun 09 13:48:14.583838 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.583840 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-default-certificate\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:14.584099 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.583859 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:14.584099 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.583881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28ed990b-7f1d-479f-9cb1-15ed52a29889-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-8zn6r\" (UID: \"28ed990b-7f1d-479f-9cb1-15ed52a29889\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" Jun 09 13:48:14.584099 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.583974 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/835718d8-f0eb-43eb-abf2-bb692fed6a79-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tczfk\" (UID: \"835718d8-f0eb-43eb-abf2-bb692fed6a79\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" Jun 09 13:48:14.584099 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.584026 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smck4\" (UniqueName: \"kubernetes.io/projected/835718d8-f0eb-43eb-abf2-bb692fed6a79-kube-api-access-smck4\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tczfk\" (UID: \"835718d8-f0eb-43eb-abf2-bb692fed6a79\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" Jun 09 13:48:14.584099 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.584048 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-stats-auth\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:14.584099 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.584075 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcdkn\" (UniqueName: \"kubernetes.io/projected/28ed990b-7f1d-479f-9cb1-15ed52a29889-kube-api-access-bcdkn\") pod \"service-ca-operator-6bc5ff68f5-8zn6r\" (UID: \"28ed990b-7f1d-479f-9cb1-15ed52a29889\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" Jun 09 13:48:14.584099 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.584098 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddv5g\" (UniqueName: \"kubernetes.io/projected/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-kube-api-access-ddv5g\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:14.584324 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.584116 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28ed990b-7f1d-479f-9cb1-15ed52a29889-config\") pod \"service-ca-operator-6bc5ff68f5-8zn6r\" (UID: \"28ed990b-7f1d-479f-9cb1-15ed52a29889\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" Jun 09 13:48:14.584324 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.584168 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:14.586598 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.586575 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd"] Jun 09 13:48:14.588387 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.588369 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bc44d6689-thr5h"] Jun 09 13:48:14.588497 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.588481 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" Jun 09 13:48:14.590044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.590027 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.591431 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.591415 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 13:48:14.592134 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.592118 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5dvn4\"" Jun 09 13:48:14.592243 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.592227 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 13:48:14.592352 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.592331 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 13:48:14.592592 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.592577 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hrcxt\"" Jun 09 13:48:14.592664 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.592629 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 13:48:14.592847 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.592832 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 13:48:14.601323 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.601299 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 13:48:14.604029 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.604008 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd"] Jun 09 13:48:14.610484 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.610461 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bc44d6689-thr5h"] Jun 09 13:48:14.685520 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.685476 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/835718d8-f0eb-43eb-abf2-bb692fed6a79-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tczfk\" (UID: \"835718d8-f0eb-43eb-abf2-bb692fed6a79\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" Jun 09 13:48:14.685520 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.685517 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-sz6zd\" (UID: \"41d47fdd-eed4-4d5e-aefe-0c0064e2511f\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" Jun 09 13:48:14.685750 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.685541 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-installation-pull-secrets\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.685750 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.685568 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddv5g\" (UniqueName: \"kubernetes.io/projected/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-kube-api-access-ddv5g\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:14.685750 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.685608 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-stats-auth\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:14.685750 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.685643 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-trusted-ca\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.685750 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.685668 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qg8t\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-kube-api-access-9qg8t\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.685750 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.685694 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smck4\" (UniqueName: \"kubernetes.io/projected/835718d8-f0eb-43eb-abf2-bb692fed6a79-kube-api-access-smck4\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tczfk\" (UID: \"835718d8-f0eb-43eb-abf2-bb692fed6a79\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" Jun 09 13:48:14.686087 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.685802 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.686087 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.685850 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:14.686087 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.685875 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sz6zd\" (UID: \"41d47fdd-eed4-4d5e-aefe-0c0064e2511f\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" Jun 09 13:48:14.686087 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.685918 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-image-registry-private-configuration\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.686087 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:14.685966 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 13:48:14.686087 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:14.686068 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs podName:6d34e2ed-b066-4106-a582-9a90c7d0cbaf nodeName:}" failed. No retries permitted until 2026-06-09 13:48:15.186047849 +0000 UTC m=+189.633770202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs") pod "router-default-668858dbc7-7wp8j" (UID: "6d34e2ed-b066-4106-a582-9a90c7d0cbaf") : secret "router-metrics-certs-default" not found Jun 09 13:48:14.686387 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.686092 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-default-certificate\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:14.686387 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.686121 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-ca-trust-extracted\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.686387 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.686157 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28ed990b-7f1d-479f-9cb1-15ed52a29889-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-8zn6r\" (UID: \"28ed990b-7f1d-479f-9cb1-15ed52a29889\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" Jun 09 13:48:14.686387 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.686181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-certificates\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.686387 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.686191 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/835718d8-f0eb-43eb-abf2-bb692fed6a79-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tczfk\" (UID: \"835718d8-f0eb-43eb-abf2-bb692fed6a79\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" Jun 09 13:48:14.686387 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.686216 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/835718d8-f0eb-43eb-abf2-bb692fed6a79-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tczfk\" (UID: \"835718d8-f0eb-43eb-abf2-bb692fed6a79\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" Jun 09 13:48:14.686387 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.686253 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28ed990b-7f1d-479f-9cb1-15ed52a29889-config\") pod \"service-ca-operator-6bc5ff68f5-8zn6r\" (UID: \"28ed990b-7f1d-479f-9cb1-15ed52a29889\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" Jun 09 13:48:14.686387 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.686293 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcdkn\" (UniqueName: \"kubernetes.io/projected/28ed990b-7f1d-479f-9cb1-15ed52a29889-kube-api-access-bcdkn\") pod \"service-ca-operator-6bc5ff68f5-8zn6r\" (UID: \"28ed990b-7f1d-479f-9cb1-15ed52a29889\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" Jun 09 13:48:14.686745 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.686418 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:14.686745 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.686463 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-bound-sa-token\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.686745 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:14.686603 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle podName:6d34e2ed-b066-4106-a582-9a90c7d0cbaf nodeName:}" failed. No retries permitted until 2026-06-09 13:48:15.18658823 +0000 UTC m=+189.634310584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle") pod "router-default-668858dbc7-7wp8j" (UID: "6d34e2ed-b066-4106-a582-9a90c7d0cbaf") : configmap references non-existent config key: service-ca.crt Jun 09 13:48:14.687113 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.687080 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28ed990b-7f1d-479f-9cb1-15ed52a29889-config\") pod \"service-ca-operator-6bc5ff68f5-8zn6r\" (UID: \"28ed990b-7f1d-479f-9cb1-15ed52a29889\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" Jun 09 13:48:14.688525 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.688502 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-stats-auth\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:14.688610 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.688588 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/835718d8-f0eb-43eb-abf2-bb692fed6a79-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tczfk\" (UID: \"835718d8-f0eb-43eb-abf2-bb692fed6a79\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" Jun 09 13:48:14.688610 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.688599 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28ed990b-7f1d-479f-9cb1-15ed52a29889-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-8zn6r\" (UID: \"28ed990b-7f1d-479f-9cb1-15ed52a29889\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" Jun 09 13:48:14.688679 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.688647 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-default-certificate\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:14.698567 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.698538 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcdkn\" (UniqueName: \"kubernetes.io/projected/28ed990b-7f1d-479f-9cb1-15ed52a29889-kube-api-access-bcdkn\") pod \"service-ca-operator-6bc5ff68f5-8zn6r\" (UID: \"28ed990b-7f1d-479f-9cb1-15ed52a29889\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" Jun 09 13:48:14.699423 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.699402 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smck4\" (UniqueName: \"kubernetes.io/projected/835718d8-f0eb-43eb-abf2-bb692fed6a79-kube-api-access-smck4\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tczfk\" (UID: \"835718d8-f0eb-43eb-abf2-bb692fed6a79\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" Jun 09 13:48:14.699828 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.699802 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddv5g\" (UniqueName: \"kubernetes.io/projected/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-kube-api-access-ddv5g\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:14.754882 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.754842 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:14.787029 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.786998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-installation-pull-secrets\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.787134 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.787038 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-trusted-ca\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.787134 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.787059 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qg8t\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-kube-api-access-9qg8t\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.787134 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.787079 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.787240 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.787152 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sz6zd\" (UID: \"41d47fdd-eed4-4d5e-aefe-0c0064e2511f\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" Jun 09 13:48:14.787240 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:14.787166 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:48:14.787240 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:14.787178 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc44d6689-thr5h: secret "image-registry-tls" not found Jun 09 13:48:14.787240 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.787190 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-image-registry-private-configuration\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.787240 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.787215 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-ca-trust-extracted\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.787240 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:14.787231 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls podName:c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2 nodeName:}" failed. No retries permitted until 2026-06-09 13:48:15.287217745 +0000 UTC m=+189.734940078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls") pod "image-registry-7bc44d6689-thr5h" (UID: "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2") : secret "image-registry-tls" not found Jun 09 13:48:14.787524 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.787255 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-certificates\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.787524 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:14.787325 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:48:14.787524 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:14.787378 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert podName:41d47fdd-eed4-4d5e-aefe-0c0064e2511f nodeName:}" failed. No retries permitted until 2026-06-09 13:48:15.287363641 +0000 UTC m=+189.735085978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-sz6zd" (UID: "41d47fdd-eed4-4d5e-aefe-0c0064e2511f") : secret "networking-console-plugin-cert" not found Jun 09 13:48:14.787524 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.787421 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-bound-sa-token\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.787524 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.787461 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-sz6zd\" (UID: \"41d47fdd-eed4-4d5e-aefe-0c0064e2511f\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" Jun 09 13:48:14.787763 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.787587 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-ca-trust-extracted\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.787932 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.787900 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-certificates\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.788201 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.788181 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-sz6zd\" (UID: \"41d47fdd-eed4-4d5e-aefe-0c0064e2511f\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" Jun 09 13:48:14.788331 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.788311 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-trusted-ca\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.789512 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.789491 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-installation-pull-secrets\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.789674 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.789657 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-image-registry-private-configuration\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.795544 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.795524 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" Jun 09 13:48:14.799403 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.799379 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-bound-sa-token\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.799525 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.799510 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qg8t\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-kube-api-access-9qg8t\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:14.804540 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.804522 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" Jun 09 13:48:14.856651 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.856610 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:14.926480 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.926449 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r"] Jun 09 13:48:14.930679 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:48:14.930649 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ed990b_7f1d_479f_9cb1_15ed52a29889.slice/crio-97b8f6d9a4f28b23013ad0c6d5bf155302cbe473a5eed0c067a7fac989f38cb7 WatchSource:0}: Error finding container 97b8f6d9a4f28b23013ad0c6d5bf155302cbe473a5eed0c067a7fac989f38cb7: Status 404 returned error can't find the container with id 97b8f6d9a4f28b23013ad0c6d5bf155302cbe473a5eed0c067a7fac989f38cb7 Jun 09 13:48:14.940285 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:14.940261 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk"] Jun 09 13:48:14.943664 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:48:14.943640 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835718d8_f0eb_43eb_abf2_bb692fed6a79.slice/crio-68c907e6570fbe925d25e1577be65f07d06c1228d4eff00fa71b0575eb5e0eaf WatchSource:0}: Error finding container 68c907e6570fbe925d25e1577be65f07d06c1228d4eff00fa71b0575eb5e0eaf: Status 404 returned error can't find the container with id 68c907e6570fbe925d25e1577be65f07d06c1228d4eff00fa71b0575eb5e0eaf Jun 09 13:48:15.191519 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:15.191428 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:15.191519 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:15.191515 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:15.191700 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:15.191614 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle podName:6d34e2ed-b066-4106-a582-9a90c7d0cbaf nodeName:}" failed. No retries permitted until 2026-06-09 13:48:16.191594831 +0000 UTC m=+190.639317190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle") pod "router-default-668858dbc7-7wp8j" (UID: "6d34e2ed-b066-4106-a582-9a90c7d0cbaf") : configmap references non-existent config key: service-ca.crt Jun 09 13:48:15.191700 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:15.191627 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 13:48:15.191700 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:15.191679 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs podName:6d34e2ed-b066-4106-a582-9a90c7d0cbaf nodeName:}" failed. No retries permitted until 2026-06-09 13:48:16.191669175 +0000 UTC m=+190.639391511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs") pod "router-default-668858dbc7-7wp8j" (UID: "6d34e2ed-b066-4106-a582-9a90c7d0cbaf") : secret "router-metrics-certs-default" not found Jun 09 13:48:15.292264 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:15.292228 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:15.292429 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:15.292280 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sz6zd\" (UID: \"41d47fdd-eed4-4d5e-aefe-0c0064e2511f\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" Jun 09 13:48:15.292429 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:15.292386 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:48:15.292429 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:15.292390 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:48:15.292429 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:15.292411 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc44d6689-thr5h: secret "image-registry-tls" not found Jun 09 13:48:15.292587 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:15.292441 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert podName:41d47fdd-eed4-4d5e-aefe-0c0064e2511f nodeName:}" failed. No retries permitted until 2026-06-09 13:48:16.29242744 +0000 UTC m=+190.740149774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-sz6zd" (UID: "41d47fdd-eed4-4d5e-aefe-0c0064e2511f") : secret "networking-console-plugin-cert" not found Jun 09 13:48:15.292587 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:15.292454 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls podName:c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2 nodeName:}" failed. No retries permitted until 2026-06-09 13:48:16.292447769 +0000 UTC m=+190.740170102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls") pod "image-registry-7bc44d6689-thr5h" (UID: "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2") : secret "image-registry-tls" not found Jun 09 13:48:15.544137 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:15.544091 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" event={"ID":"28ed990b-7f1d-479f-9cb1-15ed52a29889","Type":"ContainerStarted","Data":"97b8f6d9a4f28b23013ad0c6d5bf155302cbe473a5eed0c067a7fac989f38cb7"} Jun 09 13:48:15.545522 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:15.545481 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" event={"ID":"835718d8-f0eb-43eb-abf2-bb692fed6a79","Type":"ContainerStarted","Data":"68c907e6570fbe925d25e1577be65f07d06c1228d4eff00fa71b0575eb5e0eaf"} Jun 09 13:48:16.199741 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:16.199700 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:16.199970 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:16.199823 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:16.199970 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:16.199882 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 13:48:16.199970 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:16.199970 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs podName:6d34e2ed-b066-4106-a582-9a90c7d0cbaf nodeName:}" failed. No retries permitted until 2026-06-09 13:48:18.199949042 +0000 UTC m=+192.647671381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs") pod "router-default-668858dbc7-7wp8j" (UID: "6d34e2ed-b066-4106-a582-9a90c7d0cbaf") : secret "router-metrics-certs-default" not found Jun 09 13:48:16.200175 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:16.200049 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle podName:6d34e2ed-b066-4106-a582-9a90c7d0cbaf nodeName:}" failed. No retries permitted until 2026-06-09 13:48:18.200006796 +0000 UTC m=+192.647729143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle") pod "router-default-668858dbc7-7wp8j" (UID: "6d34e2ed-b066-4106-a582-9a90c7d0cbaf") : configmap references non-existent config key: service-ca.crt Jun 09 13:48:16.300283 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:16.300251 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:16.300487 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:16.300293 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sz6zd\" (UID: \"41d47fdd-eed4-4d5e-aefe-0c0064e2511f\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" Jun 09 13:48:16.300487 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:16.300384 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:48:16.300487 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:16.300393 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:48:16.300487 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:16.300400 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc44d6689-thr5h: secret "image-registry-tls" not found Jun 09 13:48:16.300487 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:16.300435 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert podName:41d47fdd-eed4-4d5e-aefe-0c0064e2511f nodeName:}" failed. No retries permitted until 2026-06-09 13:48:18.300423549 +0000 UTC m=+192.748145882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-sz6zd" (UID: "41d47fdd-eed4-4d5e-aefe-0c0064e2511f") : secret "networking-console-plugin-cert" not found Jun 09 13:48:16.300487 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:16.300449 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls podName:c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2 nodeName:}" failed. No retries permitted until 2026-06-09 13:48:18.300441383 +0000 UTC m=+192.748163716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls") pod "image-registry-7bc44d6689-thr5h" (UID: "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2") : secret "image-registry-tls" not found Jun 09 13:48:16.921699 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:16.921665 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:17.021974 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:17.021938 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:17.552788 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:17.552751 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" event={"ID":"28ed990b-7f1d-479f-9cb1-15ed52a29889","Type":"ContainerStarted","Data":"0e77d8f39d6d909644727fa2aacdd9e883bce6a82d2bfa395f2c840759a527e0"} Jun 09 13:48:17.554235 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:17.554205 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" event={"ID":"835718d8-f0eb-43eb-abf2-bb692fed6a79","Type":"ContainerStarted","Data":"2d08ff813167f4cd7d621b4638b3fdd999cd729d856def14f48dd7d04414842e"} Jun 09 13:48:17.569190 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:17.569140 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" podStartSLOduration=1.158785565 podStartE2EDuration="3.569121221s" totalImagesPullingTime="2.410335656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:48:17.568202497 +0000 UTC m=+192.015924852" watchObservedRunningTime="2026-06-09 13:48:17.569121221 +0000 UTC m=+192.016843577" Jun 09 13:48:17.582209 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:17.582155 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" podStartSLOduration=1.186710156 podStartE2EDuration="3.582134779s" totalImagesPullingTime="2.395424623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:48:17.581841755 +0000 UTC m=+192.029564112" watchObservedRunningTime="2026-06-09 13:48:17.582134779 +0000 UTC m=+192.029857136" Jun 09 13:48:18.219700 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:18.219666 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:18.220189 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:18.219732 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:18.220189 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:18.219810 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 13:48:18.220189 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:18.219851 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs podName:6d34e2ed-b066-4106-a582-9a90c7d0cbaf nodeName:}" failed. No retries permitted until 2026-06-09 13:48:22.219838397 +0000 UTC m=+196.667560731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs") pod "router-default-668858dbc7-7wp8j" (UID: "6d34e2ed-b066-4106-a582-9a90c7d0cbaf") : secret "router-metrics-certs-default" not found Jun 09 13:48:18.220189 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:18.219865 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle podName:6d34e2ed-b066-4106-a582-9a90c7d0cbaf nodeName:}" failed. No retries permitted until 2026-06-09 13:48:22.219859687 +0000 UTC m=+196.667582021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle") pod "router-default-668858dbc7-7wp8j" (UID: "6d34e2ed-b066-4106-a582-9a90c7d0cbaf") : configmap references non-existent config key: service-ca.crt Jun 09 13:48:18.320561 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:18.320525 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sz6zd\" (UID: \"41d47fdd-eed4-4d5e-aefe-0c0064e2511f\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" Jun 09 13:48:18.320758 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:18.320615 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:18.320758 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:18.320691 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:48:18.320758 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:18.320691 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:48:18.320975 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:18.320767 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert podName:41d47fdd-eed4-4d5e-aefe-0c0064e2511f nodeName:}" failed. No retries permitted until 2026-06-09 13:48:22.320747626 +0000 UTC m=+196.768469959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-sz6zd" (UID: "41d47fdd-eed4-4d5e-aefe-0c0064e2511f") : secret "networking-console-plugin-cert" not found Jun 09 13:48:18.320975 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:18.320701 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc44d6689-thr5h: secret "image-registry-tls" not found Jun 09 13:48:18.320975 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:18.320822 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls podName:c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2 nodeName:}" failed. No retries permitted until 2026-06-09 13:48:22.320808976 +0000 UTC m=+196.768531326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls") pod "image-registry-7bc44d6689-thr5h" (UID: "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2") : secret "image-registry-tls" not found Jun 09 13:48:18.432181 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:18.432146 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:18.502204 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:18.502173 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:18.745546 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:18.745507 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:18.838608 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:18.838518 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:18.948402 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:18.948366 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:19.325667 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:19.325629 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:19.427534 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:19.427481 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:20.026572 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:20.026539 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:20.125494 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:20.125462 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:20.344473 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:20.344398 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-96ng8_f3156ddf-2573-4c42-8de4-c0c79ebd8f80/dns-node-resolver/0.log" Jun 09 13:48:20.926410 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:20.926372 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:20.980770 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:20.980740 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:21.355393 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.355366 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b5lp8_50528af2-db53-4024-bfe0-3a0ec40c3259/node-ca/0.log" Jun 09 13:48:21.625584 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.625506 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-fcxv7"] Jun 09 13:48:21.629560 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.629540 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-fcxv7" Jun 09 13:48:21.632228 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.632199 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 13:48:21.632356 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.632208 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 13:48:21.633350 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.633316 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 13:48:21.633350 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.633339 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-s4lp7\"" Jun 09 13:48:21.633519 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.633358 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 13:48:21.638357 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.638332 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-fcxv7"] Jun 09 13:48:21.648202 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.648031 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/acec9f1d-a7b5-4d15-bc1a-1e963a38acf3-signing-cabundle\") pod \"service-ca-7d74d578b8-fcxv7\" (UID: \"acec9f1d-a7b5-4d15-bc1a-1e963a38acf3\") " pod="openshift-service-ca/service-ca-7d74d578b8-fcxv7" Jun 09 13:48:21.648202 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.648120 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6wcx\" (UniqueName: \"kubernetes.io/projected/acec9f1d-a7b5-4d15-bc1a-1e963a38acf3-kube-api-access-l6wcx\") pod \"service-ca-7d74d578b8-fcxv7\" (UID: \"acec9f1d-a7b5-4d15-bc1a-1e963a38acf3\") " pod="openshift-service-ca/service-ca-7d74d578b8-fcxv7" Jun 09 13:48:21.648202 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.648164 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/acec9f1d-a7b5-4d15-bc1a-1e963a38acf3-signing-key\") pod \"service-ca-7d74d578b8-fcxv7\" (UID: \"acec9f1d-a7b5-4d15-bc1a-1e963a38acf3\") " pod="openshift-service-ca/service-ca-7d74d578b8-fcxv7" Jun 09 13:48:21.664727 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.664679 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:21.726863 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.726833 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:21.748990 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.748960 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/acec9f1d-a7b5-4d15-bc1a-1e963a38acf3-signing-key\") pod \"service-ca-7d74d578b8-fcxv7\" (UID: \"acec9f1d-a7b5-4d15-bc1a-1e963a38acf3\") " pod="openshift-service-ca/service-ca-7d74d578b8-fcxv7" Jun 09 13:48:21.749105 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.749055 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/acec9f1d-a7b5-4d15-bc1a-1e963a38acf3-signing-cabundle\") pod \"service-ca-7d74d578b8-fcxv7\" (UID: \"acec9f1d-a7b5-4d15-bc1a-1e963a38acf3\") " pod="openshift-service-ca/service-ca-7d74d578b8-fcxv7" Jun 09 13:48:21.749151 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.749108 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6wcx\" (UniqueName: \"kubernetes.io/projected/acec9f1d-a7b5-4d15-bc1a-1e963a38acf3-kube-api-access-l6wcx\") pod \"service-ca-7d74d578b8-fcxv7\" (UID: \"acec9f1d-a7b5-4d15-bc1a-1e963a38acf3\") " pod="openshift-service-ca/service-ca-7d74d578b8-fcxv7" Jun 09 13:48:21.749738 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.749721 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/acec9f1d-a7b5-4d15-bc1a-1e963a38acf3-signing-cabundle\") pod \"service-ca-7d74d578b8-fcxv7\" (UID: \"acec9f1d-a7b5-4d15-bc1a-1e963a38acf3\") " pod="openshift-service-ca/service-ca-7d74d578b8-fcxv7" Jun 09 13:48:21.751557 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.751528 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/acec9f1d-a7b5-4d15-bc1a-1e963a38acf3-signing-key\") pod \"service-ca-7d74d578b8-fcxv7\" (UID: \"acec9f1d-a7b5-4d15-bc1a-1e963a38acf3\") " pod="openshift-service-ca/service-ca-7d74d578b8-fcxv7" Jun 09 13:48:21.758362 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.758338 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6wcx\" (UniqueName: \"kubernetes.io/projected/acec9f1d-a7b5-4d15-bc1a-1e963a38acf3-kube-api-access-l6wcx\") pod \"service-ca-7d74d578b8-fcxv7\" (UID: \"acec9f1d-a7b5-4d15-bc1a-1e963a38acf3\") " pod="openshift-service-ca/service-ca-7d74d578b8-fcxv7" Jun 09 13:48:21.938271 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:21.938169 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-fcxv7" Jun 09 13:48:22.066959 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:22.066925 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-fcxv7"] Jun 09 13:48:22.071446 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:48:22.071409 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacec9f1d_a7b5_4d15_bc1a_1e963a38acf3.slice/crio-572b5ead854ebcffd7ae285b0448cb7298d99051c5796e2769bf676c8af57fd6 WatchSource:0}: Error finding container 572b5ead854ebcffd7ae285b0448cb7298d99051c5796e2769bf676c8af57fd6: Status 404 returned error can't find the container with id 572b5ead854ebcffd7ae285b0448cb7298d99051c5796e2769bf676c8af57fd6 Jun 09 13:48:22.143155 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:22.143135 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8w6fp_0d086613-2feb-4bf5-bcc3-488f6e280503/serve-healthcheck-canary/0.log" Jun 09 13:48:22.252767 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:22.252733 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:22.252949 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:22.252805 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:22.252949 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:22.252901 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 13:48:22.252949 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:22.252922 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle podName:6d34e2ed-b066-4106-a582-9a90c7d0cbaf nodeName:}" failed. No retries permitted until 2026-06-09 13:48:30.252908669 +0000 UTC m=+204.700631002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle") pod "router-default-668858dbc7-7wp8j" (UID: "6d34e2ed-b066-4106-a582-9a90c7d0cbaf") : configmap references non-existent config key: service-ca.crt Jun 09 13:48:22.253121 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:22.252967 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs podName:6d34e2ed-b066-4106-a582-9a90c7d0cbaf nodeName:}" failed. No retries permitted until 2026-06-09 13:48:30.252946786 +0000 UTC m=+204.700669124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs") pod "router-default-668858dbc7-7wp8j" (UID: "6d34e2ed-b066-4106-a582-9a90c7d0cbaf") : secret "router-metrics-certs-default" not found Jun 09 13:48:22.354142 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:22.354103 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:22.354142 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:22.354150 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sz6zd\" (UID: \"41d47fdd-eed4-4d5e-aefe-0c0064e2511f\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" Jun 09 13:48:22.354403 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:22.354253 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:48:22.354403 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:22.354272 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc44d6689-thr5h: secret "image-registry-tls" not found Jun 09 13:48:22.354403 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:22.354277 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:48:22.354403 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:22.354326 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert podName:41d47fdd-eed4-4d5e-aefe-0c0064e2511f nodeName:}" failed. No retries permitted until 2026-06-09 13:48:30.354312627 +0000 UTC m=+204.802034961 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-sz6zd" (UID: "41d47fdd-eed4-4d5e-aefe-0c0064e2511f") : secret "networking-console-plugin-cert" not found Jun 09 13:48:22.354403 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:22.354347 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls podName:c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2 nodeName:}" failed. No retries permitted until 2026-06-09 13:48:30.354332587 +0000 UTC m=+204.802054921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls") pod "image-registry-7bc44d6689-thr5h" (UID: "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2") : secret "image-registry-tls" not found Jun 09 13:48:22.572410 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:22.572321 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-fcxv7" event={"ID":"acec9f1d-a7b5-4d15-bc1a-1e963a38acf3","Type":"ContainerStarted","Data":"13ee2b5875ed1f82cf8375cb307030bd507afad0dda2a5787ca28db59bab8696"} Jun 09 13:48:22.572410 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:22.572372 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-fcxv7" event={"ID":"acec9f1d-a7b5-4d15-bc1a-1e963a38acf3","Type":"ContainerStarted","Data":"572b5ead854ebcffd7ae285b0448cb7298d99051c5796e2769bf676c8af57fd6"} Jun 09 13:48:22.593637 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:22.593585 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-fcxv7" podStartSLOduration=1.5935599599999999 podStartE2EDuration="1.59355996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:48:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:48:22.593088135 +0000 UTC m=+197.040810490" watchObservedRunningTime="2026-06-09 13:48:22.59355996 +0000 UTC m=+197.041282317" Jun 09 13:48:22.765551 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:22.765507 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:23.505914 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:23.505881 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:23.611056 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:23.611022 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:23.713286 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:23.713249 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:23.812629 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:23.812521 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:23.882119 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:23.882083 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:24.395660 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:24.395599 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:24.795226 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:24.795187 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:25.544470 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:25.544441 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:25.645386 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:25.645309 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:25.805499 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:25.805389 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:25.998030 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:25.997999 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:26.402257 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:26.402219 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:26.996648 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:26.996612 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:27.188114 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:27.188076 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:27.386945 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:27.386841 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:27.587573 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:27.587490 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:27.790555 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:27.790522 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:27.990038 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:27.989968 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:28.187939 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:28.187860 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:29.202350 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:29.202311 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:29.590810 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:29.590779 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:29.792694 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:29.792657 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:29.995687 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:29.995646 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:30.048938 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.048907 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:30.326558 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.326463 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:30.326558 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.326552 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:30.327195 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.327172 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-service-ca-bundle\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:30.328970 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.328946 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d34e2ed-b066-4106-a582-9a90c7d0cbaf-metrics-certs\") pod \"router-default-668858dbc7-7wp8j\" (UID: \"6d34e2ed-b066-4106-a582-9a90c7d0cbaf\") " pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:30.396299 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.396247 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:30.410282 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.410253 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:30.427896 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.427860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:30.428040 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.427902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sz6zd\" (UID: \"41d47fdd-eed4-4d5e-aefe-0c0064e2511f\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" Jun 09 13:48:30.428116 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:30.428054 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:48:30.428163 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:30.428124 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert podName:41d47fdd-eed4-4d5e-aefe-0c0064e2511f nodeName:}" failed. No retries permitted until 2026-06-09 13:48:46.428104999 +0000 UTC m=+220.875827336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-sz6zd" (UID: "41d47fdd-eed4-4d5e-aefe-0c0064e2511f") : secret "networking-console-plugin-cert" not found Jun 09 13:48:30.430309 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.430286 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls\") pod \"image-registry-7bc44d6689-thr5h\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:30.503472 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.503440 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:30.544601 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.544381 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-668858dbc7-7wp8j"] Jun 09 13:48:30.546872 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:48:30.546837 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d34e2ed_b066_4106_a582_9a90c7d0cbaf.slice/crio-32ebe099019d173903886fb22f4407df0cc20ca0881e960d739f84d60cd8ffe6 WatchSource:0}: Error finding container 32ebe099019d173903886fb22f4407df0cc20ca0881e960d739f84d60cd8ffe6: Status 404 returned error can't find the container with id 32ebe099019d173903886fb22f4407df0cc20ca0881e960d739f84d60cd8ffe6 Jun 09 13:48:30.596166 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.596130 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-668858dbc7-7wp8j" event={"ID":"6d34e2ed-b066-4106-a582-9a90c7d0cbaf","Type":"ContainerStarted","Data":"32ebe099019d173903886fb22f4407df0cc20ca0881e960d739f84d60cd8ffe6"} Jun 09 13:48:30.648389 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.648359 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bc44d6689-thr5h"] Jun 09 13:48:30.651730 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:48:30.651698 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ff91e9_fac2_40d0_a6a2_6c55ab4350a2.slice/crio-c00a9711266a2fd7cde08d3e44d1975f7dfa9af51ef612f92d173dfefae61347 WatchSource:0}: Error finding container c00a9711266a2fd7cde08d3e44d1975f7dfa9af51ef612f92d173dfefae61347: Status 404 returned error can't find the container with id c00a9711266a2fd7cde08d3e44d1975f7dfa9af51ef612f92d173dfefae61347 Jun 09 13:48:30.795522 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:30.795491 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:31.391065 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:31.391028 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:31.491784 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:31.491746 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:31.601449 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:31.601405 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" event={"ID":"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2","Type":"ContainerStarted","Data":"3f2bcabd0c069b14e1374e961e4f6d21488198073a20063d1862bca7db61624c"} Jun 09 13:48:31.601641 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:31.601465 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" event={"ID":"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2","Type":"ContainerStarted","Data":"c00a9711266a2fd7cde08d3e44d1975f7dfa9af51ef612f92d173dfefae61347"} Jun 09 13:48:31.601641 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:31.601508 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:48:31.602924 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:31.602899 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-668858dbc7-7wp8j" event={"ID":"6d34e2ed-b066-4106-a582-9a90c7d0cbaf","Type":"ContainerStarted","Data":"31b1f64ff9e00339349bff3c90ec16af9959656c5c79d8acbffec583f7f7df8d"} Jun 09 13:48:31.621713 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:31.621668 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" podStartSLOduration=17.621654789 podStartE2EDuration="17.621654789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:48:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:48:31.620588389 +0000 UTC m=+206.068310744" watchObservedRunningTime="2026-06-09 13:48:31.621654789 +0000 UTC m=+206.069377122" Jun 09 13:48:31.638089 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:31.638039 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-668858dbc7-7wp8j" podStartSLOduration=17.638022881 podStartE2EDuration="17.638022881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:48:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:48:31.636919038 +0000 UTC m=+206.084641393" watchObservedRunningTime="2026-06-09 13:48:31.638022881 +0000 UTC m=+206.085745238" Jun 09 13:48:31.800340 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:31.800301 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:32.190394 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:32.190306 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:32.395553 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:32.395513 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:32.410602 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:32.410573 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:32.413222 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:32.413197 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:32.605903 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:32.605870 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:32.607181 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:32.607161 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-668858dbc7-7wp8j" Jun 09 13:48:32.800108 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:32.800064 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:33.590302 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:33.590270 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:33.794969 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:33.794940 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:33.985790 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:33.985744 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:34.184706 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:34.184667 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:34.241356 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:34.241284 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:42.102495 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.102460 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bc44d6689-thr5h"] Jun 09 13:48:42.128125 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.128096 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z7jzz"] Jun 09 13:48:42.132872 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.132856 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.135593 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.135566 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 13:48:42.135734 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.135620 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 13:48:42.135734 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.135644 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p2cw7\"" Jun 09 13:48:42.135865 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.135844 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 13:48:42.136088 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.136064 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 13:48:42.145000 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.144961 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z7jzz"] Jun 09 13:48:42.221707 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.221665 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.221902 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.221716 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-data-volume\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.221902 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.221779 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.221902 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.221852 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-crio-socket\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.221902 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.221872 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9zxl\" (UniqueName: \"kubernetes.io/projected/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-kube-api-access-z9zxl\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.238938 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.238906 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:42.322645 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.322611 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-data-volume\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.322805 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.322672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.322805 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.322716 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-crio-socket\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.322805 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.322732 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9zxl\" (UniqueName: \"kubernetes.io/projected/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-kube-api-access-z9zxl\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.322805 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.322774 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.323090 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.322841 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-crio-socket\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.323090 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.323017 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-data-volume\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.323327 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.323305 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.325195 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.325174 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.331078 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.331054 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9zxl\" (UniqueName: \"kubernetes.io/projected/b79ba834-c031-4d6d-84b6-d12e4bcd70c9-kube-api-access-z9zxl\") pod \"insights-runtime-extractor-z7jzz\" (UID: \"b79ba834-c031-4d6d-84b6-d12e4bcd70c9\") " pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.334803 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.334781 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:42.444735 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.444642 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z7jzz" Jun 09 13:48:42.570974 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.570939 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z7jzz"] Jun 09 13:48:42.574129 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:48:42.574101 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb79ba834_c031_4d6d_84b6_d12e4bcd70c9.slice/crio-a1f3e24374513e3b646b4e1e8f19945d8a79ae8d2f890b742a26955fc513ab8a WatchSource:0}: Error finding container a1f3e24374513e3b646b4e1e8f19945d8a79ae8d2f890b742a26955fc513ab8a: Status 404 returned error can't find the container with id a1f3e24374513e3b646b4e1e8f19945d8a79ae8d2f890b742a26955fc513ab8a Jun 09 13:48:42.637070 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.637036 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z7jzz" event={"ID":"b79ba834-c031-4d6d-84b6-d12e4bcd70c9","Type":"ContainerStarted","Data":"dabca508884a4613b0c628e7983e4a6b2e84de93cd105b52b58134afb697cf5b"} Jun 09 13:48:42.637181 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.637111 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z7jzz" event={"ID":"b79ba834-c031-4d6d-84b6-d12e4bcd70c9","Type":"ContainerStarted","Data":"a1f3e24374513e3b646b4e1e8f19945d8a79ae8d2f890b742a26955fc513ab8a"} Jun 09 13:48:42.748491 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.748459 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:42.807954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:42.807920 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:43.642083 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:43.642048 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z7jzz" event={"ID":"b79ba834-c031-4d6d-84b6-d12e4bcd70c9","Type":"ContainerStarted","Data":"2ce8dfca43f39b6d04c8aeef31da945b764cf089ce551719aecaaad1e219d1c6"} Jun 09 13:48:44.452260 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:44.452217 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:45.650878 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:45.650844 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z7jzz" event={"ID":"b79ba834-c031-4d6d-84b6-d12e4bcd70c9","Type":"ContainerStarted","Data":"d6e2f7218e65e58367ed498ee3b5dcc816c2b1bb4bbd67f766d3bbe0a31fd869"} Jun 09 13:48:45.669405 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:45.669357 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z7jzz" podStartSLOduration=1.574508125 podStartE2EDuration="3.669342437s" totalImagesPullingTime="2.094834312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:48:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:48:45.668214241 +0000 UTC m=+220.115936596" watchObservedRunningTime="2026-06-09 13:48:45.669342437 +0000 UTC m=+220.117064791" Jun 09 13:48:46.027618 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:46.027544 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:46.084516 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:46.084474 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:46.452482 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:46.452371 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sz6zd\" (UID: \"41d47fdd-eed4-4d5e-aefe-0c0064e2511f\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" Jun 09 13:48:46.454972 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:46.454950 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41d47fdd-eed4-4d5e-aefe-0c0064e2511f-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sz6zd\" (UID: \"41d47fdd-eed4-4d5e-aefe-0c0064e2511f\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" Jun 09 13:48:46.699119 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:46.699077 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" Jun 09 13:48:46.819440 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:46.819411 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd"] Jun 09 13:48:46.822113 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:48:46.822073 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d47fdd_eed4_4d5e_aefe_0c0064e2511f.slice/crio-ed696b40926fc8efa30cb978b9139ee497a7fbc3cb3254940727799d9281591f WatchSource:0}: Error finding container ed696b40926fc8efa30cb978b9139ee497a7fbc3cb3254940727799d9281591f: Status 404 returned error can't find the container with id ed696b40926fc8efa30cb978b9139ee497a7fbc3cb3254940727799d9281591f Jun 09 13:48:47.659677 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:47.659630 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" event={"ID":"41d47fdd-eed4-4d5e-aefe-0c0064e2511f","Type":"ContainerStarted","Data":"ed696b40926fc8efa30cb978b9139ee497a7fbc3cb3254940727799d9281591f"} Jun 09 13:48:48.664199 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:48.664159 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" event={"ID":"41d47fdd-eed4-4d5e-aefe-0c0064e2511f","Type":"ContainerStarted","Data":"e24e23484f6bb1c4862441b4c77af1ef992fec537d3bee18adf39b3cfde06806"} Jun 09 13:48:48.679511 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:48.679451 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sz6zd" podStartSLOduration=33.578347153 podStartE2EDuration="34.679434087s" totalImagesPullingTime="1.101086934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:48:48.679284482 +0000 UTC m=+223.127006836" watchObservedRunningTime="2026-06-09 13:48:48.679434087 +0000 UTC m=+223.127156442" Jun 09 13:48:48.774208 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:48.774169 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:48.876872 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:48.876844 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:49.033326 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:49.033296 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:49.114880 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:49.114855 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:49.177257 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:49.177214 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-848d4"] Jun 09 13:48:49.180469 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:49.180445 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-848d4" Jun 09 13:48:49.182866 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:49.182825 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 13:48:49.183034 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:49.183010 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qjfn6\"" Jun 09 13:48:49.191862 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:49.191837 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-848d4"] Jun 09 13:48:49.201152 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:49.201125 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:49.274875 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:49.274841 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b1a137b-1edd-46ae-b325-e9702eb30a31-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-848d4\" (UID: \"4b1a137b-1edd-46ae-b325-e9702eb30a31\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-848d4" Jun 09 13:48:49.376074 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:49.375956 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b1a137b-1edd-46ae-b325-e9702eb30a31-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-848d4\" (UID: \"4b1a137b-1edd-46ae-b325-e9702eb30a31\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-848d4" Jun 09 13:48:49.376233 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:49.376131 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 09 13:48:49.376233 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:49.376213 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b1a137b-1edd-46ae-b325-e9702eb30a31-tls-certificates podName:4b1a137b-1edd-46ae-b325-e9702eb30a31 nodeName:}" failed. No retries permitted until 2026-06-09 13:48:49.87619287 +0000 UTC m=+224.323915206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/4b1a137b-1edd-46ae-b325-e9702eb30a31-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-848d4" (UID: "4b1a137b-1edd-46ae-b325-e9702eb30a31") : secret "prometheus-operator-admission-webhook-tls" not found Jun 09 13:48:49.439454 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:49.439415 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:49.879918 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:49.879866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b1a137b-1edd-46ae-b325-e9702eb30a31-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-848d4\" (UID: \"4b1a137b-1edd-46ae-b325-e9702eb30a31\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-848d4" Jun 09 13:48:49.882414 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:49.882393 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b1a137b-1edd-46ae-b325-e9702eb30a31-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-848d4\" (UID: \"4b1a137b-1edd-46ae-b325-e9702eb30a31\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-848d4" Jun 09 13:48:50.088739 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:50.088701 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-848d4" Jun 09 13:48:50.213086 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:50.213053 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-848d4"] Jun 09 13:48:50.215878 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:48:50.215848 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1a137b_1edd_46ae_b325_e9702eb30a31.slice/crio-5917212ce1a86fc9bf2328851d84b5a1593b8d1c7d12f599bc4fca5f2aa8ea3f WatchSource:0}: Error finding container 5917212ce1a86fc9bf2328851d84b5a1593b8d1c7d12f599bc4fca5f2aa8ea3f: Status 404 returned error can't find the container with id 5917212ce1a86fc9bf2328851d84b5a1593b8d1c7d12f599bc4fca5f2aa8ea3f Jun 09 13:48:50.671830 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:50.671796 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-848d4" event={"ID":"4b1a137b-1edd-46ae-b325-e9702eb30a31","Type":"ContainerStarted","Data":"5917212ce1a86fc9bf2328851d84b5a1593b8d1c7d12f599bc4fca5f2aa8ea3f"} Jun 09 13:48:51.676697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:51.676658 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-848d4" event={"ID":"4b1a137b-1edd-46ae-b325-e9702eb30a31","Type":"ContainerStarted","Data":"fcaf60e5be73e3a1ee222855eeb838b60c9eb59d7fb87f2254a16bbb768da2d1"} Jun 09 13:48:51.677180 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:51.676854 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-848d4" Jun 09 13:48:51.681504 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:51.681483 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-848d4" Jun 09 13:48:51.693036 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:51.692968 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-848d4" podStartSLOduration=1.71176729 podStartE2EDuration="2.69295564s" totalImagesPullingTime="981.18835ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:48:51.692497326 +0000 UTC m=+226.140219681" watchObservedRunningTime="2026-06-09 13:48:51.69295564 +0000 UTC m=+226.140677995" Jun 09 13:48:52.109089 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:52.109050 2558 patch_prober.go:28] interesting pod/image-registry-7bc44d6689-thr5h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 13:48:52.109284 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:52.109109 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" podUID="c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 13:48:52.202423 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:52.202385 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:52.263648 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:52.263611 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:52.609041 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:52.609014 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:54.070171 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:54.070139 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:54.135049 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:54.135005 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:54.189258 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:54.189230 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:54.583060 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:54.583026 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:56.357652 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.357621 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:56.546012 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.545954 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:56.606231 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.606193 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9"] Jun 09 13:48:56.609396 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.609353 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" Jun 09 13:48:56.611807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.611784 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 13:48:56.612939 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.612883 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-n2557\"" Jun 09 13:48:56.612939 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.612899 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 13:48:56.612939 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.612902 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 13:48:56.613186 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.612902 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 13:48:56.613186 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.612890 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 13:48:56.619391 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.619370 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9"] Jun 09 13:48:56.627747 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.627724 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq"] Jun 09 13:48:56.630614 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.630593 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.633572 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.633549 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 13:48:56.633916 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.633872 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 13:48:56.633916 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.633897 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 13:48:56.634272 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.634246 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pz469\"" Jun 09 13:48:56.638781 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.638760 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zmssj"] Jun 09 13:48:56.641619 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.641600 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.644168 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.644141 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hndwj\"" Jun 09 13:48:56.644963 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.644943 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 13:48:56.645130 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.644952 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 13:48:56.645198 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.644964 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 13:48:56.645644 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.645611 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq"] Jun 09 13:48:56.654228 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.654209 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:56.737607 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.737572 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58c9f7cd-2acb-4b70-85b6-453047ed70d5-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.737607 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.737609 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f7b69ea-2645-4d99-b1b3-e64c26e21799-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-rz9l9\" (UID: \"4f7b69ea-2645-4d99-b1b3-e64c26e21799\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" Jun 09 13:48:56.737835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.737634 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b98d3d22-460b-4840-a6cd-42115be15590-sys\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.737835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.737658 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f7b69ea-2645-4d99-b1b3-e64c26e21799-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-rz9l9\" (UID: \"4f7b69ea-2645-4d99-b1b3-e64c26e21799\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" Jun 09 13:48:56.737835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.737678 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-accelerators-collector-config\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.737835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.737698 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/58c9f7cd-2acb-4b70-85b6-453047ed70d5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.737835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.737765 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-tls\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.737835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.737804 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58c9f7cd-2acb-4b70-85b6-453047ed70d5-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.738095 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.737867 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b98d3d22-460b-4840-a6cd-42115be15590-root\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.738095 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.737911 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58c9f7cd-2acb-4b70-85b6-453047ed70d5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.738095 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.737937 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f7b69ea-2645-4d99-b1b3-e64c26e21799-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-rz9l9\" (UID: \"4f7b69ea-2645-4d99-b1b3-e64c26e21799\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" Jun 09 13:48:56.738095 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.737954 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvltk\" (UniqueName: \"kubernetes.io/projected/4f7b69ea-2645-4d99-b1b3-e64c26e21799-kube-api-access-tvltk\") pod \"openshift-state-metrics-65f78d5c66-rz9l9\" (UID: \"4f7b69ea-2645-4d99-b1b3-e64c26e21799\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" Jun 09 13:48:56.738095 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.737972 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlgv9\" (UniqueName: \"kubernetes.io/projected/58c9f7cd-2acb-4b70-85b6-453047ed70d5-kube-api-access-tlgv9\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.738095 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.738040 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-wtmp\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.738095 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.738057 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b98d3d22-460b-4840-a6cd-42115be15590-metrics-client-ca\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.738328 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.738135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dhcc\" (UniqueName: \"kubernetes.io/projected/b98d3d22-460b-4840-a6cd-42115be15590-kube-api-access-6dhcc\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.738328 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.738180 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-textfile\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.738328 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.738208 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/58c9f7cd-2acb-4b70-85b6-453047ed70d5-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.738328 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.738244 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.838903 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.838858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/58c9f7cd-2acb-4b70-85b6-453047ed70d5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.838903 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.838901 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-tls\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.839184 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.838921 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58c9f7cd-2acb-4b70-85b6-453047ed70d5-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.839184 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.838937 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b98d3d22-460b-4840-a6cd-42115be15590-root\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.839184 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.838969 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58c9f7cd-2acb-4b70-85b6-453047ed70d5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.839184 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839048 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b98d3d22-460b-4840-a6cd-42115be15590-root\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.839184 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:56.839076 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 13:48:56.839184 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839123 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f7b69ea-2645-4d99-b1b3-e64c26e21799-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-rz9l9\" (UID: \"4f7b69ea-2645-4d99-b1b3-e64c26e21799\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" Jun 09 13:48:56.839184 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:48:56.839155 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-tls podName:b98d3d22-460b-4840-a6cd-42115be15590 nodeName:}" failed. No retries permitted until 2026-06-09 13:48:57.339133311 +0000 UTC m=+231.786855645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-tls") pod "node-exporter-zmssj" (UID: "b98d3d22-460b-4840-a6cd-42115be15590") : secret "node-exporter-tls" not found Jun 09 13:48:56.839533 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839187 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvltk\" (UniqueName: \"kubernetes.io/projected/4f7b69ea-2645-4d99-b1b3-e64c26e21799-kube-api-access-tvltk\") pod \"openshift-state-metrics-65f78d5c66-rz9l9\" (UID: \"4f7b69ea-2645-4d99-b1b3-e64c26e21799\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" Jun 09 13:48:56.839533 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839221 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlgv9\" (UniqueName: \"kubernetes.io/projected/58c9f7cd-2acb-4b70-85b6-453047ed70d5-kube-api-access-tlgv9\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.839533 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839261 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-wtmp\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.839533 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839289 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b98d3d22-460b-4840-a6cd-42115be15590-metrics-client-ca\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.839533 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839350 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dhcc\" (UniqueName: \"kubernetes.io/projected/b98d3d22-460b-4840-a6cd-42115be15590-kube-api-access-6dhcc\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.839533 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839384 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-textfile\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.839533 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839411 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/58c9f7cd-2acb-4b70-85b6-453047ed70d5-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.839533 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839450 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.839533 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839488 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58c9f7cd-2acb-4b70-85b6-453047ed70d5-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.839533 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839516 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f7b69ea-2645-4d99-b1b3-e64c26e21799-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-rz9l9\" (UID: \"4f7b69ea-2645-4d99-b1b3-e64c26e21799\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" Jun 09 13:48:56.840007 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839540 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b98d3d22-460b-4840-a6cd-42115be15590-sys\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.840007 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839566 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f7b69ea-2645-4d99-b1b3-e64c26e21799-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-rz9l9\" (UID: \"4f7b69ea-2645-4d99-b1b3-e64c26e21799\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" Jun 09 13:48:56.840007 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839594 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-accelerators-collector-config\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.840007 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839726 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/58c9f7cd-2acb-4b70-85b6-453047ed70d5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.840217 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.840081 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/58c9f7cd-2acb-4b70-85b6-453047ed70d5-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.840217 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.840156 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b98d3d22-460b-4840-a6cd-42115be15590-sys\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.840318 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.840273 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b98d3d22-460b-4840-a6cd-42115be15590-metrics-client-ca\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.840318 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.840283 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-textfile\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.840318 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.839540 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-wtmp\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.840723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.840696 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-accelerators-collector-config\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.840723 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.840716 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58c9f7cd-2acb-4b70-85b6-453047ed70d5-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.841082 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.841056 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f7b69ea-2645-4d99-b1b3-e64c26e21799-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-rz9l9\" (UID: \"4f7b69ea-2645-4d99-b1b3-e64c26e21799\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" Jun 09 13:48:56.842390 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.842349 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.842515 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.842491 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58c9f7cd-2acb-4b70-85b6-453047ed70d5-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.842590 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.842554 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f7b69ea-2645-4d99-b1b3-e64c26e21799-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-rz9l9\" (UID: \"4f7b69ea-2645-4d99-b1b3-e64c26e21799\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" Jun 09 13:48:56.842795 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.842777 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f7b69ea-2645-4d99-b1b3-e64c26e21799-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-rz9l9\" (UID: \"4f7b69ea-2645-4d99-b1b3-e64c26e21799\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" Jun 09 13:48:56.843196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.843176 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58c9f7cd-2acb-4b70-85b6-453047ed70d5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.848186 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.848155 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvltk\" (UniqueName: \"kubernetes.io/projected/4f7b69ea-2645-4d99-b1b3-e64c26e21799-kube-api-access-tvltk\") pod \"openshift-state-metrics-65f78d5c66-rz9l9\" (UID: \"4f7b69ea-2645-4d99-b1b3-e64c26e21799\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" Jun 09 13:48:56.848409 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.848391 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlgv9\" (UniqueName: \"kubernetes.io/projected/58c9f7cd-2acb-4b70-85b6-453047ed70d5-kube-api-access-tlgv9\") pod \"kube-state-metrics-57bbf8bfb5-mmqfq\" (UID: \"58c9f7cd-2acb-4b70-85b6-453047ed70d5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:56.848531 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.848514 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dhcc\" (UniqueName: \"kubernetes.io/projected/b98d3d22-460b-4840-a6cd-42115be15590-kube-api-access-6dhcc\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:56.859620 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.859565 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:56.919130 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.919101 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" Jun 09 13:48:56.940067 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:56.940042 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" Jun 09 13:48:57.067703 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.067251 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9"] Jun 09 13:48:57.087689 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.087655 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:57.094467 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.088785 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq"] Jun 09 13:48:57.094467 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:48:57.091239 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c9f7cd_2acb_4b70_85b6_453047ed70d5.slice/crio-afa592a01126f301aee473c6f052809354b79af9ca625fb55af45e21df2ce22c WatchSource:0}: Error finding container afa592a01126f301aee473c6f052809354b79af9ca625fb55af45e21df2ce22c: Status 404 returned error can't find the container with id afa592a01126f301aee473c6f052809354b79af9ca625fb55af45e21df2ce22c Jun 09 13:48:57.185017 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.184958 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:57.343967 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.343927 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-tls\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:57.346472 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.346446 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b98d3d22-460b-4840-a6cd-42115be15590-node-exporter-tls\") pod \"node-exporter-zmssj\" (UID: \"b98d3d22-460b-4840-a6cd-42115be15590\") " pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:57.373071 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.373035 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:57.550759 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.550723 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zmssj" Jun 09 13:48:57.565237 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:48:57.565204 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb98d3d22_460b_4840_a6cd_42115be15590.slice/crio-4567460225b1dd11a8f90b5611a779a6a4db99946f8ce2cb5730e35837d24c4d WatchSource:0}: Error finding container 4567460225b1dd11a8f90b5611a779a6a4db99946f8ce2cb5730e35837d24c4d: Status 404 returned error can't find the container with id 4567460225b1dd11a8f90b5611a779a6a4db99946f8ce2cb5730e35837d24c4d Jun 09 13:48:57.611322 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.611279 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:57.683121 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.683084 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:57.686913 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.686862 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:48:57.690759 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.690733 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.693413 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.693393 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 13:48:57.693537 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.693509 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 13:48:57.693822 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.693793 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 13:48:57.694263 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.694052 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 13:48:57.694263 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.694089 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 13:48:57.694263 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.694098 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 13:48:57.694263 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.694112 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cblwl\"" Jun 09 13:48:57.694263 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.694252 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 13:48:57.694546 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.694255 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 13:48:57.694546 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.694498 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 13:48:57.698912 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.698885 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zmssj" event={"ID":"b98d3d22-460b-4840-a6cd-42115be15590","Type":"ContainerStarted","Data":"4567460225b1dd11a8f90b5611a779a6a4db99946f8ce2cb5730e35837d24c4d"} Jun 09 13:48:57.702041 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.701943 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" event={"ID":"58c9f7cd-2acb-4b70-85b6-453047ed70d5","Type":"ContainerStarted","Data":"afa592a01126f301aee473c6f052809354b79af9ca625fb55af45e21df2ce22c"} Jun 09 13:48:57.704775 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.704745 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" event={"ID":"4f7b69ea-2645-4d99-b1b3-e64c26e21799","Type":"ContainerStarted","Data":"7909b80ebed24c85884cbd08ec950265559a5c3c6cd7545f399fdb03809dc182"} Jun 09 13:48:57.704896 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.704824 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" event={"ID":"4f7b69ea-2645-4d99-b1b3-e64c26e21799","Type":"ContainerStarted","Data":"3cf8bd9e4aadba7f9036e400f9579c0ed63efc4bef420645b9e78abfdb79e4dd"} Jun 09 13:48:57.704896 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.704858 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" event={"ID":"4f7b69ea-2645-4d99-b1b3-e64c26e21799","Type":"ContainerStarted","Data":"d48e67563a6ececd722c7dada296dcd54698d0e917a285fb74e4662b6c01bdce"} Jun 09 13:48:57.707430 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.707351 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:48:57.823030 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.822925 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:57.848107 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.848072 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.848269 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.848129 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.848269 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.848166 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.848269 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.848190 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.848440 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.848272 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-web-config\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.848440 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.848330 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.848440 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.848377 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnzq6\" (UniqueName: \"kubernetes.io/projected/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-kube-api-access-jnzq6\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.848440 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.848408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.848440 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.848435 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.848654 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.848462 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.848654 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.848504 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-config-out\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.848654 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.848557 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-config-volume\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.848654 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.848611 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.949278 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.949246 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-config-out\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.949278 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.949284 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-config-volume\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.949516 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.949319 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.949516 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.949340 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.949516 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.949360 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.949516 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.949379 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.949516 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.949393 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.949731 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.949647 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-web-config\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.949731 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.949718 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.949843 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.949752 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.949843 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.949771 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnzq6\" (UniqueName: \"kubernetes.io/projected/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-kube-api-access-jnzq6\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.949843 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.949804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.950037 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.949841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.950037 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.949886 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.950426 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.950401 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.951738 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.951707 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.953532 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.952770 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-config-volume\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.953532 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.953033 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-config-out\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.953532 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.953170 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.954701 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.954677 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.954701 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.954693 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-web-config\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.955135 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.955112 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.955220 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.955168 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.955371 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.955350 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.955536 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.955510 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:57.958453 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:57.958430 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnzq6\" (UniqueName: \"kubernetes.io/projected/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-kube-api-access-jnzq6\") pod \"alertmanager-main-0\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:58.002911 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:58.002871 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:48:58.933896 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:58.932227 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:48:59.534326 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:59.534288 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:59.615784 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:59.615746 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:59.675729 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:59.675689 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:48:59.713882 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:59.713825 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerStarted","Data":"bb242528dd91c0095b1d1bad5e48710ab1c5fa0dc394e8fa6cb2ff51e2ba7bfe"} Jun 09 13:48:59.715826 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:59.715799 2558 generic.go:356] "Generic (PLEG): container finished" podID="b98d3d22-460b-4840-a6cd-42115be15590" containerID="f35099a89dda77e5586111bf63ac18f5409075a7fa7e93dd76be10b0015f66dc" exitCode=0 Jun 09 13:48:59.715958 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:59.715885 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zmssj" event={"ID":"b98d3d22-460b-4840-a6cd-42115be15590","Type":"ContainerDied","Data":"f35099a89dda77e5586111bf63ac18f5409075a7fa7e93dd76be10b0015f66dc"} Jun 09 13:48:59.718326 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:59.718300 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" event={"ID":"58c9f7cd-2acb-4b70-85b6-453047ed70d5","Type":"ContainerStarted","Data":"997e8320cbd6200cb8231da94447b9467a293eb52e3f9d93214f0ee75aadf6ef"} Jun 09 13:48:59.718411 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:59.718363 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" event={"ID":"58c9f7cd-2acb-4b70-85b6-453047ed70d5","Type":"ContainerStarted","Data":"49ba04a7e01e19fb5ee31beb257cec5f8d50c96ad4c247eee4913397e1c05277"} Jun 09 13:48:59.718411 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:59.718396 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" event={"ID":"58c9f7cd-2acb-4b70-85b6-453047ed70d5","Type":"ContainerStarted","Data":"6b1430e873cbef78108e2da83592e4a4397352366a18dcdaa2bcd1208ab3c11d"} Jun 09 13:48:59.720493 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:59.720472 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" event={"ID":"4f7b69ea-2645-4d99-b1b3-e64c26e21799","Type":"ContainerStarted","Data":"9bc36ccbb72541f2383d141c1d07ae07aa1b10c7f7bc576bd35f3e1e8e60a44d"} Jun 09 13:48:59.773296 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:59.773242 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mmqfq" podStartSLOduration=2.1142574769999998 podStartE2EDuration="3.77322212s" totalImagesPullingTime="1.658964643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:48:59.754057339 +0000 UTC m=+234.201779694" watchObservedRunningTime="2026-06-09 13:48:59.77322212 +0000 UTC m=+234.220944475" Jun 09 13:48:59.773923 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:59.773887 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rz9l9" podStartSLOduration=2.237982684 podStartE2EDuration="3.773876882s" totalImagesPullingTime="1.535894198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:48:59.772434857 +0000 UTC m=+234.220157212" watchObservedRunningTime="2026-06-09 13:48:59.773876882 +0000 UTC m=+234.221599238" Jun 09 13:48:59.858028 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:48:59.858002 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:00.725673 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:00.725637 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerID="a8063573ccd038073c457280ac9b57ede9ab1d4b8168178c2ff41577aea95671" exitCode=0 Jun 09 13:49:00.726182 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:00.725738 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerDied","Data":"a8063573ccd038073c457280ac9b57ede9ab1d4b8168178c2ff41577aea95671"} Jun 09 13:49:00.728047 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:00.728021 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zmssj" event={"ID":"b98d3d22-460b-4840-a6cd-42115be15590","Type":"ContainerStarted","Data":"b5e0108974ecd5d396d600df00fd5cb0e1785c420b31edb6d69c7e498e2f2e42"} Jun 09 13:49:00.728164 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:00.728076 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zmssj" event={"ID":"b98d3d22-460b-4840-a6cd-42115be15590","Type":"ContainerStarted","Data":"c935880107d18c3fda81b2c6843bd4c4bcf0eb2a78abb1b3f07128949ef0cd5b"} Jun 09 13:49:00.772266 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:00.772209 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zmssj" podStartSLOduration=3.476989386 podStartE2EDuration="4.772193066s" totalImagesPullingTime="1.188426425s" totalInitContainerRuntime="106.777255ms" isStatefulPod=true podCreationTimestamp="2026-06-09 13:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:49:00.7711043 +0000 UTC m=+235.218826653" watchObservedRunningTime="2026-06-09 13:49:00.772193066 +0000 UTC m=+235.219915420" Jun 09 13:49:01.009163 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.009131 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-994rw"] Jun 09 13:49:01.012451 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.012427 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-994rw" Jun 09 13:49:01.014892 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.014862 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 13:49:01.014892 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.014862 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 13:49:01.015086 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.014903 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2zgm5\"" Jun 09 13:49:01.020563 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.020540 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-994rw"] Jun 09 13:49:01.023677 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.023654 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:01.136713 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.136676 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:01.160944 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.160906 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7ddc94f557-djv7k"] Jun 09 13:49:01.164013 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.163974 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.166766 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.166735 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4569c\"" Jun 09 13:49:01.166766 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.166753 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bfk5d7srtkqqb\"" Jun 09 13:49:01.166932 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.166770 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 13:49:01.166932 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.166748 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 13:49:01.166932 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.166779 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 13:49:01.166932 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.166739 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 13:49:01.175495 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.175475 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7ddc94f557-djv7k"] Jun 09 13:49:01.183078 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.183054 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqxbh\" (UniqueName: \"kubernetes.io/projected/31fbae42-0c4a-46be-ab35-d9f75106bd57-kube-api-access-tqxbh\") pod \"downloads-6657875f97-994rw\" (UID: \"31fbae42-0c4a-46be-ab35-d9f75106bd57\") " pod="openshift-console/downloads-6657875f97-994rw" Jun 09 13:49:01.284273 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.284190 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/20d8c6ae-e027-4938-8a50-6ca22d88f51a-audit-log\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.284698 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.284242 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drxz9\" (UniqueName: \"kubernetes.io/projected/20d8c6ae-e027-4938-8a50-6ca22d88f51a-kube-api-access-drxz9\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.284768 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.284731 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqxbh\" (UniqueName: \"kubernetes.io/projected/31fbae42-0c4a-46be-ab35-d9f75106bd57-kube-api-access-tqxbh\") pod \"downloads-6657875f97-994rw\" (UID: \"31fbae42-0c4a-46be-ab35-d9f75106bd57\") " pod="openshift-console/downloads-6657875f97-994rw" Jun 09 13:49:01.284829 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.284782 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20d8c6ae-e027-4938-8a50-6ca22d88f51a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.284879 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.284833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/20d8c6ae-e027-4938-8a50-6ca22d88f51a-metrics-server-audit-profiles\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.284931 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.284894 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/20d8c6ae-e027-4938-8a50-6ca22d88f51a-secret-metrics-server-client-certs\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.285002 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.284943 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/20d8c6ae-e027-4938-8a50-6ca22d88f51a-secret-metrics-server-tls\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.285052 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.284974 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20d8c6ae-e027-4938-8a50-6ca22d88f51a-client-ca-bundle\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.294753 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.294724 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqxbh\" (UniqueName: \"kubernetes.io/projected/31fbae42-0c4a-46be-ab35-d9f75106bd57-kube-api-access-tqxbh\") pod \"downloads-6657875f97-994rw\" (UID: \"31fbae42-0c4a-46be-ab35-d9f75106bd57\") " pod="openshift-console/downloads-6657875f97-994rw" Jun 09 13:49:01.315449 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.315415 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:01.322322 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.322295 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-994rw" Jun 09 13:49:01.376885 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.376844 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s"] Jun 09 13:49:01.387362 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.386199 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20d8c6ae-e027-4938-8a50-6ca22d88f51a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.387362 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.386282 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/20d8c6ae-e027-4938-8a50-6ca22d88f51a-metrics-server-audit-profiles\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.387362 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.386339 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/20d8c6ae-e027-4938-8a50-6ca22d88f51a-secret-metrics-server-client-certs\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.387362 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.386381 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/20d8c6ae-e027-4938-8a50-6ca22d88f51a-secret-metrics-server-tls\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.387362 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.386415 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20d8c6ae-e027-4938-8a50-6ca22d88f51a-client-ca-bundle\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.387362 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.386485 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/20d8c6ae-e027-4938-8a50-6ca22d88f51a-audit-log\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.387362 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.386526 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drxz9\" (UniqueName: \"kubernetes.io/projected/20d8c6ae-e027-4938-8a50-6ca22d88f51a-kube-api-access-drxz9\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.389127 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.387789 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20d8c6ae-e027-4938-8a50-6ca22d88f51a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.389127 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.387804 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/20d8c6ae-e027-4938-8a50-6ca22d88f51a-metrics-server-audit-profiles\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.389127 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.388641 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/20d8c6ae-e027-4938-8a50-6ca22d88f51a-audit-log\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.389127 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.388912 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s" Jun 09 13:49:01.390671 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.390587 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s"] Jun 09 13:49:01.393272 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.392035 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 13:49:01.393272 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.392418 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wlj86\"" Jun 09 13:49:01.393272 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.392953 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:01.394947 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.394875 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20d8c6ae-e027-4938-8a50-6ca22d88f51a-client-ca-bundle\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.396702 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.396676 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/20d8c6ae-e027-4938-8a50-6ca22d88f51a-secret-metrics-server-client-certs\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.397523 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.397498 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/20d8c6ae-e027-4938-8a50-6ca22d88f51a-secret-metrics-server-tls\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.402477 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.402448 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drxz9\" (UniqueName: \"kubernetes.io/projected/20d8c6ae-e027-4938-8a50-6ca22d88f51a-kube-api-access-drxz9\") pod \"metrics-server-7ddc94f557-djv7k\" (UID: \"20d8c6ae-e027-4938-8a50-6ca22d88f51a\") " pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.473700 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.473626 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:01.487558 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.487530 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/62c05740-8144-46c4-9a47-01a0b8b6306f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rwd7s\" (UID: \"62c05740-8144-46c4-9a47-01a0b8b6306f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s" Jun 09 13:49:01.487683 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.487644 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw2kl\" (UniqueName: \"kubernetes.io/projected/62c05740-8144-46c4-9a47-01a0b8b6306f-kube-api-access-hw2kl\") pod \"monitoring-plugin-76b68cc874-rwd7s\" (UID: \"62c05740-8144-46c4-9a47-01a0b8b6306f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s" Jun 09 13:49:01.498835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.498795 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-994rw"] Jun 09 13:49:01.500876 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:49:01.500848 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31fbae42_0c4a_46be_ab35_d9f75106bd57.slice/crio-4aef19d7538c0b1e32f5a226e0c9a8b73df978cfaad8151d931fc190c0249f5b WatchSource:0}: Error finding container 4aef19d7538c0b1e32f5a226e0c9a8b73df978cfaad8151d931fc190c0249f5b: Status 404 returned error can't find the container with id 4aef19d7538c0b1e32f5a226e0c9a8b73df978cfaad8151d931fc190c0249f5b Jun 09 13:49:01.592047 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.591460 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/62c05740-8144-46c4-9a47-01a0b8b6306f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rwd7s\" (UID: \"62c05740-8144-46c4-9a47-01a0b8b6306f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s" Jun 09 13:49:01.592047 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.591526 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw2kl\" (UniqueName: \"kubernetes.io/projected/62c05740-8144-46c4-9a47-01a0b8b6306f-kube-api-access-hw2kl\") pod \"monitoring-plugin-76b68cc874-rwd7s\" (UID: \"62c05740-8144-46c4-9a47-01a0b8b6306f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s" Jun 09 13:49:01.592047 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:49:01.591861 2558 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 09 13:49:01.592047 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:49:01.591907 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c05740-8144-46c4-9a47-01a0b8b6306f-monitoring-plugin-cert podName:62c05740-8144-46c4-9a47-01a0b8b6306f nodeName:}" failed. No retries permitted until 2026-06-09 13:49:02.091893386 +0000 UTC m=+236.539615719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/62c05740-8144-46c4-9a47-01a0b8b6306f-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-rwd7s" (UID: "62c05740-8144-46c4-9a47-01a0b8b6306f") : secret "monitoring-plugin-cert" not found Jun 09 13:49:01.600420 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.600390 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw2kl\" (UniqueName: \"kubernetes.io/projected/62c05740-8144-46c4-9a47-01a0b8b6306f-kube-api-access-hw2kl\") pod \"monitoring-plugin-76b68cc874-rwd7s\" (UID: \"62c05740-8144-46c4-9a47-01a0b8b6306f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s" Jun 09 13:49:01.626481 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.626448 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7ddc94f557-djv7k"] Jun 09 13:49:01.628238 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:49:01.628209 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d8c6ae_e027_4938_8a50_6ca22d88f51a.slice/crio-61a5843bae911feec0d7d406e712462a8203bf6edf1c9654dec5c36e1e9f0c31 WatchSource:0}: Error finding container 61a5843bae911feec0d7d406e712462a8203bf6edf1c9654dec5c36e1e9f0c31: Status 404 returned error can't find the container with id 61a5843bae911feec0d7d406e712462a8203bf6edf1c9654dec5c36e1e9f0c31 Jun 09 13:49:01.697407 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.697374 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:01.733434 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.733402 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-994rw" event={"ID":"31fbae42-0c4a-46be-ab35-d9f75106bd57","Type":"ContainerStarted","Data":"4aef19d7538c0b1e32f5a226e0c9a8b73df978cfaad8151d931fc190c0249f5b"} Jun 09 13:49:01.734854 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.734827 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" event={"ID":"20d8c6ae-e027-4938-8a50-6ca22d88f51a","Type":"ContainerStarted","Data":"61a5843bae911feec0d7d406e712462a8203bf6edf1c9654dec5c36e1e9f0c31"} Jun 09 13:49:01.797506 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.797474 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:01.907317 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:01.907009 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:02.095791 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.095757 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/62c05740-8144-46c4-9a47-01a0b8b6306f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rwd7s\" (UID: \"62c05740-8144-46c4-9a47-01a0b8b6306f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s" Jun 09 13:49:02.099102 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.099071 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/62c05740-8144-46c4-9a47-01a0b8b6306f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rwd7s\" (UID: \"62c05740-8144-46c4-9a47-01a0b8b6306f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s" Jun 09 13:49:02.109103 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.109052 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:02.109309 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.109254 2558 patch_prober.go:28] interesting pod/image-registry-7bc44d6689-thr5h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 13:49:02.109381 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.109310 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" podUID="c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 13:49:02.206377 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.206351 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:02.326307 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.326278 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s" Jun 09 13:49:02.327361 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.327333 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:02.431361 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.431316 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:02.538714 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.538531 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s"] Jun 09 13:49:02.543836 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:49:02.543789 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c05740_8144_46c4_9a47_01a0b8b6306f.slice/crio-e3fe1a8677f96ac730a30ca2fe130b7d1b1360af44756b63cf905f72b6e9d817 WatchSource:0}: Error finding container e3fe1a8677f96ac730a30ca2fe130b7d1b1360af44756b63cf905f72b6e9d817: Status 404 returned error can't find the container with id e3fe1a8677f96ac730a30ca2fe130b7d1b1360af44756b63cf905f72b6e9d817 Jun 09 13:49:02.544565 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.544506 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:02.731759 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.731625 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:02.744391 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.744354 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerStarted","Data":"a351376b684d6cf5e3edb0c387ad08e01d18c2b497c4f901a37d4dde8f07b28f"} Jun 09 13:49:02.744900 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.744441 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerStarted","Data":"a63e927f62d7c53b9d71855dbeb29bf7760c6e92b2e7ae810e7af720d78678f6"} Jun 09 13:49:02.744900 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.744481 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerStarted","Data":"049a9060f373dd68f2a653e0b7621ef2df0448c1faaabcd659868dbcf608c77a"} Jun 09 13:49:02.744900 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.744516 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerStarted","Data":"513e9e842a137bc96fd620f3ee0f53a5cee8aeaec4ce74ee78566e403a3592b8"} Jun 09 13:49:02.744900 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.744541 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerStarted","Data":"33dfb006f2e128b677ac91770e77ccf91048e438f054bb49f599ed90f4c3472d"} Jun 09 13:49:02.746366 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.746338 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s" event={"ID":"62c05740-8144-46c4-9a47-01a0b8b6306f","Type":"ContainerStarted","Data":"e3fe1a8677f96ac730a30ca2fe130b7d1b1360af44756b63cf905f72b6e9d817"} Jun 09 13:49:02.878924 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.878815 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:02.942448 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:02.942396 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:03.329259 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:03.329227 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:04.719618 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:04.719580 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:04.757267 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:04.757229 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" event={"ID":"20d8c6ae-e027-4938-8a50-6ca22d88f51a","Type":"ContainerStarted","Data":"f01e81b541489a3b77b6e88a29491050fa67a2ce221d6e10b5643cc95d693c99"} Jun 09 13:49:04.760666 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:04.760632 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerStarted","Data":"d5ac5676ae7e959c12c37562c43776972c676a6bfbf8e0ee5f700e2dfe9029d5"} Jun 09 13:49:04.762083 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:04.762060 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s" event={"ID":"62c05740-8144-46c4-9a47-01a0b8b6306f","Type":"ContainerStarted","Data":"fc2be4326402454d57ba3cd03cfcbf3eb3b3ccfc15b73374d6c1492f9c227e9c"} Jun 09 13:49:04.762306 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:04.762290 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s" Jun 09 13:49:04.766892 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:04.766875 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s" Jun 09 13:49:04.776280 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:04.776237 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" podStartSLOduration=1.426465901 podStartE2EDuration="3.77622431s" totalImagesPullingTime="2.349758409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:49:04.774221617 +0000 UTC m=+239.221943977" watchObservedRunningTime="2026-06-09 13:49:04.77622431 +0000 UTC m=+239.223946665" Jun 09 13:49:04.778579 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:04.778521 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:04.802039 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:04.801789 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.028642366 podStartE2EDuration="7.8017674s" totalImagesPullingTime="3.756210658s" totalInitContainerRuntime="16.914376ms" isStatefulPod=false podCreationTimestamp="2026-06-09 13:48:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:49:04.800244557 +0000 UTC m=+239.247966911" watchObservedRunningTime="2026-06-09 13:49:04.8017674 +0000 UTC m=+239.249489756" Jun 09 13:49:04.816769 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:04.816708 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rwd7s" podStartSLOduration=2.334865716 podStartE2EDuration="3.81668664s" totalImagesPullingTime="1.481820924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:49:04.816315952 +0000 UTC m=+239.264038307" watchObservedRunningTime="2026-06-09 13:49:04.81668664 +0000 UTC m=+239.264408995" Jun 09 13:49:07.123410 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.123366 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" podUID="c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" containerName="registry" containerID="cri-o://3f2bcabd0c069b14e1374e961e4f6d21488198073a20063d1862bca7db61624c" gracePeriod=30 Jun 09 13:49:07.382791 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.382731 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:49:07.550698 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.550654 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-installation-pull-secrets\") pod \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " Jun 09 13:49:07.550860 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.550711 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-certificates\") pod \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " Jun 09 13:49:07.550860 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.550735 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-ca-trust-extracted\") pod \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " Jun 09 13:49:07.550860 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.550771 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-bound-sa-token\") pod \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " Jun 09 13:49:07.551284 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.550825 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-image-registry-private-configuration\") pod \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " Jun 09 13:49:07.553469 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.551414 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-trusted-ca\") pod \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " Jun 09 13:49:07.553469 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.551679 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" (UID: "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:49:07.553469 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.551704 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qg8t\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-kube-api-access-9qg8t\") pod \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " Jun 09 13:49:07.553469 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.552158 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" (UID: "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:49:07.553469 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.553314 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls\") pod \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\" (UID: \"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2\") " Jun 09 13:49:07.554148 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.554122 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-trusted-ca\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:49:07.554148 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.554161 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-certificates\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:49:07.554329 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.554192 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" (UID: "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:49:07.556147 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.556050 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" (UID: "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:49:07.561916 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.561055 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-kube-api-access-9qg8t" (OuterVolumeSpecName: "kube-api-access-9qg8t") pod "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" (UID: "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2"). InnerVolumeSpecName "kube-api-access-9qg8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:49:07.561916 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.561109 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" (UID: "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:49:07.561916 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.561139 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" (UID: "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:49:07.565934 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.565905 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" (UID: "c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:49:07.655498 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.655416 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-image-registry-private-configuration\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:49:07.655498 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.655454 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qg8t\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-kube-api-access-9qg8t\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:49:07.655498 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.655470 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-registry-tls\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:49:07.655498 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.655486 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-installation-pull-secrets\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:49:07.655728 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.655502 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-ca-trust-extracted\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:49:07.655728 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.655516 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2-bound-sa-token\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:49:07.775551 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.775506 2558 generic.go:356] "Generic (PLEG): container finished" podID="c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" containerID="3f2bcabd0c069b14e1374e961e4f6d21488198073a20063d1862bca7db61624c" exitCode=0 Jun 09 13:49:07.775720 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.775597 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" Jun 09 13:49:07.775720 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.775605 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" event={"ID":"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2","Type":"ContainerDied","Data":"3f2bcabd0c069b14e1374e961e4f6d21488198073a20063d1862bca7db61624c"} Jun 09 13:49:07.775720 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.775689 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc44d6689-thr5h" event={"ID":"c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2","Type":"ContainerDied","Data":"c00a9711266a2fd7cde08d3e44d1975f7dfa9af51ef612f92d173dfefae61347"} Jun 09 13:49:07.775720 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.775717 2558 scope.go:117] "RemoveContainer" containerID="3f2bcabd0c069b14e1374e961e4f6d21488198073a20063d1862bca7db61624c" Jun 09 13:49:07.786473 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.786449 2558 scope.go:117] "RemoveContainer" containerID="3f2bcabd0c069b14e1374e961e4f6d21488198073a20063d1862bca7db61624c" Jun 09 13:49:07.786762 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:49:07.786740 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f2bcabd0c069b14e1374e961e4f6d21488198073a20063d1862bca7db61624c\": container with ID starting with 3f2bcabd0c069b14e1374e961e4f6d21488198073a20063d1862bca7db61624c not found: ID does not exist" containerID="3f2bcabd0c069b14e1374e961e4f6d21488198073a20063d1862bca7db61624c" Jun 09 13:49:07.786831 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.786769 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f2bcabd0c069b14e1374e961e4f6d21488198073a20063d1862bca7db61624c"} err="failed to get container status \"3f2bcabd0c069b14e1374e961e4f6d21488198073a20063d1862bca7db61624c\": rpc error: code = NotFound desc = could not find container \"3f2bcabd0c069b14e1374e961e4f6d21488198073a20063d1862bca7db61624c\": container with ID starting with 3f2bcabd0c069b14e1374e961e4f6d21488198073a20063d1862bca7db61624c not found: ID does not exist" Jun 09 13:49:07.798585 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.798556 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bc44d6689-thr5h"] Jun 09 13:49:07.801337 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.801312 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7bc44d6689-thr5h"] Jun 09 13:49:07.945905 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:07.945803 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" path="/var/lib/kubelet/pods/c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2/volumes" Jun 09 13:49:09.537727 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.537690 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75d7b9bcf5-jnk2d"] Jun 09 13:49:09.538166 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.538138 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" containerName="registry" Jun 09 13:49:09.538166 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.538156 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" containerName="registry" Jun 09 13:49:09.538292 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.538251 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7ff91e9-fac2-40d0-a6a2-6c55ab4350a2" containerName="registry" Jun 09 13:49:09.543431 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.543406 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.547104 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.547081 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 13:49:09.547229 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.547128 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nx27s\"" Jun 09 13:49:09.547229 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.547128 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 13:49:09.547401 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.547374 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 13:49:09.547510 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.547439 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 13:49:09.547577 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.547558 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 13:49:09.550229 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.550175 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d7b9bcf5-jnk2d"] Jun 09 13:49:09.572192 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.572159 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwsf9\" (UniqueName: \"kubernetes.io/projected/2ecd8705-73d9-4092-b70d-3ebc234540c9-kube-api-access-zwsf9\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.572369 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.572207 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-serving-cert\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.572369 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.572231 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-service-ca\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.572480 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.572379 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-oauth-serving-cert\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.572480 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.572427 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-oauth-config\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.572480 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.572452 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-config\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.673258 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.673223 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwsf9\" (UniqueName: \"kubernetes.io/projected/2ecd8705-73d9-4092-b70d-3ebc234540c9-kube-api-access-zwsf9\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.673427 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.673274 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-serving-cert\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.673427 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.673302 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-service-ca\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.673427 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.673382 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-oauth-serving-cert\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.673593 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.673414 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-oauth-config\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.673593 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.673489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-config\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.674435 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.674203 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-service-ca\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.674435 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.674254 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-oauth-serving-cert\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.674615 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.674439 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-config\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.676407 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.676384 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-serving-cert\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.676667 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.676641 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-oauth-config\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.681912 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.681886 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwsf9\" (UniqueName: \"kubernetes.io/projected/2ecd8705-73d9-4092-b70d-3ebc234540c9-kube-api-access-zwsf9\") pod \"console-75d7b9bcf5-jnk2d\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:09.855657 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:09.855568 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:10.009227 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:10.009119 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d7b9bcf5-jnk2d"] Jun 09 13:49:10.012018 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:49:10.011971 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ecd8705_73d9_4092_b70d_3ebc234540c9.slice/crio-370a4336948a6ea6310994d63825d09347cce8ef31c7d45b2b6f7d45981c442c WatchSource:0}: Error finding container 370a4336948a6ea6310994d63825d09347cce8ef31c7d45b2b6f7d45981c442c: Status 404 returned error can't find the container with id 370a4336948a6ea6310994d63825d09347cce8ef31c7d45b2b6f7d45981c442c Jun 09 13:49:10.792515 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:10.792479 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d7b9bcf5-jnk2d" event={"ID":"2ecd8705-73d9-4092-b70d-3ebc234540c9","Type":"ContainerStarted","Data":"370a4336948a6ea6310994d63825d09347cce8ef31c7d45b2b6f7d45981c442c"} Jun 09 13:49:16.930369 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:16.930339 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:16.986574 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:16.986538 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:17.847318 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:17.847279 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:49:17.849903 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:17.849850 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2e9f3f-f036-427f-85ac-33212870137f-metrics-certs\") pod \"network-metrics-daemon-5rz5l\" (UID: \"9d2e9f3f-f036-427f-85ac-33212870137f\") " pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:49:18.043635 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.043595 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-htm2v\"" Jun 09 13:49:18.050873 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.050847 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rz5l" Jun 09 13:49:18.322432 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.322394 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6755d8cfc6-9mkxk"] Jun 09 13:49:18.325517 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.325488 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.339107 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.339079 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6755d8cfc6-9mkxk"] Jun 09 13:49:18.339970 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.339904 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 13:49:18.352302 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.352266 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-trusted-ca-bundle\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.352468 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.352333 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca348576-2098-4a41-9094-a4b19829eaa6-console-oauth-config\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.352468 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.352411 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-service-ca\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.352468 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.352444 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-console-config\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.352570 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.352488 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl698\" (UniqueName: \"kubernetes.io/projected/ca348576-2098-4a41-9094-a4b19829eaa6-kube-api-access-jl698\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.352570 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.352521 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca348576-2098-4a41-9094-a4b19829eaa6-console-serving-cert\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.352570 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.352542 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-oauth-serving-cert\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.453109 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.453075 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-trusted-ca-bundle\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.453299 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.453123 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca348576-2098-4a41-9094-a4b19829eaa6-console-oauth-config\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.453299 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.453154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-service-ca\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.453299 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.453175 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-console-config\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.453299 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.453226 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl698\" (UniqueName: \"kubernetes.io/projected/ca348576-2098-4a41-9094-a4b19829eaa6-kube-api-access-jl698\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.453299 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.453269 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca348576-2098-4a41-9094-a4b19829eaa6-console-serving-cert\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.453898 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.453643 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-oauth-serving-cert\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.454110 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.454076 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-service-ca\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.454364 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.454180 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-console-config\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.454364 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.454273 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-trusted-ca-bundle\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.454482 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.454393 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-oauth-serving-cert\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.456216 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.456158 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca348576-2098-4a41-9094-a4b19829eaa6-console-serving-cert\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.456317 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.456300 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca348576-2098-4a41-9094-a4b19829eaa6-console-oauth-config\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.462627 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.462605 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl698\" (UniqueName: \"kubernetes.io/projected/ca348576-2098-4a41-9094-a4b19829eaa6-kube-api-access-jl698\") pod \"console-6755d8cfc6-9mkxk\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:18.641733 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:18.641644 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:20.651489 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:20.651462 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5rz5l"] Jun 09 13:49:20.653744 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:49:20.653716 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2e9f3f_f036_427f_85ac_33212870137f.slice/crio-ba34c1a900c26ef9084c2c3c8905fcfc4039458a445703c30a09b2ac4ba5151c WatchSource:0}: Error finding container ba34c1a900c26ef9084c2c3c8905fcfc4039458a445703c30a09b2ac4ba5151c: Status 404 returned error can't find the container with id ba34c1a900c26ef9084c2c3c8905fcfc4039458a445703c30a09b2ac4ba5151c Jun 09 13:49:20.674198 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:20.674176 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6755d8cfc6-9mkxk"] Jun 09 13:49:20.677085 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:49:20.677051 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca348576_2098_4a41_9094_a4b19829eaa6.slice/crio-5cd46b6ffecbb5dfa31c2877f6c09790ff3dd692bb6511758c569b2546f59525 WatchSource:0}: Error finding container 5cd46b6ffecbb5dfa31c2877f6c09790ff3dd692bb6511758c569b2546f59525: Status 404 returned error can't find the container with id 5cd46b6ffecbb5dfa31c2877f6c09790ff3dd692bb6511758c569b2546f59525 Jun 09 13:49:20.715533 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:20.715466 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:20.817436 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:20.817334 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:20.843935 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:20.843699 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6755d8cfc6-9mkxk" event={"ID":"ca348576-2098-4a41-9094-a4b19829eaa6","Type":"ContainerStarted","Data":"c11b51b6096822c48783153cb897284fb0417f6b15243e43d2b029153527d297"} Jun 09 13:49:20.843935 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:20.843750 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6755d8cfc6-9mkxk" event={"ID":"ca348576-2098-4a41-9094-a4b19829eaa6","Type":"ContainerStarted","Data":"5cd46b6ffecbb5dfa31c2877f6c09790ff3dd692bb6511758c569b2546f59525"} Jun 09 13:49:20.845655 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:20.845626 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d7b9bcf5-jnk2d" event={"ID":"2ecd8705-73d9-4092-b70d-3ebc234540c9","Type":"ContainerStarted","Data":"cc392c1ce7ca711a8d46aa98c53522fbb6a34f468bbad19c8a2164cedd0fd7bd"} Jun 09 13:49:20.847473 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:20.847271 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rz5l" event={"ID":"9d2e9f3f-f036-427f-85ac-33212870137f","Type":"ContainerStarted","Data":"ba34c1a900c26ef9084c2c3c8905fcfc4039458a445703c30a09b2ac4ba5151c"} Jun 09 13:49:20.849047 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:20.849020 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-994rw" event={"ID":"31fbae42-0c4a-46be-ab35-d9f75106bd57","Type":"ContainerStarted","Data":"4903adf344d043dcfb8bd2819eb5b5c3d4b9439a4400a21fa9f4ada0a09e9648"} Jun 09 13:49:20.849361 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:20.849305 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-994rw" Jun 09 13:49:20.855451 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:20.855406 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-994rw" Jun 09 13:49:20.862234 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:20.862188 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6755d8cfc6-9mkxk" podStartSLOduration=2.862172895 podStartE2EDuration="2.862172895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:49:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:49:20.861071737 +0000 UTC m=+255.308794093" watchObservedRunningTime="2026-06-09 13:49:20.862172895 +0000 UTC m=+255.309895252" Jun 09 13:49:20.877739 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:20.877691 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-994rw" podStartSLOduration=1.820730002 podStartE2EDuration="20.877676733s" totalImagesPullingTime="19.056946731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:49:20.875861189 +0000 UTC m=+255.323583543" watchObservedRunningTime="2026-06-09 13:49:20.877676733 +0000 UTC m=+255.325399086" Jun 09 13:49:20.894091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:20.893944 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75d7b9bcf5-jnk2d" podStartSLOduration=1.397448507 podStartE2EDuration="11.893921395s" totalImagesPullingTime="10.496472888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:49:20.891728104 +0000 UTC m=+255.339450481" watchObservedRunningTime="2026-06-09 13:49:20.893921395 +0000 UTC m=+255.341643751" Jun 09 13:49:21.474126 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:21.474074 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:21.474331 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:21.474243 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:21.864477 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:21.864428 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rz5l" event={"ID":"9d2e9f3f-f036-427f-85ac-33212870137f","Type":"ContainerStarted","Data":"c742bf935d3db34db3d0665622fcb3d2e3598c06fea7bcfecc217fde5d13412c"} Jun 09 13:49:21.864959 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:21.864532 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rz5l" event={"ID":"9d2e9f3f-f036-427f-85ac-33212870137f","Type":"ContainerStarted","Data":"95feacfe2c878e9506fddbed451fda571614fc638b4d91ffcd44fb4c6df59bd0"} Jun 09 13:49:21.884705 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:21.884645 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5rz5l" podStartSLOduration=254.986130392 podStartE2EDuration="4m15.884629047s" totalImagesPullingTime="898.498655ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:49:21.882901365 +0000 UTC m=+256.330623747" watchObservedRunningTime="2026-06-09 13:49:21.884629047 +0000 UTC m=+256.332351400" Jun 09 13:49:21.980851 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:21.980812 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:22.873417 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:22.873355 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:27.749272 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:27.749157 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:27.807575 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:27.807535 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:28.642376 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:28.642330 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:28.642580 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:28.642408 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:28.644166 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:28.644136 2558 patch_prober.go:28] interesting pod/console-6755d8cfc6-9mkxk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 09 13:49:28.644287 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:28.644201 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6755d8cfc6-9mkxk" podUID="ca348576-2098-4a41-9094-a4b19829eaa6" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 09 13:49:28.902165 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:28.902064 2558 generic.go:356] "Generic (PLEG): container finished" podID="835718d8-f0eb-43eb-abf2-bb692fed6a79" containerID="2d08ff813167f4cd7d621b4638b3fdd999cd729d856def14f48dd7d04414842e" exitCode=0 Jun 09 13:49:28.902653 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:28.902212 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" event={"ID":"835718d8-f0eb-43eb-abf2-bb692fed6a79","Type":"ContainerDied","Data":"2d08ff813167f4cd7d621b4638b3fdd999cd729d856def14f48dd7d04414842e"} Jun 09 13:49:28.902738 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:28.902711 2558 scope.go:117] "RemoveContainer" containerID="2d08ff813167f4cd7d621b4638b3fdd999cd729d856def14f48dd7d04414842e" Jun 09 13:49:29.335307 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:29.335265 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:29.390344 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:29.390299 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:29.855747 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:29.855704 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:29.855955 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:29.855780 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:49:29.857510 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:29.857477 2558 patch_prober.go:28] interesting pod/console-75d7b9bcf5-jnk2d container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 09 13:49:29.857644 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:29.857533 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75d7b9bcf5-jnk2d" podUID="2ecd8705-73d9-4092-b70d-3ebc234540c9" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 09 13:49:29.914231 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:29.914192 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tczfk" event={"ID":"835718d8-f0eb-43eb-abf2-bb692fed6a79","Type":"ContainerStarted","Data":"51b0c55d142a163af7fa0b843aeda8902ab0ae2d7784f47cd93d498d7872b95f"} Jun 09 13:49:33.685352 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:33.685313 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:33.751481 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:33.751443 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:35.540708 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:35.540663 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:35.602152 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:35.602114 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:37.952859 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:37.952807 2558 generic.go:356] "Generic (PLEG): container finished" podID="28ed990b-7f1d-479f-9cb1-15ed52a29889" containerID="0e77d8f39d6d909644727fa2aacdd9e883bce6a82d2bfa395f2c840759a527e0" exitCode=0 Jun 09 13:49:37.953226 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:37.952878 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" event={"ID":"28ed990b-7f1d-479f-9cb1-15ed52a29889","Type":"ContainerDied","Data":"0e77d8f39d6d909644727fa2aacdd9e883bce6a82d2bfa395f2c840759a527e0"} Jun 09 13:49:37.953226 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:37.953200 2558 scope.go:117] "RemoveContainer" containerID="0e77d8f39d6d909644727fa2aacdd9e883bce6a82d2bfa395f2c840759a527e0" Jun 09 13:49:38.213142 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:38.213053 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:38.284732 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:38.284696 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:38.646432 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:38.646399 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:38.650272 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:38.650245 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:49:38.712641 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:38.712606 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d7b9bcf5-jnk2d"] Jun 09 13:49:38.831117 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:38.831083 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:38.933364 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:38.933279 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:38.958642 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:38.958605 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8zn6r" event={"ID":"28ed990b-7f1d-479f-9cb1-15ed52a29889","Type":"ContainerStarted","Data":"e87eeff95080f09490d05932bc1c6d20f1d05ed604a19803ac5e1ea89081e6b1"} Jun 09 13:49:39.035814 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:39.035784 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:39.178814 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:39.178781 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:39.283588 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:39.283544 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:39.386952 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:39.386917 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:39.482573 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:39.482531 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:41.479494 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:41.479466 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:41.483396 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:41.483370 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7ddc94f557-djv7k" Jun 09 13:49:42.609525 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:42.609493 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:42.665735 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:42.665702 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:42.757223 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:42.757182 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:42.856493 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:42.856463 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:44.620472 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:44.620439 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:44.680872 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:44.680831 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:45.600768 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:45.600739 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-96ng8_f3156ddf-2573-4c42-8de4-c0c79ebd8f80/dns-node-resolver/0.log" Jun 09 13:49:46.006373 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:46.006346 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-668858dbc7-7wp8j_6d34e2ed-b066-4106-a582-9a90c7d0cbaf/router/0.log" Jun 09 13:49:46.401457 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:46.401375 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8w6fp_0d086613-2feb-4bf5-bcc3-488f6e280503/serve-healthcheck-canary/0.log" Jun 09 13:49:47.254371 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:47.254332 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:47.356528 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:47.356494 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:48.469291 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:49:48.469240 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ppk28" podUID="32cb4473-dcd4-49a0-a77b-947ef606801b" Jun 09 13:49:48.997274 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:48.997241 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ppk28" Jun 09 13:49:49.584246 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:49.584215 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:49.645172 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:49.645139 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:51.865118 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:51.865079 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:49:51.867656 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:51.867636 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32cb4473-dcd4-49a0-a77b-947ef606801b-metrics-tls\") pod \"dns-default-ppk28\" (UID: \"32cb4473-dcd4-49a0-a77b-947ef606801b\") " pod="openshift-dns/dns-default-ppk28" Jun 09 13:49:52.001073 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:52.001034 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7smxg\"" Jun 09 13:49:52.008763 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:52.008739 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ppk28" Jun 09 13:49:52.170683 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:52.170521 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ppk28"] Jun 09 13:49:52.173507 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:49:52.173472 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32cb4473_dcd4_49a0_a77b_947ef606801b.slice/crio-08e6b92998fc92e78ae250b6671a3e062587ceaa56ac8ea0834db3efbf3267ac WatchSource:0}: Error finding container 08e6b92998fc92e78ae250b6671a3e062587ceaa56ac8ea0834db3efbf3267ac: Status 404 returned error can't find the container with id 08e6b92998fc92e78ae250b6671a3e062587ceaa56ac8ea0834db3efbf3267ac Jun 09 13:49:53.014562 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:53.014519 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ppk28" event={"ID":"32cb4473-dcd4-49a0-a77b-947ef606801b","Type":"ContainerStarted","Data":"08e6b92998fc92e78ae250b6671a3e062587ceaa56ac8ea0834db3efbf3267ac"} Jun 09 13:49:57.037598 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:57.037548 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ppk28" event={"ID":"32cb4473-dcd4-49a0-a77b-947ef606801b","Type":"ContainerStarted","Data":"d2570ea3e067d8395a152976d157a11fce6c4007683ef8557daae34cedb04c07"} Jun 09 13:49:57.038016 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:57.037661 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ppk28" Jun 09 13:49:57.038016 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:57.037691 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ppk28" event={"ID":"32cb4473-dcd4-49a0-a77b-947ef606801b","Type":"ContainerStarted","Data":"df4cbb61c53b5a67a7a033409c7e903c5f57b5b774a790856bf1dabf7a84280a"} Jun 09 13:49:57.060033 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:57.059947 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ppk28" podStartSLOduration=252.248853526 podStartE2EDuration="4m16.059922085s" totalImagesPullingTime="3.811068559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:49:57.056639087 +0000 UTC m=+291.504361444" watchObservedRunningTime="2026-06-09 13:49:57.059922085 +0000 UTC m=+291.507644442" Jun 09 13:49:57.755211 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:57.755150 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:49:57.818786 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:49:57.818754 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:03.734473 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:03.734424 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75d7b9bcf5-jnk2d" podUID="2ecd8705-73d9-4092-b70d-3ebc234540c9" containerName="console" containerID="cri-o://cc392c1ce7ca711a8d46aa98c53522fbb6a34f468bbad19c8a2164cedd0fd7bd" gracePeriod=15 Jun 09 13:50:04.008080 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.008004 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:50:04.073365 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.073336 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-serving-cert\") pod \"2ecd8705-73d9-4092-b70d-3ebc234540c9\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " Jun 09 13:50:04.073569 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.073382 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-oauth-serving-cert\") pod \"2ecd8705-73d9-4092-b70d-3ebc234540c9\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " Jun 09 13:50:04.073569 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.073416 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwsf9\" (UniqueName: \"kubernetes.io/projected/2ecd8705-73d9-4092-b70d-3ebc234540c9-kube-api-access-zwsf9\") pod \"2ecd8705-73d9-4092-b70d-3ebc234540c9\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " Jun 09 13:50:04.073569 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.073452 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-config\") pod \"2ecd8705-73d9-4092-b70d-3ebc234540c9\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " Jun 09 13:50:04.073569 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.073485 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-oauth-config\") pod \"2ecd8705-73d9-4092-b70d-3ebc234540c9\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " Jun 09 13:50:04.073569 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.073531 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-service-ca\") pod \"2ecd8705-73d9-4092-b70d-3ebc234540c9\" (UID: \"2ecd8705-73d9-4092-b70d-3ebc234540c9\") " Jun 09 13:50:04.073815 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.073792 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2ecd8705-73d9-4092-b70d-3ebc234540c9" (UID: "2ecd8705-73d9-4092-b70d-3ebc234540c9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:50:04.073960 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.073921 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-config" (OuterVolumeSpecName: "console-config") pod "2ecd8705-73d9-4092-b70d-3ebc234540c9" (UID: "2ecd8705-73d9-4092-b70d-3ebc234540c9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:50:04.074137 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.074117 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-service-ca" (OuterVolumeSpecName: "service-ca") pod "2ecd8705-73d9-4092-b70d-3ebc234540c9" (UID: "2ecd8705-73d9-4092-b70d-3ebc234540c9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:50:04.074361 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.074336 2558 generic.go:356] "Generic (PLEG): container finished" podID="2ecd8705-73d9-4092-b70d-3ebc234540c9" containerID="cc392c1ce7ca711a8d46aa98c53522fbb6a34f468bbad19c8a2164cedd0fd7bd" exitCode=0 Jun 09 13:50:04.074438 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.074381 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d7b9bcf5-jnk2d" Jun 09 13:50:04.074438 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.074415 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d7b9bcf5-jnk2d" event={"ID":"2ecd8705-73d9-4092-b70d-3ebc234540c9","Type":"ContainerDied","Data":"cc392c1ce7ca711a8d46aa98c53522fbb6a34f468bbad19c8a2164cedd0fd7bd"} Jun 09 13:50:04.074521 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.074463 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d7b9bcf5-jnk2d" event={"ID":"2ecd8705-73d9-4092-b70d-3ebc234540c9","Type":"ContainerDied","Data":"370a4336948a6ea6310994d63825d09347cce8ef31c7d45b2b6f7d45981c442c"} Jun 09 13:50:04.074521 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.074491 2558 scope.go:117] "RemoveContainer" containerID="cc392c1ce7ca711a8d46aa98c53522fbb6a34f468bbad19c8a2164cedd0fd7bd" Jun 09 13:50:04.076420 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.076394 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2ecd8705-73d9-4092-b70d-3ebc234540c9" (UID: "2ecd8705-73d9-4092-b70d-3ebc234540c9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:50:04.076529 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.076483 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2ecd8705-73d9-4092-b70d-3ebc234540c9" (UID: "2ecd8705-73d9-4092-b70d-3ebc234540c9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:50:04.076585 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.076524 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ecd8705-73d9-4092-b70d-3ebc234540c9-kube-api-access-zwsf9" (OuterVolumeSpecName: "kube-api-access-zwsf9") pod "2ecd8705-73d9-4092-b70d-3ebc234540c9" (UID: "2ecd8705-73d9-4092-b70d-3ebc234540c9"). InnerVolumeSpecName "kube-api-access-zwsf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:50:04.093760 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.093737 2558 scope.go:117] "RemoveContainer" containerID="cc392c1ce7ca711a8d46aa98c53522fbb6a34f468bbad19c8a2164cedd0fd7bd" Jun 09 13:50:04.094154 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:50:04.094129 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc392c1ce7ca711a8d46aa98c53522fbb6a34f468bbad19c8a2164cedd0fd7bd\": container with ID starting with cc392c1ce7ca711a8d46aa98c53522fbb6a34f468bbad19c8a2164cedd0fd7bd not found: ID does not exist" containerID="cc392c1ce7ca711a8d46aa98c53522fbb6a34f468bbad19c8a2164cedd0fd7bd" Jun 09 13:50:04.094201 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.094166 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc392c1ce7ca711a8d46aa98c53522fbb6a34f468bbad19c8a2164cedd0fd7bd"} err="failed to get container status \"cc392c1ce7ca711a8d46aa98c53522fbb6a34f468bbad19c8a2164cedd0fd7bd\": rpc error: code = NotFound desc = could not find container \"cc392c1ce7ca711a8d46aa98c53522fbb6a34f468bbad19c8a2164cedd0fd7bd\": container with ID starting with cc392c1ce7ca711a8d46aa98c53522fbb6a34f468bbad19c8a2164cedd0fd7bd not found: ID does not exist" Jun 09 13:50:04.175173 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.175130 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-oauth-config\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:04.175173 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.175163 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-service-ca\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:04.175173 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.175173 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-serving-cert\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:04.175173 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.175182 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-oauth-serving-cert\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:04.175427 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.175193 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwsf9\" (UniqueName: \"kubernetes.io/projected/2ecd8705-73d9-4092-b70d-3ebc234540c9-kube-api-access-zwsf9\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:04.175427 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.175201 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ecd8705-73d9-4092-b70d-3ebc234540c9-console-config\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:04.396599 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.396564 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d7b9bcf5-jnk2d"] Jun 09 13:50:04.400973 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:04.400945 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75d7b9bcf5-jnk2d"] Jun 09 13:50:05.891543 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:05.891515 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gp8mh_94fe717f-e61a-483a-bac8-be82ca3c7dc2/ovn-acl-logging/0.log" Jun 09 13:50:05.891964 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:05.891947 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gp8mh_94fe717f-e61a-483a-bac8-be82ca3c7dc2/ovn-acl-logging/0.log" Jun 09 13:50:05.898743 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:05.898723 2558 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 13:50:05.945296 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:05.945168 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ecd8705-73d9-4092-b70d-3ebc234540c9" path="/var/lib/kubelet/pods/2ecd8705-73d9-4092-b70d-3ebc234540c9/volumes" Jun 09 13:50:07.044375 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:07.044345 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ppk28" Jun 09 13:50:10.506624 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:10.506588 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:10.563600 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:10.563562 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:12.754632 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:12.754590 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:12.822049 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:12.822012 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:15.114434 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:15.114398 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:15.214961 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:15.214931 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:15.287658 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:15.287624 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:15.863969 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:15.863939 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:16.177835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:16.177744 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:16.236321 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:16.236284 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:16.971111 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:16.971072 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:50:16.971358 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:16.971338 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="alertmanager" containerID="cri-o://33dfb006f2e128b677ac91770e77ccf91048e438f054bb49f599ed90f4c3472d" gracePeriod=120 Jun 09 13:50:16.971430 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:16.971405 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="kube-rbac-proxy-metric" containerID="cri-o://a351376b684d6cf5e3edb0c387ad08e01d18c2b497c4f901a37d4dde8f07b28f" gracePeriod=120 Jun 09 13:50:16.971487 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:16.971465 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="prom-label-proxy" containerID="cri-o://d5ac5676ae7e959c12c37562c43776972c676a6bfbf8e0ee5f700e2dfe9029d5" gracePeriod=120 Jun 09 13:50:16.971535 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:16.971500 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="config-reloader" containerID="cri-o://513e9e842a137bc96fd620f3ee0f53a5cee8aeaec4ce74ee78566e403a3592b8" gracePeriod=120 Jun 09 13:50:16.971583 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:16.971529 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="kube-rbac-proxy" containerID="cri-o://a63e927f62d7c53b9d71855dbeb29bf7760c6e92b2e7ae810e7af720d78678f6" gracePeriod=120 Jun 09 13:50:16.971687 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:16.971648 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="kube-rbac-proxy-web" containerID="cri-o://049a9060f373dd68f2a653e0b7621ef2df0448c1faaabcd659868dbcf608c77a" gracePeriod=120 Jun 09 13:50:17.129279 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:17.129246 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerID="d5ac5676ae7e959c12c37562c43776972c676a6bfbf8e0ee5f700e2dfe9029d5" exitCode=0 Jun 09 13:50:17.129279 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:17.129272 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerID="a63e927f62d7c53b9d71855dbeb29bf7760c6e92b2e7ae810e7af720d78678f6" exitCode=0 Jun 09 13:50:17.129279 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:17.129279 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerID="513e9e842a137bc96fd620f3ee0f53a5cee8aeaec4ce74ee78566e403a3592b8" exitCode=0 Jun 09 13:50:17.129279 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:17.129284 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerID="33dfb006f2e128b677ac91770e77ccf91048e438f054bb49f599ed90f4c3472d" exitCode=0 Jun 09 13:50:17.129537 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:17.129314 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerDied","Data":"d5ac5676ae7e959c12c37562c43776972c676a6bfbf8e0ee5f700e2dfe9029d5"} Jun 09 13:50:17.129537 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:17.129377 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerDied","Data":"a63e927f62d7c53b9d71855dbeb29bf7760c6e92b2e7ae810e7af720d78678f6"} Jun 09 13:50:17.129537 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:17.129402 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerDied","Data":"513e9e842a137bc96fd620f3ee0f53a5cee8aeaec4ce74ee78566e403a3592b8"} Jun 09 13:50:17.129537 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:17.129426 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerDied","Data":"33dfb006f2e128b677ac91770e77ccf91048e438f054bb49f599ed90f4c3472d"} Jun 09 13:50:18.138629 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.138595 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerID="a351376b684d6cf5e3edb0c387ad08e01d18c2b497c4f901a37d4dde8f07b28f" exitCode=0 Jun 09 13:50:18.138629 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.138630 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerID="049a9060f373dd68f2a653e0b7621ef2df0448c1faaabcd659868dbcf608c77a" exitCode=0 Jun 09 13:50:18.139129 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.138690 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerDied","Data":"a351376b684d6cf5e3edb0c387ad08e01d18c2b497c4f901a37d4dde8f07b28f"} Jun 09 13:50:18.139129 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.138758 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerDied","Data":"049a9060f373dd68f2a653e0b7621ef2df0448c1faaabcd659868dbcf608c77a"} Jun 09 13:50:18.219472 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.219446 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:18.293583 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.293498 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy\") pod \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " Jun 09 13:50:18.293583 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.293542 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnzq6\" (UniqueName: \"kubernetes.io/projected/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-kube-api-access-jnzq6\") pod \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " Jun 09 13:50:18.293583 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.293579 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-metrics-client-ca\") pod \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " Jun 09 13:50:18.293835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.293600 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-config-volume\") pod \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " Jun 09 13:50:18.293835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.293628 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-config-out\") pod \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " Jun 09 13:50:18.293835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.293667 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-alertmanager-main-db\") pod \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " Jun 09 13:50:18.293835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.293691 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-web-config\") pod \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " Jun 09 13:50:18.293835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.293714 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-cluster-tls-config\") pod \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " Jun 09 13:50:18.293835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.293748 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy-web\") pod \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " Jun 09 13:50:18.293835 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.293821 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-tls-assets\") pod \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " Jun 09 13:50:18.294244 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.293863 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " Jun 09 13:50:18.294244 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.293901 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-alertmanager-trusted-ca-bundle\") pod \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " Jun 09 13:50:18.294244 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.293952 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-main-tls\") pod \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\" (UID: \"3f87b588-65ed-44e4-968d-cf4cb4cf1b13\") " Jun 09 13:50:18.294244 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.293951 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3f87b588-65ed-44e4-968d-cf4cb4cf1b13" (UID: "3f87b588-65ed-44e4-968d-cf4cb4cf1b13"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:50:18.294972 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.294941 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3f87b588-65ed-44e4-968d-cf4cb4cf1b13" (UID: "3f87b588-65ed-44e4-968d-cf4cb4cf1b13"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:50:18.295127 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.295045 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3f87b588-65ed-44e4-968d-cf4cb4cf1b13" (UID: "3f87b588-65ed-44e4-968d-cf4cb4cf1b13"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:50:18.295127 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.295092 2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-metrics-client-ca\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:18.297086 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.297050 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3f87b588-65ed-44e4-968d-cf4cb4cf1b13" (UID: "3f87b588-65ed-44e4-968d-cf4cb4cf1b13"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:50:18.297752 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.297716 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-config-volume" (OuterVolumeSpecName: "config-volume") pod "3f87b588-65ed-44e4-968d-cf4cb4cf1b13" (UID: "3f87b588-65ed-44e4-968d-cf4cb4cf1b13"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:50:18.297853 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.297764 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3f87b588-65ed-44e4-968d-cf4cb4cf1b13" (UID: "3f87b588-65ed-44e4-968d-cf4cb4cf1b13"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:50:18.298315 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.298281 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3f87b588-65ed-44e4-968d-cf4cb4cf1b13" (UID: "3f87b588-65ed-44e4-968d-cf4cb4cf1b13"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:50:18.299090 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.299064 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-kube-api-access-jnzq6" (OuterVolumeSpecName: "kube-api-access-jnzq6") pod "3f87b588-65ed-44e4-968d-cf4cb4cf1b13" (UID: "3f87b588-65ed-44e4-968d-cf4cb4cf1b13"). InnerVolumeSpecName "kube-api-access-jnzq6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:50:18.299190 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.299111 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3f87b588-65ed-44e4-968d-cf4cb4cf1b13" (UID: "3f87b588-65ed-44e4-968d-cf4cb4cf1b13"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:50:18.299610 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.299589 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3f87b588-65ed-44e4-968d-cf4cb4cf1b13" (UID: "3f87b588-65ed-44e4-968d-cf4cb4cf1b13"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:50:18.299730 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.299708 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-config-out" (OuterVolumeSpecName: "config-out") pod "3f87b588-65ed-44e4-968d-cf4cb4cf1b13" (UID: "3f87b588-65ed-44e4-968d-cf4cb4cf1b13"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:50:18.302285 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.302261 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3f87b588-65ed-44e4-968d-cf4cb4cf1b13" (UID: "3f87b588-65ed-44e4-968d-cf4cb4cf1b13"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:50:18.308990 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.308952 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-web-config" (OuterVolumeSpecName: "web-config") pod "3f87b588-65ed-44e4-968d-cf4cb4cf1b13" (UID: "3f87b588-65ed-44e4-968d-cf4cb4cf1b13"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:50:18.395801 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.395750 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:18.395801 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.395797 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-tls-assets\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:18.395801 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.395807 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:18.395801 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.395817 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:18.396103 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.395826 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-main-tls\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:18.396103 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.395835 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:18.396103 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.395844 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnzq6\" (UniqueName: \"kubernetes.io/projected/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-kube-api-access-jnzq6\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:18.396103 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.395853 2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-config-volume\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:18.396103 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.395860 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-config-out\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:18.396103 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.395867 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-alertmanager-main-db\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:18.396103 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.395876 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-web-config\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:18.396103 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:18.395883 2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3f87b588-65ed-44e4-968d-cf4cb4cf1b13-cluster-tls-config\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:50:19.147119 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.147081 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f87b588-65ed-44e4-968d-cf4cb4cf1b13","Type":"ContainerDied","Data":"bb242528dd91c0095b1d1bad5e48710ab1c5fa0dc394e8fa6cb2ff51e2ba7bfe"} Jun 09 13:50:19.147119 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.147118 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.147611 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.147172 2558 scope.go:117] "RemoveContainer" containerID="d5ac5676ae7e959c12c37562c43776972c676a6bfbf8e0ee5f700e2dfe9029d5" Jun 09 13:50:19.155284 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.155137 2558 scope.go:117] "RemoveContainer" containerID="a351376b684d6cf5e3edb0c387ad08e01d18c2b497c4f901a37d4dde8f07b28f" Jun 09 13:50:19.163045 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.163015 2558 scope.go:117] "RemoveContainer" containerID="a63e927f62d7c53b9d71855dbeb29bf7760c6e92b2e7ae810e7af720d78678f6" Jun 09 13:50:19.169943 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.169875 2558 scope.go:117] "RemoveContainer" containerID="049a9060f373dd68f2a653e0b7621ef2df0448c1faaabcd659868dbcf608c77a" Jun 09 13:50:19.172386 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.172364 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:50:19.176947 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.176927 2558 scope.go:117] "RemoveContainer" containerID="513e9e842a137bc96fd620f3ee0f53a5cee8aeaec4ce74ee78566e403a3592b8" Jun 09 13:50:19.184360 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.184328 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:50:19.185646 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.185622 2558 scope.go:117] "RemoveContainer" containerID="33dfb006f2e128b677ac91770e77ccf91048e438f054bb49f599ed90f4c3472d" Jun 09 13:50:19.192773 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.192752 2558 scope.go:117] "RemoveContainer" containerID="a8063573ccd038073c457280ac9b57ede9ab1d4b8168178c2ff41577aea95671" Jun 09 13:50:19.215505 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215473 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:50:19.215754 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215742 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="config-reloader" Jun 09 13:50:19.215802 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215755 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="config-reloader" Jun 09 13:50:19.215802 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215766 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="prom-label-proxy" Jun 09 13:50:19.215802 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215772 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="prom-label-proxy" Jun 09 13:50:19.215802 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215780 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="alertmanager" Jun 09 13:50:19.215802 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215786 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="alertmanager" Jun 09 13:50:19.215802 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215793 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="kube-rbac-proxy-metric" Jun 09 13:50:19.215802 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215798 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="kube-rbac-proxy-metric" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215808 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="init-config-reloader" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215814 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="init-config-reloader" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215819 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="kube-rbac-proxy" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215824 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="kube-rbac-proxy" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215837 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="kube-rbac-proxy-web" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215843 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="kube-rbac-proxy-web" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215848 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ecd8705-73d9-4092-b70d-3ebc234540c9" containerName="console" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215853 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ecd8705-73d9-4092-b70d-3ebc234540c9" containerName="console" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215897 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="alertmanager" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215905 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ecd8705-73d9-4092-b70d-3ebc234540c9" containerName="console" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215910 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="kube-rbac-proxy" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215916 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="kube-rbac-proxy-metric" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215922 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="kube-rbac-proxy-web" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215928 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="config-reloader" Jun 09 13:50:19.216032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.215933 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" containerName="prom-label-proxy" Jun 09 13:50:19.219196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.219178 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.223079 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.223055 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 13:50:19.223189 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.223145 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 13:50:19.223321 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.223267 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 13:50:19.223442 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.223425 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 13:50:19.223548 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.223455 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 13:50:19.223548 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.223478 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cblwl\"" Jun 09 13:50:19.223548 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.223527 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 13:50:19.223803 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.223790 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 13:50:19.223860 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.223822 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 13:50:19.230956 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.230937 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 13:50:19.241382 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.241354 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:50:19.304348 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.304258 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e568b77-2c26-472a-b2b2-3b24e2680877-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.304348 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.304299 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f58mf\" (UniqueName: \"kubernetes.io/projected/6e568b77-2c26-472a-b2b2-3b24e2680877-kube-api-access-f58mf\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.304348 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.304322 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e568b77-2c26-472a-b2b2-3b24e2680877-config-out\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.304599 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.304408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e568b77-2c26-472a-b2b2-3b24e2680877-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.304599 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.304449 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.304599 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.304477 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e568b77-2c26-472a-b2b2-3b24e2680877-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.304599 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.304550 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-web-config\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.304599 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.304590 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.304838 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.304617 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.304838 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.304662 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e568b77-2c26-472a-b2b2-3b24e2680877-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.304838 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.304702 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.304838 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.304753 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.304838 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.304776 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.405312 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.405258 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.405312 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.405313 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.405630 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.405348 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e568b77-2c26-472a-b2b2-3b24e2680877-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.405630 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.405376 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f58mf\" (UniqueName: \"kubernetes.io/projected/6e568b77-2c26-472a-b2b2-3b24e2680877-kube-api-access-f58mf\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.405630 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.405526 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e568b77-2c26-472a-b2b2-3b24e2680877-config-out\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.405630 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.405586 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e568b77-2c26-472a-b2b2-3b24e2680877-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.405900 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.405629 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.405900 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.405663 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e568b77-2c26-472a-b2b2-3b24e2680877-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.405900 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.405703 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-web-config\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.405900 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.405730 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.405900 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.405756 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.405900 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.405773 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e568b77-2c26-472a-b2b2-3b24e2680877-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.405900 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.405813 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e568b77-2c26-472a-b2b2-3b24e2680877-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.405900 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.405845 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.406805 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.406775 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e568b77-2c26-472a-b2b2-3b24e2680877-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.408840 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.408722 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.408840 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.408725 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.409012 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.408839 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.409012 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.408952 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.409206 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.409177 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.409306 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.409232 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e568b77-2c26-472a-b2b2-3b24e2680877-config-out\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.409570 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.409550 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.409636 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.409592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e568b77-2c26-472a-b2b2-3b24e2680877-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.409916 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.409894 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e568b77-2c26-472a-b2b2-3b24e2680877-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.411078 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.411058 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e568b77-2c26-472a-b2b2-3b24e2680877-web-config\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.414714 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.414693 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f58mf\" (UniqueName: \"kubernetes.io/projected/6e568b77-2c26-472a-b2b2-3b24e2680877-kube-api-access-f58mf\") pod \"alertmanager-main-0\" (UID: \"6e568b77-2c26-472a-b2b2-3b24e2680877\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.528826 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.528787 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:50:19.676351 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.676320 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:50:19.679459 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:50:19.679429 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e568b77_2c26_472a_b2b2_3b24e2680877.slice/crio-3f6f0a8457f437dee3d10abb6a930140d7a25baebdf919467e4fea8f6c02d273 WatchSource:0}: Error finding container 3f6f0a8457f437dee3d10abb6a930140d7a25baebdf919467e4fea8f6c02d273: Status 404 returned error can't find the container with id 3f6f0a8457f437dee3d10abb6a930140d7a25baebdf919467e4fea8f6c02d273 Jun 09 13:50:19.944547 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:19.944466 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f87b588-65ed-44e4-968d-cf4cb4cf1b13" path="/var/lib/kubelet/pods/3f87b588-65ed-44e4-968d-cf4cb4cf1b13/volumes" Jun 09 13:50:20.152610 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:20.152571 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e568b77-2c26-472a-b2b2-3b24e2680877" containerID="803500f3b56a5d99b4776082524f682577bca1a122dfb63f7158b45aed8255d5" exitCode=0 Jun 09 13:50:20.153036 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:20.152655 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e568b77-2c26-472a-b2b2-3b24e2680877","Type":"ContainerDied","Data":"803500f3b56a5d99b4776082524f682577bca1a122dfb63f7158b45aed8255d5"} Jun 09 13:50:20.153036 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:20.152722 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e568b77-2c26-472a-b2b2-3b24e2680877","Type":"ContainerStarted","Data":"3f6f0a8457f437dee3d10abb6a930140d7a25baebdf919467e4fea8f6c02d273"} Jun 09 13:50:20.970363 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:20.970324 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-fb956d567-xqkvb"] Jun 09 13:50:20.972747 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:20.972731 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:20.975521 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:20.975494 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 13:50:20.975691 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:20.975667 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 13:50:20.975808 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:20.975764 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 13:50:20.975996 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:20.975968 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nxdr6\"" Jun 09 13:50:20.976588 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:20.976570 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 13:50:20.976685 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:20.976664 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 13:50:20.981626 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:20.981605 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 13:50:20.987703 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:20.987678 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fb956d567-xqkvb"] Jun 09 13:50:21.119281 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.119223 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cdd47680-74a0-4491-91cd-244741fe3d5f-telemeter-client-tls\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.119281 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.119284 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdd47680-74a0-4491-91cd-244741fe3d5f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.119501 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.119327 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdd47680-74a0-4491-91cd-244741fe3d5f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.119501 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.119351 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cdd47680-74a0-4491-91cd-244741fe3d5f-secret-telemeter-client\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.119501 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.119385 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdd47680-74a0-4491-91cd-244741fe3d5f-serving-certs-ca-bundle\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.119501 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.119431 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdd47680-74a0-4491-91cd-244741fe3d5f-metrics-client-ca\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.119501 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.119482 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cdd47680-74a0-4491-91cd-244741fe3d5f-federate-client-tls\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.119684 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.119508 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj2mz\" (UniqueName: \"kubernetes.io/projected/cdd47680-74a0-4491-91cd-244741fe3d5f-kube-api-access-qj2mz\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.160780 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.160747 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e568b77-2c26-472a-b2b2-3b24e2680877","Type":"ContainerStarted","Data":"f7efc72bda2efb77edd48dbc1bfb7cddf77709eb058e56a9105104b7c45b832d"} Jun 09 13:50:21.161151 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.160809 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e568b77-2c26-472a-b2b2-3b24e2680877","Type":"ContainerStarted","Data":"124fdb4f6ce0b6989de516f3cf6d7c05c4bfefa1e51071eeb22ba5ae7238641a"} Jun 09 13:50:21.161151 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.160837 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e568b77-2c26-472a-b2b2-3b24e2680877","Type":"ContainerStarted","Data":"1609ccfefb2e1e3342292ca5ed62b5d271263b5eedfa9b46268df2ab651084a6"} Jun 09 13:50:21.161151 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.160860 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e568b77-2c26-472a-b2b2-3b24e2680877","Type":"ContainerStarted","Data":"039a098acd6dc4275ea746f6b22afae501e4e819e8fd073bedbbfa11997532b3"} Jun 09 13:50:21.161151 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.160884 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e568b77-2c26-472a-b2b2-3b24e2680877","Type":"ContainerStarted","Data":"9aa2083b7e9024fc796507d046035cc0688da6f27a01e68a5778cbc2a3e8d8c0"} Jun 09 13:50:21.161151 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.160907 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e568b77-2c26-472a-b2b2-3b24e2680877","Type":"ContainerStarted","Data":"67c92296666e81f4b4f44f3e0b9d442dd762b78201171ecfdff1499ea0b38f57"} Jun 09 13:50:21.190314 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.190252 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.175204343 podStartE2EDuration="2.190231987s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.027644ms" isStatefulPod=false podCreationTimestamp="2026-06-09 13:50:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:50:21.188445498 +0000 UTC m=+315.636167855" watchObservedRunningTime="2026-06-09 13:50:21.190231987 +0000 UTC m=+315.637954342" Jun 09 13:50:21.220503 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.220403 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj2mz\" (UniqueName: \"kubernetes.io/projected/cdd47680-74a0-4491-91cd-244741fe3d5f-kube-api-access-qj2mz\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.220503 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.220442 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cdd47680-74a0-4491-91cd-244741fe3d5f-telemeter-client-tls\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.220503 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.220479 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdd47680-74a0-4491-91cd-244741fe3d5f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.220762 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.220533 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdd47680-74a0-4491-91cd-244741fe3d5f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.220762 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.220556 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cdd47680-74a0-4491-91cd-244741fe3d5f-secret-telemeter-client\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.220762 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.220703 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdd47680-74a0-4491-91cd-244741fe3d5f-serving-certs-ca-bundle\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.220912 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.220774 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdd47680-74a0-4491-91cd-244741fe3d5f-metrics-client-ca\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.220912 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.220897 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cdd47680-74a0-4491-91cd-244741fe3d5f-federate-client-tls\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.222744 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.222709 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdd47680-74a0-4491-91cd-244741fe3d5f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.223178 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.223154 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdd47680-74a0-4491-91cd-244741fe3d5f-metrics-client-ca\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.223843 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.223797 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdd47680-74a0-4491-91cd-244741fe3d5f-serving-certs-ca-bundle\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.229832 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.224286 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdd47680-74a0-4491-91cd-244741fe3d5f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.229832 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.224468 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cdd47680-74a0-4491-91cd-244741fe3d5f-secret-telemeter-client\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.229832 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.224568 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cdd47680-74a0-4491-91cd-244741fe3d5f-federate-client-tls\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.230240 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.230199 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj2mz\" (UniqueName: \"kubernetes.io/projected/cdd47680-74a0-4491-91cd-244741fe3d5f-kube-api-access-qj2mz\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.230404 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.230373 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cdd47680-74a0-4491-91cd-244741fe3d5f-telemeter-client-tls\") pod \"telemeter-client-fb956d567-xqkvb\" (UID: \"cdd47680-74a0-4491-91cd-244741fe3d5f\") " pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.283321 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.283277 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" Jun 09 13:50:21.430790 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.430758 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fb956d567-xqkvb"] Jun 09 13:50:21.433223 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:50:21.433192 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd47680_74a0_4491_91cd_244741fe3d5f.slice/crio-9ed7dba00d5f149760da7797e283c458be212cb9208a8d0e61533ca111611028 WatchSource:0}: Error finding container 9ed7dba00d5f149760da7797e283c458be212cb9208a8d0e61533ca111611028: Status 404 returned error can't find the container with id 9ed7dba00d5f149760da7797e283c458be212cb9208a8d0e61533ca111611028 Jun 09 13:50:21.435288 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:21.435272 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 13:50:22.168122 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:22.168083 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" event={"ID":"cdd47680-74a0-4491-91cd-244741fe3d5f","Type":"ContainerStarted","Data":"9ed7dba00d5f149760da7797e283c458be212cb9208a8d0e61533ca111611028"} Jun 09 13:50:24.178962 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:24.178926 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" event={"ID":"cdd47680-74a0-4491-91cd-244741fe3d5f","Type":"ContainerStarted","Data":"43c4134881cf401e9fc7f376530ead28b63e7b5ef3c53637a3845480441a953c"} Jun 09 13:50:24.179392 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:24.179002 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" event={"ID":"cdd47680-74a0-4491-91cd-244741fe3d5f","Type":"ContainerStarted","Data":"0cf33ef7e3f0cb24745f38e0a073f463e7667103b40341e6f77d1eefeae6b4d9"} Jun 09 13:50:24.179392 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:24.179030 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" event={"ID":"cdd47680-74a0-4491-91cd-244741fe3d5f","Type":"ContainerStarted","Data":"4bced00218711008e43aa94f8c27c4d0d5fd63618fad2bb4950765fb1323827d"} Jun 09 13:50:24.207091 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:24.206950 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-fb956d567-xqkvb" podStartSLOduration=2.157359357 podStartE2EDuration="4.206921478s" totalImagesPullingTime="2.049562121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:50:24.205796248 +0000 UTC m=+318.653518604" watchObservedRunningTime="2026-06-09 13:50:24.206921478 +0000 UTC m=+318.654643837" Jun 09 13:50:25.013307 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.013274 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fd47fcf88-xw2rb"] Jun 09 13:50:25.015517 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.015495 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.032865 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.032829 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd47fcf88-xw2rb"] Jun 09 13:50:25.092213 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.092174 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:25.153147 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.153110 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f92180c-6e5f-4b04-a9d0-76229665c620-console-serving-cert\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.153147 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.153155 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-oauth-serving-cert\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.153323 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.153231 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6zdn\" (UniqueName: \"kubernetes.io/projected/8f92180c-6e5f-4b04-a9d0-76229665c620-kube-api-access-m6zdn\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.153323 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.153280 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f92180c-6e5f-4b04-a9d0-76229665c620-console-oauth-config\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.153323 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.153308 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-console-config\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.153437 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.153338 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-trusted-ca-bundle\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.153437 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.153367 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-service-ca\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.199458 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.199426 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:25.254749 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.254710 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f92180c-6e5f-4b04-a9d0-76229665c620-console-serving-cert\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.254953 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.254912 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-oauth-serving-cert\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.255356 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.255088 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6zdn\" (UniqueName: \"kubernetes.io/projected/8f92180c-6e5f-4b04-a9d0-76229665c620-kube-api-access-m6zdn\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.255356 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.255149 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f92180c-6e5f-4b04-a9d0-76229665c620-console-oauth-config\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.255356 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.255190 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-console-config\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.255356 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.255217 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-trusted-ca-bundle\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.255356 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.255248 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-service-ca\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.255676 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.255639 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-oauth-serving-cert\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.255846 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.255822 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-console-config\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.256317 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.256296 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-service-ca\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.256386 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.256367 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-trusted-ca-bundle\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.257516 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.257494 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f92180c-6e5f-4b04-a9d0-76229665c620-console-oauth-config\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.257636 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.257616 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f92180c-6e5f-4b04-a9d0-76229665c620-console-serving-cert\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.265413 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.265355 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6zdn\" (UniqueName: \"kubernetes.io/projected/8f92180c-6e5f-4b04-a9d0-76229665c620-kube-api-access-m6zdn\") pod \"console-6fd47fcf88-xw2rb\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.324486 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.324437 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:25.462959 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:25.462929 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd47fcf88-xw2rb"] Jun 09 13:50:25.464954 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:50:25.464931 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f92180c_6e5f_4b04_a9d0_76229665c620.slice/crio-d4612684286b94c12cd823a0cbadc1be8521a6ade6b3708b04bc9ceb5ae0f222 WatchSource:0}: Error finding container d4612684286b94c12cd823a0cbadc1be8521a6ade6b3708b04bc9ceb5ae0f222: Status 404 returned error can't find the container with id d4612684286b94c12cd823a0cbadc1be8521a6ade6b3708b04bc9ceb5ae0f222 Jun 09 13:50:26.190059 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:26.190020 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd47fcf88-xw2rb" event={"ID":"8f92180c-6e5f-4b04-a9d0-76229665c620","Type":"ContainerStarted","Data":"e7b44e6f6ae3c7d492ab38c59b8f1e572ef83188a6cefe9df30f7ccbadb1777a"} Jun 09 13:50:26.190242 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:26.190078 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd47fcf88-xw2rb" event={"ID":"8f92180c-6e5f-4b04-a9d0-76229665c620","Type":"ContainerStarted","Data":"d4612684286b94c12cd823a0cbadc1be8521a6ade6b3708b04bc9ceb5ae0f222"} Jun 09 13:50:26.211117 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:26.211065 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fd47fcf88-xw2rb" podStartSLOduration=2.211047019 podStartE2EDuration="2.211047019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:50:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:50:26.208389135 +0000 UTC m=+320.656111491" watchObservedRunningTime="2026-06-09 13:50:26.211047019 +0000 UTC m=+320.658769375" Jun 09 13:50:27.773291 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:27.773255 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:27.877469 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:27.877427 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:33.498649 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:33.498620 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:35.325556 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:35.325514 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:35.326062 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:35.325581 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:35.330415 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:35.330394 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:36.239924 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:36.239891 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:50:36.287373 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:36.287341 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6755d8cfc6-9mkxk"] Jun 09 13:50:36.426504 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:36.426464 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:36.549032 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:36.548929 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:50:36.618688 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:50:36.618654 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:51:01.311935 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.311829 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6755d8cfc6-9mkxk" podUID="ca348576-2098-4a41-9094-a4b19829eaa6" containerName="console" containerID="cri-o://c11b51b6096822c48783153cb897284fb0417f6b15243e43d2b029153527d297" gracePeriod=15 Jun 09 13:51:01.558467 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.558440 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:51:01.671507 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.671411 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl698\" (UniqueName: \"kubernetes.io/projected/ca348576-2098-4a41-9094-a4b19829eaa6-kube-api-access-jl698\") pod \"ca348576-2098-4a41-9094-a4b19829eaa6\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " Jun 09 13:51:01.671507 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.671453 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca348576-2098-4a41-9094-a4b19829eaa6-console-serving-cert\") pod \"ca348576-2098-4a41-9094-a4b19829eaa6\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " Jun 09 13:51:01.671507 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.671483 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-oauth-serving-cert\") pod \"ca348576-2098-4a41-9094-a4b19829eaa6\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " Jun 09 13:51:01.671507 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.671502 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca348576-2098-4a41-9094-a4b19829eaa6-console-oauth-config\") pod \"ca348576-2098-4a41-9094-a4b19829eaa6\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " Jun 09 13:51:01.671841 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.671679 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-service-ca\") pod \"ca348576-2098-4a41-9094-a4b19829eaa6\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " Jun 09 13:51:01.671841 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.671740 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-console-config\") pod \"ca348576-2098-4a41-9094-a4b19829eaa6\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " Jun 09 13:51:01.671841 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.671781 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-trusted-ca-bundle\") pod \"ca348576-2098-4a41-9094-a4b19829eaa6\" (UID: \"ca348576-2098-4a41-9094-a4b19829eaa6\") " Jun 09 13:51:01.672023 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.671833 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ca348576-2098-4a41-9094-a4b19829eaa6" (UID: "ca348576-2098-4a41-9094-a4b19829eaa6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:51:01.672227 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.672163 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-service-ca" (OuterVolumeSpecName: "service-ca") pod "ca348576-2098-4a41-9094-a4b19829eaa6" (UID: "ca348576-2098-4a41-9094-a4b19829eaa6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:51:01.672227 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.672185 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ca348576-2098-4a41-9094-a4b19829eaa6" (UID: "ca348576-2098-4a41-9094-a4b19829eaa6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:51:01.672227 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.672176 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-console-config" (OuterVolumeSpecName: "console-config") pod "ca348576-2098-4a41-9094-a4b19829eaa6" (UID: "ca348576-2098-4a41-9094-a4b19829eaa6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:51:01.672548 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.672389 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-oauth-serving-cert\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:51:01.673791 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.673762 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca348576-2098-4a41-9094-a4b19829eaa6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ca348576-2098-4a41-9094-a4b19829eaa6" (UID: "ca348576-2098-4a41-9094-a4b19829eaa6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:51:01.673791 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.673764 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca348576-2098-4a41-9094-a4b19829eaa6-kube-api-access-jl698" (OuterVolumeSpecName: "kube-api-access-jl698") pod "ca348576-2098-4a41-9094-a4b19829eaa6" (UID: "ca348576-2098-4a41-9094-a4b19829eaa6"). InnerVolumeSpecName "kube-api-access-jl698". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:51:01.673913 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.673783 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca348576-2098-4a41-9094-a4b19829eaa6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ca348576-2098-4a41-9094-a4b19829eaa6" (UID: "ca348576-2098-4a41-9094-a4b19829eaa6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:51:01.773657 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.773627 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-trusted-ca-bundle\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:51:01.773657 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.773655 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl698\" (UniqueName: \"kubernetes.io/projected/ca348576-2098-4a41-9094-a4b19829eaa6-kube-api-access-jl698\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:51:01.773657 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.773665 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca348576-2098-4a41-9094-a4b19829eaa6-console-serving-cert\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:51:01.773875 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.773674 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca348576-2098-4a41-9094-a4b19829eaa6-console-oauth-config\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:51:01.773875 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.773682 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-service-ca\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:51:01.773875 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:01.773692 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca348576-2098-4a41-9094-a4b19829eaa6-console-config\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:51:02.343254 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:02.343213 2558 generic.go:356] "Generic (PLEG): container finished" podID="ca348576-2098-4a41-9094-a4b19829eaa6" containerID="c11b51b6096822c48783153cb897284fb0417f6b15243e43d2b029153527d297" exitCode=0 Jun 09 13:51:02.343644 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:02.343264 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6755d8cfc6-9mkxk" Jun 09 13:51:02.343644 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:02.343299 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6755d8cfc6-9mkxk" event={"ID":"ca348576-2098-4a41-9094-a4b19829eaa6","Type":"ContainerDied","Data":"c11b51b6096822c48783153cb897284fb0417f6b15243e43d2b029153527d297"} Jun 09 13:51:02.343644 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:02.343356 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6755d8cfc6-9mkxk" event={"ID":"ca348576-2098-4a41-9094-a4b19829eaa6","Type":"ContainerDied","Data":"5cd46b6ffecbb5dfa31c2877f6c09790ff3dd692bb6511758c569b2546f59525"} Jun 09 13:51:02.343644 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:02.343376 2558 scope.go:117] "RemoveContainer" containerID="c11b51b6096822c48783153cb897284fb0417f6b15243e43d2b029153527d297" Jun 09 13:51:02.353945 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:02.353922 2558 scope.go:117] "RemoveContainer" containerID="c11b51b6096822c48783153cb897284fb0417f6b15243e43d2b029153527d297" Jun 09 13:51:02.354318 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:51:02.354296 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c11b51b6096822c48783153cb897284fb0417f6b15243e43d2b029153527d297\": container with ID starting with c11b51b6096822c48783153cb897284fb0417f6b15243e43d2b029153527d297 not found: ID does not exist" containerID="c11b51b6096822c48783153cb897284fb0417f6b15243e43d2b029153527d297" Jun 09 13:51:02.354388 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:02.354328 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c11b51b6096822c48783153cb897284fb0417f6b15243e43d2b029153527d297"} err="failed to get container status \"c11b51b6096822c48783153cb897284fb0417f6b15243e43d2b029153527d297\": rpc error: code = NotFound desc = could not find container \"c11b51b6096822c48783153cb897284fb0417f6b15243e43d2b029153527d297\": container with ID starting with c11b51b6096822c48783153cb897284fb0417f6b15243e43d2b029153527d297 not found: ID does not exist" Jun 09 13:51:02.363264 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:02.363178 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6755d8cfc6-9mkxk"] Jun 09 13:51:02.364802 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:02.364784 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6755d8cfc6-9mkxk"] Jun 09 13:51:03.945143 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:03.945110 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca348576-2098-4a41-9094-a4b19829eaa6" path="/var/lib/kubelet/pods/ca348576-2098-4a41-9094-a4b19829eaa6/volumes" Jun 09 13:51:13.740239 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:13.740195 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:51:13.803668 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:13.803635 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:51:31.178133 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:31.178068 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:51:31.270076 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:31.270042 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:51:43.085709 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:43.085664 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:51:43.183586 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:43.183548 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:51:51.988563 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:51.988526 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7784c4597-trblb"] Jun 09 13:51:51.988939 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:51.988840 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca348576-2098-4a41-9094-a4b19829eaa6" containerName="console" Jun 09 13:51:51.988939 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:51.988851 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca348576-2098-4a41-9094-a4b19829eaa6" containerName="console" Jun 09 13:51:51.988939 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:51.988918 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca348576-2098-4a41-9094-a4b19829eaa6" containerName="console" Jun 09 13:51:51.991920 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:51.991902 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.084868 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.084832 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7784c4597-trblb"] Jun 09 13:51:52.101300 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.101269 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-oauth-serving-cert\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.101468 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.101325 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-console-config\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.101468 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.101410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9315e63-9f22-4984-9e57-7de0674cbc88-console-serving-cert\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.101468 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.101451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-trusted-ca-bundle\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.101630 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.101526 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-service-ca\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.101630 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.101558 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx9lg\" (UniqueName: \"kubernetes.io/projected/e9315e63-9f22-4984-9e57-7de0674cbc88-kube-api-access-mx9lg\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.101630 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.101596 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9315e63-9f22-4984-9e57-7de0674cbc88-console-oauth-config\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.143569 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.143539 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:51:52.202575 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.202535 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-oauth-serving-cert\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.202575 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.202573 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-console-config\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.202797 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.202602 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9315e63-9f22-4984-9e57-7de0674cbc88-console-serving-cert\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.202797 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.202622 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-trusted-ca-bundle\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.202797 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.202681 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-service-ca\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.202797 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.202707 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx9lg\" (UniqueName: \"kubernetes.io/projected/e9315e63-9f22-4984-9e57-7de0674cbc88-kube-api-access-mx9lg\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.202797 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.202737 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9315e63-9f22-4984-9e57-7de0674cbc88-console-oauth-config\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.203352 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.203324 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-oauth-serving-cert\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.203635 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.203420 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-console-config\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.203635 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.203420 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-service-ca\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.203801 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.203775 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-trusted-ca-bundle\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.205314 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.205295 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9315e63-9f22-4984-9e57-7de0674cbc88-console-serving-cert\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.205402 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.205372 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9315e63-9f22-4984-9e57-7de0674cbc88-console-oauth-config\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.215111 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.215091 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx9lg\" (UniqueName: \"kubernetes.io/projected/e9315e63-9f22-4984-9e57-7de0674cbc88-kube-api-access-mx9lg\") pod \"console-7784c4597-trblb\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.291296 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.291201 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:51:52.315307 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.315267 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7784c4597-trblb" Jun 09 13:51:52.468752 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.468717 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7784c4597-trblb"] Jun 09 13:51:52.475441 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:51:52.475416 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9315e63_9f22_4984_9e57_7de0674cbc88.slice/crio-15fceccb66db7a4e046aa4c4bf4b4993a379ae0a9f69da0f2951c27f49776bc8 WatchSource:0}: Error finding container 15fceccb66db7a4e046aa4c4bf4b4993a379ae0a9f69da0f2951c27f49776bc8: Status 404 returned error can't find the container with id 15fceccb66db7a4e046aa4c4bf4b4993a379ae0a9f69da0f2951c27f49776bc8 Jun 09 13:51:52.543809 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.543734 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7784c4597-trblb" event={"ID":"e9315e63-9f22-4984-9e57-7de0674cbc88","Type":"ContainerStarted","Data":"92cdbb59532201a072ffe655efd40b3f31371fd1d51e489e329f0f03447378e4"} Jun 09 13:51:52.543809 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.543792 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7784c4597-trblb" event={"ID":"e9315e63-9f22-4984-9e57-7de0674cbc88","Type":"ContainerStarted","Data":"15fceccb66db7a4e046aa4c4bf4b4993a379ae0a9f69da0f2951c27f49776bc8"} Jun 09 13:51:52.587064 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:52.587006 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7784c4597-trblb" podStartSLOduration=1.5869738629999999 podStartE2EDuration="1.586973863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:51:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:51:52.584883756 +0000 UTC m=+407.032606111" watchObservedRunningTime="2026-06-09 13:51:52.586973863 +0000 UTC m=+407.034696220" Jun 09 13:51:57.780562 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:57.780503 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:51:57.876972 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:57.876929 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:51:58.253783 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:51:58.253746 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:52:02.315407 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:02.315358 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7784c4597-trblb" Jun 09 13:52:02.315933 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:02.315450 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7784c4597-trblb" Jun 09 13:52:02.320753 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:02.320729 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7784c4597-trblb" Jun 09 13:52:02.589143 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:02.589061 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7784c4597-trblb" Jun 09 13:52:02.652502 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:02.652464 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fd47fcf88-xw2rb"] Jun 09 13:52:02.802546 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:02.802513 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:52:02.905508 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:02.905419 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:52:03.004635 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:03.004601 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:52:27.674544 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:27.674432 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6fd47fcf88-xw2rb" podUID="8f92180c-6e5f-4b04-a9d0-76229665c620" containerName="console" containerID="cri-o://e7b44e6f6ae3c7d492ab38c59b8f1e572ef83188a6cefe9df30f7ccbadb1777a" gracePeriod=15 Jun 09 13:52:27.915159 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:27.915134 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:52:28.013921 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.013889 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-service-ca\") pod \"8f92180c-6e5f-4b04-a9d0-76229665c620\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " Jun 09 13:52:28.014111 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.014028 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-oauth-serving-cert\") pod \"8f92180c-6e5f-4b04-a9d0-76229665c620\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " Jun 09 13:52:28.014111 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.014060 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-console-config\") pod \"8f92180c-6e5f-4b04-a9d0-76229665c620\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " Jun 09 13:52:28.014111 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.014091 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6zdn\" (UniqueName: \"kubernetes.io/projected/8f92180c-6e5f-4b04-a9d0-76229665c620-kube-api-access-m6zdn\") pod \"8f92180c-6e5f-4b04-a9d0-76229665c620\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " Jun 09 13:52:28.014240 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.014121 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f92180c-6e5f-4b04-a9d0-76229665c620-console-serving-cert\") pod \"8f92180c-6e5f-4b04-a9d0-76229665c620\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " Jun 09 13:52:28.014240 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.014166 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f92180c-6e5f-4b04-a9d0-76229665c620-console-oauth-config\") pod \"8f92180c-6e5f-4b04-a9d0-76229665c620\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " Jun 09 13:52:28.014240 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.014188 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-trusted-ca-bundle\") pod \"8f92180c-6e5f-4b04-a9d0-76229665c620\" (UID: \"8f92180c-6e5f-4b04-a9d0-76229665c620\") " Jun 09 13:52:28.014375 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.014338 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-service-ca" (OuterVolumeSpecName: "service-ca") pod "8f92180c-6e5f-4b04-a9d0-76229665c620" (UID: "8f92180c-6e5f-4b04-a9d0-76229665c620"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:52:28.014430 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.014421 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-service-ca\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:52:28.014560 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.014527 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8f92180c-6e5f-4b04-a9d0-76229665c620" (UID: "8f92180c-6e5f-4b04-a9d0-76229665c620"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:52:28.014692 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.014629 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-console-config" (OuterVolumeSpecName: "console-config") pod "8f92180c-6e5f-4b04-a9d0-76229665c620" (UID: "8f92180c-6e5f-4b04-a9d0-76229665c620"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:52:28.014751 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.014714 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8f92180c-6e5f-4b04-a9d0-76229665c620" (UID: "8f92180c-6e5f-4b04-a9d0-76229665c620"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:52:28.016515 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.016491 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f92180c-6e5f-4b04-a9d0-76229665c620-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8f92180c-6e5f-4b04-a9d0-76229665c620" (UID: "8f92180c-6e5f-4b04-a9d0-76229665c620"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:52:28.016515 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.016496 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f92180c-6e5f-4b04-a9d0-76229665c620-kube-api-access-m6zdn" (OuterVolumeSpecName: "kube-api-access-m6zdn") pod "8f92180c-6e5f-4b04-a9d0-76229665c620" (UID: "8f92180c-6e5f-4b04-a9d0-76229665c620"). InnerVolumeSpecName "kube-api-access-m6zdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:52:28.016626 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.016530 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f92180c-6e5f-4b04-a9d0-76229665c620-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8f92180c-6e5f-4b04-a9d0-76229665c620" (UID: "8f92180c-6e5f-4b04-a9d0-76229665c620"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:52:28.115504 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.115463 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f92180c-6e5f-4b04-a9d0-76229665c620-console-oauth-config\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:52:28.115504 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.115495 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-trusted-ca-bundle\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:52:28.115504 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.115506 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-oauth-serving-cert\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:52:28.115504 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.115516 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f92180c-6e5f-4b04-a9d0-76229665c620-console-config\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:52:28.115761 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.115524 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6zdn\" (UniqueName: \"kubernetes.io/projected/8f92180c-6e5f-4b04-a9d0-76229665c620-kube-api-access-m6zdn\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:52:28.115761 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.115533 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f92180c-6e5f-4b04-a9d0-76229665c620-console-serving-cert\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:52:28.708990 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.708949 2558 generic.go:356] "Generic (PLEG): container finished" podID="8f92180c-6e5f-4b04-a9d0-76229665c620" containerID="e7b44e6f6ae3c7d492ab38c59b8f1e572ef83188a6cefe9df30f7ccbadb1777a" exitCode=0 Jun 09 13:52:28.709481 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.709021 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd47fcf88-xw2rb" Jun 09 13:52:28.709481 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.709034 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd47fcf88-xw2rb" event={"ID":"8f92180c-6e5f-4b04-a9d0-76229665c620","Type":"ContainerDied","Data":"e7b44e6f6ae3c7d492ab38c59b8f1e572ef83188a6cefe9df30f7ccbadb1777a"} Jun 09 13:52:28.709481 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.709123 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd47fcf88-xw2rb" event={"ID":"8f92180c-6e5f-4b04-a9d0-76229665c620","Type":"ContainerDied","Data":"d4612684286b94c12cd823a0cbadc1be8521a6ade6b3708b04bc9ceb5ae0f222"} Jun 09 13:52:28.709481 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.709156 2558 scope.go:117] "RemoveContainer" containerID="e7b44e6f6ae3c7d492ab38c59b8f1e572ef83188a6cefe9df30f7ccbadb1777a" Jun 09 13:52:28.717803 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.717785 2558 scope.go:117] "RemoveContainer" containerID="e7b44e6f6ae3c7d492ab38c59b8f1e572ef83188a6cefe9df30f7ccbadb1777a" Jun 09 13:52:28.718060 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:52:28.718040 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7b44e6f6ae3c7d492ab38c59b8f1e572ef83188a6cefe9df30f7ccbadb1777a\": container with ID starting with e7b44e6f6ae3c7d492ab38c59b8f1e572ef83188a6cefe9df30f7ccbadb1777a not found: ID does not exist" containerID="e7b44e6f6ae3c7d492ab38c59b8f1e572ef83188a6cefe9df30f7ccbadb1777a" Jun 09 13:52:28.718124 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.718066 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b44e6f6ae3c7d492ab38c59b8f1e572ef83188a6cefe9df30f7ccbadb1777a"} err="failed to get container status \"e7b44e6f6ae3c7d492ab38c59b8f1e572ef83188a6cefe9df30f7ccbadb1777a\": rpc error: code = NotFound desc = could not find container \"e7b44e6f6ae3c7d492ab38c59b8f1e572ef83188a6cefe9df30f7ccbadb1777a\": container with ID starting with e7b44e6f6ae3c7d492ab38c59b8f1e572ef83188a6cefe9df30f7ccbadb1777a not found: ID does not exist" Jun 09 13:52:28.736689 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.736662 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fd47fcf88-xw2rb"] Jun 09 13:52:28.738318 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:28.738298 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fd47fcf88-xw2rb"] Jun 09 13:52:29.945306 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:29.945271 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f92180c-6e5f-4b04-a9d0-76229665c620" path="/var/lib/kubelet/pods/8f92180c-6e5f-4b04-a9d0-76229665c620/volumes" Jun 09 13:52:46.594937 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:52:46.594883 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:53:32.077567 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:53:32.077519 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:53:32.145336 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:53:32.145307 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:53:57.702860 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:53:57.702782 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:54:26.261806 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:26.261754 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:54:27.027192 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.027154 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9"] Jun 09 13:54:27.027475 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.027463 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f92180c-6e5f-4b04-a9d0-76229665c620" containerName="console" Jun 09 13:54:27.027525 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.027476 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f92180c-6e5f-4b04-a9d0-76229665c620" containerName="console" Jun 09 13:54:27.027559 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.027547 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f92180c-6e5f-4b04-a9d0-76229665c620" containerName="console" Jun 09 13:54:27.030531 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.030508 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" Jun 09 13:54:27.034060 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.034037 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6xmqb\"" Jun 09 13:54:27.034060 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.034051 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 13:54:27.034953 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.034930 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 13:54:27.054076 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.054046 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9"] Jun 09 13:54:27.129418 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.129376 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2fvr\" (UniqueName: \"kubernetes.io/projected/5483af4b-92fa-4f62-b530-41f9dfe67a87-kube-api-access-t2fvr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9\" (UID: \"5483af4b-92fa-4f62-b530-41f9dfe67a87\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" Jun 09 13:54:27.129598 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.129433 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5483af4b-92fa-4f62-b530-41f9dfe67a87-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9\" (UID: \"5483af4b-92fa-4f62-b530-41f9dfe67a87\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" Jun 09 13:54:27.129598 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.129550 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5483af4b-92fa-4f62-b530-41f9dfe67a87-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9\" (UID: \"5483af4b-92fa-4f62-b530-41f9dfe67a87\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" Jun 09 13:54:27.230434 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.230389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5483af4b-92fa-4f62-b530-41f9dfe67a87-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9\" (UID: \"5483af4b-92fa-4f62-b530-41f9dfe67a87\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" Jun 09 13:54:27.230609 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.230451 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2fvr\" (UniqueName: \"kubernetes.io/projected/5483af4b-92fa-4f62-b530-41f9dfe67a87-kube-api-access-t2fvr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9\" (UID: \"5483af4b-92fa-4f62-b530-41f9dfe67a87\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" Jun 09 13:54:27.230609 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.230484 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5483af4b-92fa-4f62-b530-41f9dfe67a87-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9\" (UID: \"5483af4b-92fa-4f62-b530-41f9dfe67a87\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" Jun 09 13:54:27.230843 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.230819 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5483af4b-92fa-4f62-b530-41f9dfe67a87-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9\" (UID: \"5483af4b-92fa-4f62-b530-41f9dfe67a87\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" Jun 09 13:54:27.230913 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.230827 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5483af4b-92fa-4f62-b530-41f9dfe67a87-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9\" (UID: \"5483af4b-92fa-4f62-b530-41f9dfe67a87\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" Jun 09 13:54:27.238444 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.238425 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2fvr\" (UniqueName: \"kubernetes.io/projected/5483af4b-92fa-4f62-b530-41f9dfe67a87-kube-api-access-t2fvr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9\" (UID: \"5483af4b-92fa-4f62-b530-41f9dfe67a87\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" Jun 09 13:54:27.339475 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.339387 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" Jun 09 13:54:27.460628 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.460595 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:54:27.469453 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:27.469351 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9"] Jun 09 13:54:27.472119 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:54:27.472077 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5483af4b_92fa_4f62_b530_41f9dfe67a87.slice/crio-8429d79d31d9ddfc77350dd53b4a665f35ec1ea03f810c56292a7b65549f0df6 WatchSource:0}: Error finding container 8429d79d31d9ddfc77350dd53b4a665f35ec1ea03f810c56292a7b65549f0df6: Status 404 returned error can't find the container with id 8429d79d31d9ddfc77350dd53b4a665f35ec1ea03f810c56292a7b65549f0df6 Jun 09 13:54:28.198634 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:28.198600 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" event={"ID":"5483af4b-92fa-4f62-b530-41f9dfe67a87","Type":"ContainerStarted","Data":"8429d79d31d9ddfc77350dd53b4a665f35ec1ea03f810c56292a7b65549f0df6"} Jun 09 13:54:28.969748 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:28.969710 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:54:35.233784 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:35.233743 2558 generic.go:356] "Generic (PLEG): container finished" podID="5483af4b-92fa-4f62-b530-41f9dfe67a87" containerID="4231053e21b341105f6d9a6b2c94735facacfc22358020b6f65a2110375c7492" exitCode=0 Jun 09 13:54:35.233784 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:35.233778 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" event={"ID":"5483af4b-92fa-4f62-b530-41f9dfe67a87","Type":"ContainerDied","Data":"4231053e21b341105f6d9a6b2c94735facacfc22358020b6f65a2110375c7492"} Jun 09 13:54:37.246109 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:37.246079 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" event={"ID":"5483af4b-92fa-4f62-b530-41f9dfe67a87","Type":"ContainerStarted","Data":"667119c437dbd952fac49a9ae5c8e07503fda60edbd08049137901e26c03b2de"} Jun 09 13:54:38.252327 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:38.252292 2558 generic.go:356] "Generic (PLEG): container finished" podID="5483af4b-92fa-4f62-b530-41f9dfe67a87" containerID="667119c437dbd952fac49a9ae5c8e07503fda60edbd08049137901e26c03b2de" exitCode=0 Jun 09 13:54:38.252779 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:38.252378 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" event={"ID":"5483af4b-92fa-4f62-b530-41f9dfe67a87","Type":"ContainerDied","Data":"667119c437dbd952fac49a9ae5c8e07503fda60edbd08049137901e26c03b2de"} Jun 09 13:54:48.299076 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:48.299038 2558 generic.go:356] "Generic (PLEG): container finished" podID="5483af4b-92fa-4f62-b530-41f9dfe67a87" containerID="b8d34112d3932ae4969724e595bd6a952bced1ae94d6adbec30380ea2456ce80" exitCode=0 Jun 09 13:54:48.299511 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:48.299131 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" event={"ID":"5483af4b-92fa-4f62-b530-41f9dfe67a87","Type":"ContainerDied","Data":"b8d34112d3932ae4969724e595bd6a952bced1ae94d6adbec30380ea2456ce80"} Jun 09 13:54:49.484545 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:49.484509 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" Jun 09 13:54:49.628100 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:49.628008 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2fvr\" (UniqueName: \"kubernetes.io/projected/5483af4b-92fa-4f62-b530-41f9dfe67a87-kube-api-access-t2fvr\") pod \"5483af4b-92fa-4f62-b530-41f9dfe67a87\" (UID: \"5483af4b-92fa-4f62-b530-41f9dfe67a87\") " Jun 09 13:54:49.628266 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:49.628109 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5483af4b-92fa-4f62-b530-41f9dfe67a87-util\") pod \"5483af4b-92fa-4f62-b530-41f9dfe67a87\" (UID: \"5483af4b-92fa-4f62-b530-41f9dfe67a87\") " Jun 09 13:54:49.628266 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:49.628169 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5483af4b-92fa-4f62-b530-41f9dfe67a87-bundle\") pod \"5483af4b-92fa-4f62-b530-41f9dfe67a87\" (UID: \"5483af4b-92fa-4f62-b530-41f9dfe67a87\") " Jun 09 13:54:49.628799 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:49.628765 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5483af4b-92fa-4f62-b530-41f9dfe67a87-bundle" (OuterVolumeSpecName: "bundle") pod "5483af4b-92fa-4f62-b530-41f9dfe67a87" (UID: "5483af4b-92fa-4f62-b530-41f9dfe67a87"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:54:49.630421 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:49.630395 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5483af4b-92fa-4f62-b530-41f9dfe67a87-kube-api-access-t2fvr" (OuterVolumeSpecName: "kube-api-access-t2fvr") pod "5483af4b-92fa-4f62-b530-41f9dfe67a87" (UID: "5483af4b-92fa-4f62-b530-41f9dfe67a87"). InnerVolumeSpecName "kube-api-access-t2fvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:54:49.632320 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:49.632295 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5483af4b-92fa-4f62-b530-41f9dfe67a87-util" (OuterVolumeSpecName: "util") pod "5483af4b-92fa-4f62-b530-41f9dfe67a87" (UID: "5483af4b-92fa-4f62-b530-41f9dfe67a87"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:54:49.729258 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:49.729219 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2fvr\" (UniqueName: \"kubernetes.io/projected/5483af4b-92fa-4f62-b530-41f9dfe67a87-kube-api-access-t2fvr\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:54:49.729258 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:49.729251 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5483af4b-92fa-4f62-b530-41f9dfe67a87-util\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:54:49.729258 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:49.729261 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5483af4b-92fa-4f62-b530-41f9dfe67a87-bundle\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:54:50.311099 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:50.311063 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" event={"ID":"5483af4b-92fa-4f62-b530-41f9dfe67a87","Type":"ContainerDied","Data":"8429d79d31d9ddfc77350dd53b4a665f35ec1ea03f810c56292a7b65549f0df6"} Jun 09 13:54:50.311335 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:50.311103 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8hm9" Jun 09 13:54:50.311335 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:50.311116 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8429d79d31d9ddfc77350dd53b4a665f35ec1ea03f810c56292a7b65549f0df6" Jun 09 13:54:53.136678 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:53.136645 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:54:54.005172 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:54.005137 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:54:55.121423 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.121383 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gxwz5"] Jun 09 13:54:55.121810 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.121692 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5483af4b-92fa-4f62-b530-41f9dfe67a87" containerName="util" Jun 09 13:54:55.121810 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.121702 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5483af4b-92fa-4f62-b530-41f9dfe67a87" containerName="util" Jun 09 13:54:55.121810 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.121716 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5483af4b-92fa-4f62-b530-41f9dfe67a87" containerName="extract" Jun 09 13:54:55.121810 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.121722 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5483af4b-92fa-4f62-b530-41f9dfe67a87" containerName="extract" Jun 09 13:54:55.121810 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.121734 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5483af4b-92fa-4f62-b530-41f9dfe67a87" containerName="pull" Jun 09 13:54:55.121810 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.121739 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5483af4b-92fa-4f62-b530-41f9dfe67a87" containerName="pull" Jun 09 13:54:55.121810 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.121795 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5483af4b-92fa-4f62-b530-41f9dfe67a87" containerName="extract" Jun 09 13:54:55.123616 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.123600 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gxwz5" Jun 09 13:54:55.127969 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.127941 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-66b62\"" Jun 09 13:54:55.128145 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.128057 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 13:54:55.129412 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.129385 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:54:55.158209 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.158179 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gxwz5"] Jun 09 13:54:55.279058 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.279020 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a2fc854-cd51-4e64-bb2a-8162c157dc34-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gxwz5\" (UID: \"1a2fc854-cd51-4e64-bb2a-8162c157dc34\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gxwz5" Jun 09 13:54:55.279058 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.279064 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wthns\" (UniqueName: \"kubernetes.io/projected/1a2fc854-cd51-4e64-bb2a-8162c157dc34-kube-api-access-wthns\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gxwz5\" (UID: \"1a2fc854-cd51-4e64-bb2a-8162c157dc34\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gxwz5" Jun 09 13:54:55.379833 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.379741 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a2fc854-cd51-4e64-bb2a-8162c157dc34-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gxwz5\" (UID: \"1a2fc854-cd51-4e64-bb2a-8162c157dc34\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gxwz5" Jun 09 13:54:55.379833 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.379777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wthns\" (UniqueName: \"kubernetes.io/projected/1a2fc854-cd51-4e64-bb2a-8162c157dc34-kube-api-access-wthns\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gxwz5\" (UID: \"1a2fc854-cd51-4e64-bb2a-8162c157dc34\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gxwz5" Jun 09 13:54:55.380158 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.380135 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a2fc854-cd51-4e64-bb2a-8162c157dc34-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gxwz5\" (UID: \"1a2fc854-cd51-4e64-bb2a-8162c157dc34\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gxwz5" Jun 09 13:54:55.390704 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.390681 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wthns\" (UniqueName: \"kubernetes.io/projected/1a2fc854-cd51-4e64-bb2a-8162c157dc34-kube-api-access-wthns\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gxwz5\" (UID: \"1a2fc854-cd51-4e64-bb2a-8162c157dc34\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gxwz5" Jun 09 13:54:55.432649 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.432624 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gxwz5" Jun 09 13:54:55.582192 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:55.582167 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gxwz5"] Jun 09 13:54:55.584628 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:54:55.584605 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a2fc854_cd51_4e64_bb2a_8162c157dc34.slice/crio-f338d91eb1728d9515528db70c139a0ca954cff1aa435b655023b9f0e3605c85 WatchSource:0}: Error finding container f338d91eb1728d9515528db70c139a0ca954cff1aa435b655023b9f0e3605c85: Status 404 returned error can't find the container with id f338d91eb1728d9515528db70c139a0ca954cff1aa435b655023b9f0e3605c85 Jun 09 13:54:56.337671 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:56.337637 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gxwz5" event={"ID":"1a2fc854-cd51-4e64-bb2a-8162c157dc34","Type":"ContainerStarted","Data":"f338d91eb1728d9515528db70c139a0ca954cff1aa435b655023b9f0e3605c85"} Jun 09 13:54:56.974606 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:56.974569 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:54:57.076414 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:57.076381 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:54:58.348700 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:58.348611 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gxwz5" event={"ID":"1a2fc854-cd51-4e64-bb2a-8162c157dc34","Type":"ContainerStarted","Data":"44d0e56a32eec623eefc196dba8d6c67b56728bc3e81788e217dadc08caf5f24"} Jun 09 13:54:58.370603 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:58.370551 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gxwz5" podStartSLOduration=0.938394764 podStartE2EDuration="3.370535375s" totalImagesPullingTime="2.432140611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:54:58.369731855 +0000 UTC m=+592.817454211" watchObservedRunningTime="2026-06-09 13:54:58.370535375 +0000 UTC m=+592.818257731" Jun 09 13:54:58.690858 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:58.690775 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:54:58.795220 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:58.795186 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:54:58.877965 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:58.877928 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf"] Jun 09 13:54:58.881822 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:58.881802 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" Jun 09 13:54:58.885086 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:58.885065 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6xmqb\"" Jun 09 13:54:58.886210 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:58.886187 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 13:54:58.886330 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:58.886310 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 13:54:58.903128 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:58.903098 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf"] Jun 09 13:54:59.010704 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:59.010662 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa5881f7-56af-4087-ac4f-e39e4e809c42-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf\" (UID: \"fa5881f7-56af-4087-ac4f-e39e4e809c42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" Jun 09 13:54:59.010704 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:59.010702 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gm7h\" (UniqueName: \"kubernetes.io/projected/fa5881f7-56af-4087-ac4f-e39e4e809c42-kube-api-access-2gm7h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf\" (UID: \"fa5881f7-56af-4087-ac4f-e39e4e809c42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" Jun 09 13:54:59.010907 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:59.010766 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa5881f7-56af-4087-ac4f-e39e4e809c42-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf\" (UID: \"fa5881f7-56af-4087-ac4f-e39e4e809c42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" Jun 09 13:54:59.061863 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:59.061825 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:54:59.112085 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:59.112043 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa5881f7-56af-4087-ac4f-e39e4e809c42-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf\" (UID: \"fa5881f7-56af-4087-ac4f-e39e4e809c42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" Jun 09 13:54:59.112256 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:59.112221 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa5881f7-56af-4087-ac4f-e39e4e809c42-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf\" (UID: \"fa5881f7-56af-4087-ac4f-e39e4e809c42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" Jun 09 13:54:59.112320 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:59.112250 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gm7h\" (UniqueName: \"kubernetes.io/projected/fa5881f7-56af-4087-ac4f-e39e4e809c42-kube-api-access-2gm7h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf\" (UID: \"fa5881f7-56af-4087-ac4f-e39e4e809c42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" Jun 09 13:54:59.112572 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:59.112548 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa5881f7-56af-4087-ac4f-e39e4e809c42-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf\" (UID: \"fa5881f7-56af-4087-ac4f-e39e4e809c42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" Jun 09 13:54:59.112678 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:59.112579 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa5881f7-56af-4087-ac4f-e39e4e809c42-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf\" (UID: \"fa5881f7-56af-4087-ac4f-e39e4e809c42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" Jun 09 13:54:59.131729 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:59.131701 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gm7h\" (UniqueName: \"kubernetes.io/projected/fa5881f7-56af-4087-ac4f-e39e4e809c42-kube-api-access-2gm7h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf\" (UID: \"fa5881f7-56af-4087-ac4f-e39e4e809c42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" Jun 09 13:54:59.191916 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:59.191882 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" Jun 09 13:54:59.265534 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:59.265447 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:54:59.333701 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:59.333677 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf"] Jun 09 13:54:59.335758 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:54:59.335733 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5881f7_56af_4087_ac4f_e39e4e809c42.slice/crio-813ad18a4c0255f75809ee41f12a454f4bb94ad50ee1b53279b44c0441543bc1 WatchSource:0}: Error finding container 813ad18a4c0255f75809ee41f12a454f4bb94ad50ee1b53279b44c0441543bc1: Status 404 returned error can't find the container with id 813ad18a4c0255f75809ee41f12a454f4bb94ad50ee1b53279b44c0441543bc1 Jun 09 13:54:59.354466 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:54:59.354438 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" event={"ID":"fa5881f7-56af-4087-ac4f-e39e4e809c42","Type":"ContainerStarted","Data":"813ad18a4c0255f75809ee41f12a454f4bb94ad50ee1b53279b44c0441543bc1"} Jun 09 13:55:00.359853 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.359813 2558 generic.go:356] "Generic (PLEG): container finished" podID="fa5881f7-56af-4087-ac4f-e39e4e809c42" containerID="cc73bd947b36d0cbfc8fb514e0a25d4929f81974fa3e6819d63ae17e8cfa6769" exitCode=0 Jun 09 13:55:00.360318 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.359906 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" event={"ID":"fa5881f7-56af-4087-ac4f-e39e4e809c42","Type":"ContainerDied","Data":"cc73bd947b36d0cbfc8fb514e0a25d4929f81974fa3e6819d63ae17e8cfa6769"} Jun 09 13:55:00.543597 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.543567 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-w29ll"] Jun 09 13:55:00.546901 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.546886 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-w29ll" Jun 09 13:55:00.549425 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.549398 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 13:55:00.549554 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.549449 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 13:55:00.549617 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.549600 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7ndps\"" Jun 09 13:55:00.556492 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.556468 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-w29ll"] Jun 09 13:55:00.726696 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.726651 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m77wn\" (UniqueName: \"kubernetes.io/projected/45b2c048-8411-4f72-b62e-079a2cb1b26f-kube-api-access-m77wn\") pod \"cert-manager-webhook-7dc76cbb94-w29ll\" (UID: \"45b2c048-8411-4f72-b62e-079a2cb1b26f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-w29ll" Jun 09 13:55:00.726857 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.726772 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45b2c048-8411-4f72-b62e-079a2cb1b26f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-w29ll\" (UID: \"45b2c048-8411-4f72-b62e-079a2cb1b26f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-w29ll" Jun 09 13:55:00.827298 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.827203 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m77wn\" (UniqueName: \"kubernetes.io/projected/45b2c048-8411-4f72-b62e-079a2cb1b26f-kube-api-access-m77wn\") pod \"cert-manager-webhook-7dc76cbb94-w29ll\" (UID: \"45b2c048-8411-4f72-b62e-079a2cb1b26f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-w29ll" Jun 09 13:55:00.827298 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.827281 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45b2c048-8411-4f72-b62e-079a2cb1b26f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-w29ll\" (UID: \"45b2c048-8411-4f72-b62e-079a2cb1b26f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-w29ll" Jun 09 13:55:00.835755 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.835716 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45b2c048-8411-4f72-b62e-079a2cb1b26f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-w29ll\" (UID: \"45b2c048-8411-4f72-b62e-079a2cb1b26f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-w29ll" Jun 09 13:55:00.835755 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.835738 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m77wn\" (UniqueName: \"kubernetes.io/projected/45b2c048-8411-4f72-b62e-079a2cb1b26f-kube-api-access-m77wn\") pod \"cert-manager-webhook-7dc76cbb94-w29ll\" (UID: \"45b2c048-8411-4f72-b62e-079a2cb1b26f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-w29ll" Jun 09 13:55:00.866883 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:00.866853 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-w29ll" Jun 09 13:55:01.010963 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:01.010901 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-w29ll"] Jun 09 13:55:01.013765 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:55:01.013731 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45b2c048_8411_4f72_b62e_079a2cb1b26f.slice/crio-173a3ccae67638dea61d51c80fb73b5d99a950d141f626b20649aff9c70bbabc WatchSource:0}: Error finding container 173a3ccae67638dea61d51c80fb73b5d99a950d141f626b20649aff9c70bbabc: Status 404 returned error can't find the container with id 173a3ccae67638dea61d51c80fb73b5d99a950d141f626b20649aff9c70bbabc Jun 09 13:55:01.365958 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:01.365926 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-w29ll" event={"ID":"45b2c048-8411-4f72-b62e-079a2cb1b26f","Type":"ContainerStarted","Data":"173a3ccae67638dea61d51c80fb73b5d99a950d141f626b20649aff9c70bbabc"} Jun 09 13:55:02.665078 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:02.665011 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:02.892672 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:02.892641 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:03.691271 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:03.691242 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:03.750460 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:03.750432 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:04.382601 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:04.382553 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-w29ll" event={"ID":"45b2c048-8411-4f72-b62e-079a2cb1b26f","Type":"ContainerStarted","Data":"cd4a030c0d5ea2dec51a9ac43e3a6583528eb5613214cabfa83ede81341815a2"} Jun 09 13:55:04.382801 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:04.382695 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-w29ll" Jun 09 13:55:04.384220 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:04.384193 2558 generic.go:356] "Generic (PLEG): container finished" podID="fa5881f7-56af-4087-ac4f-e39e4e809c42" containerID="3eb5d5c98c13b35997ff574e34c228d7488c4479c2a92cbb46bfb7d6fca875f3" exitCode=0 Jun 09 13:55:04.384363 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:04.384237 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" event={"ID":"fa5881f7-56af-4087-ac4f-e39e4e809c42","Type":"ContainerDied","Data":"3eb5d5c98c13b35997ff574e34c228d7488c4479c2a92cbb46bfb7d6fca875f3"} Jun 09 13:55:04.410798 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:04.410745 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-w29ll" podStartSLOduration=1.798253349 podStartE2EDuration="4.410727703s" totalImagesPullingTime="2.612474354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:55:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:55:04.407733221 +0000 UTC m=+598.855455576" watchObservedRunningTime="2026-06-09 13:55:04.410727703 +0000 UTC m=+598.858450060" Jun 09 13:55:05.198321 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.198283 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-bwc27"] Jun 09 13:55:05.202321 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.202304 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bwc27" Jun 09 13:55:05.205154 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.205135 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ghjtj\"" Jun 09 13:55:05.214225 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.214200 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-bwc27"] Jun 09 13:55:05.263995 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.263942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxgxj\" (UniqueName: \"kubernetes.io/projected/fab8dcde-2146-4ffb-94d2-15c294d1d757-kube-api-access-lxgxj\") pod \"cert-manager-cainjector-5d99449ffd-bwc27\" (UID: \"fab8dcde-2146-4ffb-94d2-15c294d1d757\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bwc27" Jun 09 13:55:05.264126 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.264019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fab8dcde-2146-4ffb-94d2-15c294d1d757-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-bwc27\" (UID: \"fab8dcde-2146-4ffb-94d2-15c294d1d757\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bwc27" Jun 09 13:55:05.364787 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.364749 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxgxj\" (UniqueName: \"kubernetes.io/projected/fab8dcde-2146-4ffb-94d2-15c294d1d757-kube-api-access-lxgxj\") pod \"cert-manager-cainjector-5d99449ffd-bwc27\" (UID: \"fab8dcde-2146-4ffb-94d2-15c294d1d757\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bwc27" Jun 09 13:55:05.364942 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.364799 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fab8dcde-2146-4ffb-94d2-15c294d1d757-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-bwc27\" (UID: \"fab8dcde-2146-4ffb-94d2-15c294d1d757\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bwc27" Jun 09 13:55:05.374143 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.374119 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fab8dcde-2146-4ffb-94d2-15c294d1d757-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-bwc27\" (UID: \"fab8dcde-2146-4ffb-94d2-15c294d1d757\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bwc27" Jun 09 13:55:05.374237 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.374178 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxgxj\" (UniqueName: \"kubernetes.io/projected/fab8dcde-2146-4ffb-94d2-15c294d1d757-kube-api-access-lxgxj\") pod \"cert-manager-cainjector-5d99449ffd-bwc27\" (UID: \"fab8dcde-2146-4ffb-94d2-15c294d1d757\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bwc27" Jun 09 13:55:05.391029 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.390999 2558 generic.go:356] "Generic (PLEG): container finished" podID="fa5881f7-56af-4087-ac4f-e39e4e809c42" containerID="df6ad122b0861ffc2d6f2e645960a11afcc533e746c91c1be75c082c618f4be4" exitCode=0 Jun 09 13:55:05.391155 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.391082 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" event={"ID":"fa5881f7-56af-4087-ac4f-e39e4e809c42","Type":"ContainerDied","Data":"df6ad122b0861ffc2d6f2e645960a11afcc533e746c91c1be75c082c618f4be4"} Jun 09 13:55:05.511690 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.511644 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bwc27" Jun 09 13:55:05.642213 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.642190 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-bwc27"] Jun 09 13:55:05.644222 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:55:05.644188 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfab8dcde_2146_4ffb_94d2_15c294d1d757.slice/crio-65295ed574bd5eaf92566b45985aa06ffbcfea76b3f8b9fb5dfaa2ce74cdea02 WatchSource:0}: Error finding container 65295ed574bd5eaf92566b45985aa06ffbcfea76b3f8b9fb5dfaa2ce74cdea02: Status 404 returned error can't find the container with id 65295ed574bd5eaf92566b45985aa06ffbcfea76b3f8b9fb5dfaa2ce74cdea02 Jun 09 13:55:05.926093 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.926016 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gp8mh_94fe717f-e61a-483a-bac8-be82ca3c7dc2/ovn-acl-logging/0.log" Jun 09 13:55:05.926286 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:05.926260 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gp8mh_94fe717f-e61a-483a-bac8-be82ca3c7dc2/ovn-acl-logging/0.log" Jun 09 13:55:06.397346 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:06.397308 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bwc27" event={"ID":"fab8dcde-2146-4ffb-94d2-15c294d1d757","Type":"ContainerStarted","Data":"265c8a02255c8edcf1bb87a015e09f1ca65c5714caf66821fae3921134cef91a"} Jun 09 13:55:06.399649 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:06.397356 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bwc27" event={"ID":"fab8dcde-2146-4ffb-94d2-15c294d1d757","Type":"ContainerStarted","Data":"65295ed574bd5eaf92566b45985aa06ffbcfea76b3f8b9fb5dfaa2ce74cdea02"} Jun 09 13:55:06.416221 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:06.416176 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bwc27" podStartSLOduration=1.416163471 podStartE2EDuration="1.416163471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:55:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:55:06.414529608 +0000 UTC m=+600.862251967" watchObservedRunningTime="2026-06-09 13:55:06.416163471 +0000 UTC m=+600.863885826" Jun 09 13:55:06.536679 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:06.536653 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" Jun 09 13:55:06.574842 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:06.574813 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa5881f7-56af-4087-ac4f-e39e4e809c42-bundle\") pod \"fa5881f7-56af-4087-ac4f-e39e4e809c42\" (UID: \"fa5881f7-56af-4087-ac4f-e39e4e809c42\") " Jun 09 13:55:06.574842 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:06.574846 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa5881f7-56af-4087-ac4f-e39e4e809c42-util\") pod \"fa5881f7-56af-4087-ac4f-e39e4e809c42\" (UID: \"fa5881f7-56af-4087-ac4f-e39e4e809c42\") " Jun 09 13:55:06.575073 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:06.574919 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gm7h\" (UniqueName: \"kubernetes.io/projected/fa5881f7-56af-4087-ac4f-e39e4e809c42-kube-api-access-2gm7h\") pod \"fa5881f7-56af-4087-ac4f-e39e4e809c42\" (UID: \"fa5881f7-56af-4087-ac4f-e39e4e809c42\") " Jun 09 13:55:06.575235 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:06.575212 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5881f7-56af-4087-ac4f-e39e4e809c42-bundle" (OuterVolumeSpecName: "bundle") pod "fa5881f7-56af-4087-ac4f-e39e4e809c42" (UID: "fa5881f7-56af-4087-ac4f-e39e4e809c42"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:55:06.577158 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:06.577128 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa5881f7-56af-4087-ac4f-e39e4e809c42-kube-api-access-2gm7h" (OuterVolumeSpecName: "kube-api-access-2gm7h") pod "fa5881f7-56af-4087-ac4f-e39e4e809c42" (UID: "fa5881f7-56af-4087-ac4f-e39e4e809c42"). InnerVolumeSpecName "kube-api-access-2gm7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:55:06.581610 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:06.581580 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5881f7-56af-4087-ac4f-e39e4e809c42-util" (OuterVolumeSpecName: "util") pod "fa5881f7-56af-4087-ac4f-e39e4e809c42" (UID: "fa5881f7-56af-4087-ac4f-e39e4e809c42"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:55:06.676382 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:06.676314 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gm7h\" (UniqueName: \"kubernetes.io/projected/fa5881f7-56af-4087-ac4f-e39e4e809c42-kube-api-access-2gm7h\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:55:06.676382 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:06.676341 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa5881f7-56af-4087-ac4f-e39e4e809c42-bundle\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:55:06.676382 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:06.676350 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa5881f7-56af-4087-ac4f-e39e4e809c42-util\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:55:07.403246 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:07.403211 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" event={"ID":"fa5881f7-56af-4087-ac4f-e39e4e809c42","Type":"ContainerDied","Data":"813ad18a4c0255f75809ee41f12a454f4bb94ad50ee1b53279b44c0441543bc1"} Jun 09 13:55:07.403246 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:07.403245 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqmf" Jun 09 13:55:07.403643 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:07.403261 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="813ad18a4c0255f75809ee41f12a454f4bb94ad50ee1b53279b44c0441543bc1" Jun 09 13:55:10.073294 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:10.073262 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:10.393449 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:10.393369 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-w29ll" Jun 09 13:55:12.093684 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.093647 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:12.194593 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.194558 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:12.214673 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.214638 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-2479x"] Jun 09 13:55:12.215042 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.215024 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa5881f7-56af-4087-ac4f-e39e4e809c42" containerName="extract" Jun 09 13:55:12.215134 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.215044 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa5881f7-56af-4087-ac4f-e39e4e809c42" containerName="extract" Jun 09 13:55:12.215134 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.215073 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa5881f7-56af-4087-ac4f-e39e4e809c42" containerName="pull" Jun 09 13:55:12.215134 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.215081 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa5881f7-56af-4087-ac4f-e39e4e809c42" containerName="pull" Jun 09 13:55:12.215134 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.215093 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa5881f7-56af-4087-ac4f-e39e4e809c42" containerName="util" Jun 09 13:55:12.215134 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.215102 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa5881f7-56af-4087-ac4f-e39e4e809c42" containerName="util" Jun 09 13:55:12.215367 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.215194 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa5881f7-56af-4087-ac4f-e39e4e809c42" containerName="extract" Jun 09 13:55:12.218751 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.218732 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2479x" Jun 09 13:55:12.221275 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.221257 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-b25vs\"" Jun 09 13:55:12.227159 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.227138 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2479x"] Jun 09 13:55:12.324183 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.324157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/183b679b-9349-435b-a30f-7666f062aa49-bound-sa-token\") pod \"cert-manager-59c77684cc-2479x\" (UID: \"183b679b-9349-435b-a30f-7666f062aa49\") " pod="cert-manager/cert-manager-59c77684cc-2479x" Jun 09 13:55:12.324335 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.324206 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzgm5\" (UniqueName: \"kubernetes.io/projected/183b679b-9349-435b-a30f-7666f062aa49-kube-api-access-dzgm5\") pod \"cert-manager-59c77684cc-2479x\" (UID: \"183b679b-9349-435b-a30f-7666f062aa49\") " pod="cert-manager/cert-manager-59c77684cc-2479x" Jun 09 13:55:12.425410 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.425329 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/183b679b-9349-435b-a30f-7666f062aa49-bound-sa-token\") pod \"cert-manager-59c77684cc-2479x\" (UID: \"183b679b-9349-435b-a30f-7666f062aa49\") " pod="cert-manager/cert-manager-59c77684cc-2479x" Jun 09 13:55:12.425410 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.425383 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzgm5\" (UniqueName: \"kubernetes.io/projected/183b679b-9349-435b-a30f-7666f062aa49-kube-api-access-dzgm5\") pod \"cert-manager-59c77684cc-2479x\" (UID: \"183b679b-9349-435b-a30f-7666f062aa49\") " pod="cert-manager/cert-manager-59c77684cc-2479x" Jun 09 13:55:12.443756 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.443727 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/183b679b-9349-435b-a30f-7666f062aa49-bound-sa-token\") pod \"cert-manager-59c77684cc-2479x\" (UID: \"183b679b-9349-435b-a30f-7666f062aa49\") " pod="cert-manager/cert-manager-59c77684cc-2479x" Jun 09 13:55:12.443893 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.443805 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzgm5\" (UniqueName: \"kubernetes.io/projected/183b679b-9349-435b-a30f-7666f062aa49-kube-api-access-dzgm5\") pod \"cert-manager-59c77684cc-2479x\" (UID: \"183b679b-9349-435b-a30f-7666f062aa49\") " pod="cert-manager/cert-manager-59c77684cc-2479x" Jun 09 13:55:12.528576 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.528548 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2479x" Jun 09 13:55:12.660703 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:12.660679 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2479x"] Jun 09 13:55:12.662634 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:55:12.662606 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod183b679b_9349_435b_a30f_7666f062aa49.slice/crio-95f5aad3f639035d1dd724397216cc2a12086db0c2ea6fdb6c31a679c4029616 WatchSource:0}: Error finding container 95f5aad3f639035d1dd724397216cc2a12086db0c2ea6fdb6c31a679c4029616: Status 404 returned error can't find the container with id 95f5aad3f639035d1dd724397216cc2a12086db0c2ea6fdb6c31a679c4029616 Jun 09 13:55:13.431196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:13.431160 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2479x" event={"ID":"183b679b-9349-435b-a30f-7666f062aa49","Type":"ContainerStarted","Data":"109e0dba54ef0600ad34d455e7b2afaa394de5ac7695a8dfe2d3f39623880270"} Jun 09 13:55:13.431196 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:13.431202 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2479x" event={"ID":"183b679b-9349-435b-a30f-7666f062aa49","Type":"ContainerStarted","Data":"95f5aad3f639035d1dd724397216cc2a12086db0c2ea6fdb6c31a679c4029616"} Jun 09 13:55:13.447995 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:13.447944 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-2479x" podStartSLOduration=1.447930616 podStartE2EDuration="1.447930616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:55:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:55:13.446112018 +0000 UTC m=+607.893834373" watchObservedRunningTime="2026-06-09 13:55:13.447930616 +0000 UTC m=+607.895652971" Jun 09 13:55:17.896398 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:17.896364 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:17.996618 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:17.996587 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:18.764319 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:18.764282 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:18.817341 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:18.817311 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:19.579260 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.579227 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d"] Jun 09 13:55:19.583111 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.583091 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" Jun 09 13:55:19.585593 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.585570 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 13:55:19.585706 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.585570 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 13:55:19.585706 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.585632 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6xmqb\"" Jun 09 13:55:19.592289 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.592255 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d"] Jun 09 13:55:19.691257 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.691219 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d\" (UID: \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" Jun 09 13:55:19.691436 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.691267 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d\" (UID: \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" Jun 09 13:55:19.691436 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.691343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9fst\" (UniqueName: \"kubernetes.io/projected/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-kube-api-access-v9fst\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d\" (UID: \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" Jun 09 13:55:19.792012 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.791944 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d\" (UID: \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" Jun 09 13:55:19.792206 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.792033 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9fst\" (UniqueName: \"kubernetes.io/projected/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-kube-api-access-v9fst\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d\" (UID: \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" Jun 09 13:55:19.792206 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.792114 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d\" (UID: \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" Jun 09 13:55:19.792343 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.792323 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d\" (UID: \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" Jun 09 13:55:19.792466 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.792446 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d\" (UID: \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" Jun 09 13:55:19.800729 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.800701 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9fst\" (UniqueName: \"kubernetes.io/projected/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-kube-api-access-v9fst\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d\" (UID: \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" Jun 09 13:55:19.893790 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:19.893701 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" Jun 09 13:55:20.036395 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:20.036367 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d"] Jun 09 13:55:20.038366 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:55:20.038337 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d3d2cd_94ed_4ead_bc61_b6802f3b054b.slice/crio-406efdc8f5a79bff37cbd18895363b305b42c7eb2e38cdb5b0dc7ce0feca4731 WatchSource:0}: Error finding container 406efdc8f5a79bff37cbd18895363b305b42c7eb2e38cdb5b0dc7ce0feca4731: Status 404 returned error can't find the container with id 406efdc8f5a79bff37cbd18895363b305b42c7eb2e38cdb5b0dc7ce0feca4731 Jun 09 13:55:20.466579 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:20.466541 2558 generic.go:356] "Generic (PLEG): container finished" podID="98d3d2cd-94ed-4ead-bc61-b6802f3b054b" containerID="b3f60629605e2d94e038ba5e42eeaf6d306fea1d430168a6b8be77086fe5aacc" exitCode=0 Jun 09 13:55:20.466754 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:20.466630 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" event={"ID":"98d3d2cd-94ed-4ead-bc61-b6802f3b054b","Type":"ContainerDied","Data":"b3f60629605e2d94e038ba5e42eeaf6d306fea1d430168a6b8be77086fe5aacc"} Jun 09 13:55:20.466754 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:20.466694 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" event={"ID":"98d3d2cd-94ed-4ead-bc61-b6802f3b054b","Type":"ContainerStarted","Data":"406efdc8f5a79bff37cbd18895363b305b42c7eb2e38cdb5b0dc7ce0feca4731"} Jun 09 13:55:20.484405 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:20.484374 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:20.923540 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:20.923493 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:20.978358 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:20.978325 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:21.473572 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:21.473492 2558 generic.go:356] "Generic (PLEG): container finished" podID="98d3d2cd-94ed-4ead-bc61-b6802f3b054b" containerID="7515b8a089f282d6689837b438d269b6706993304ff901c66776fc4d35e993aa" exitCode=0 Jun 09 13:55:21.473722 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:21.473582 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" event={"ID":"98d3d2cd-94ed-4ead-bc61-b6802f3b054b","Type":"ContainerDied","Data":"7515b8a089f282d6689837b438d269b6706993304ff901c66776fc4d35e993aa"} Jun 09 13:55:22.479931 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:22.479894 2558 generic.go:356] "Generic (PLEG): container finished" podID="98d3d2cd-94ed-4ead-bc61-b6802f3b054b" containerID="c0a924342b55cb09089b24d1529aa7a2ff501a673546f5d520ab6f52062bc9da" exitCode=0 Jun 09 13:55:22.480327 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:22.479994 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" event={"ID":"98d3d2cd-94ed-4ead-bc61-b6802f3b054b","Type":"ContainerDied","Data":"c0a924342b55cb09089b24d1529aa7a2ff501a673546f5d520ab6f52062bc9da"} Jun 09 13:55:23.614191 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:23.614167 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" Jun 09 13:55:23.726455 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:23.726376 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-util\") pod \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\" (UID: \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\") " Jun 09 13:55:23.726597 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:23.726476 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9fst\" (UniqueName: \"kubernetes.io/projected/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-kube-api-access-v9fst\") pod \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\" (UID: \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\") " Jun 09 13:55:23.726597 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:23.726511 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-bundle\") pod \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\" (UID: \"98d3d2cd-94ed-4ead-bc61-b6802f3b054b\") " Jun 09 13:55:23.727275 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:23.727239 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-bundle" (OuterVolumeSpecName: "bundle") pod "98d3d2cd-94ed-4ead-bc61-b6802f3b054b" (UID: "98d3d2cd-94ed-4ead-bc61-b6802f3b054b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:55:23.728646 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:23.728624 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-kube-api-access-v9fst" (OuterVolumeSpecName: "kube-api-access-v9fst") pod "98d3d2cd-94ed-4ead-bc61-b6802f3b054b" (UID: "98d3d2cd-94ed-4ead-bc61-b6802f3b054b"). InnerVolumeSpecName "kube-api-access-v9fst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:55:23.732015 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:23.731975 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-util" (OuterVolumeSpecName: "util") pod "98d3d2cd-94ed-4ead-bc61-b6802f3b054b" (UID: "98d3d2cd-94ed-4ead-bc61-b6802f3b054b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:55:23.827587 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:23.827502 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9fst\" (UniqueName: \"kubernetes.io/projected/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-kube-api-access-v9fst\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:55:23.827587 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:23.827532 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-bundle\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:55:23.827587 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:23.827541 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98d3d2cd-94ed-4ead-bc61-b6802f3b054b-util\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:55:24.493153 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:24.493121 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" Jun 09 13:55:24.493302 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:24.493125 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7g92d" event={"ID":"98d3d2cd-94ed-4ead-bc61-b6802f3b054b","Type":"ContainerDied","Data":"406efdc8f5a79bff37cbd18895363b305b42c7eb2e38cdb5b0dc7ce0feca4731"} Jun 09 13:55:24.493302 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:24.493246 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="406efdc8f5a79bff37cbd18895363b305b42c7eb2e38cdb5b0dc7ce0feca4731" Jun 09 13:55:33.104635 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:33.104592 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:33.210490 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:33.210452 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:33.477276 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:33.477163 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:33.582563 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:33.582526 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:33.946593 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:33.946557 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:34.141883 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.141836 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:34.240406 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.240342 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:34.290300 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.290265 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch"] Jun 09 13:55:34.290773 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.290751 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d3d2cd-94ed-4ead-bc61-b6802f3b054b" containerName="extract" Jun 09 13:55:34.290773 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.290775 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d3d2cd-94ed-4ead-bc61-b6802f3b054b" containerName="extract" Jun 09 13:55:34.290907 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.290799 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d3d2cd-94ed-4ead-bc61-b6802f3b054b" containerName="util" Jun 09 13:55:34.290907 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.290808 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d3d2cd-94ed-4ead-bc61-b6802f3b054b" containerName="util" Jun 09 13:55:34.290907 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.290817 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d3d2cd-94ed-4ead-bc61-b6802f3b054b" containerName="pull" Jun 09 13:55:34.290907 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.290825 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d3d2cd-94ed-4ead-bc61-b6802f3b054b" containerName="pull" Jun 09 13:55:34.291067 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.290910 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d3d2cd-94ed-4ead-bc61-b6802f3b054b" containerName="extract" Jun 09 13:55:34.293271 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.293245 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.297037 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.297013 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 13:55:34.297155 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.297042 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m2hn6\"" Jun 09 13:55:34.297232 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.297160 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 13:55:34.297232 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.297214 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 13:55:34.297369 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.297250 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 13:55:34.315711 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.315686 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch"] Jun 09 13:55:34.414715 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.414678 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:34.434220 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.434180 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.434371 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.434241 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-tmp\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.434371 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.434303 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-manifests\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.434371 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.434344 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjcxs\" (UniqueName: \"kubernetes.io/projected/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-kube-api-access-kjcxs\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.434503 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.434406 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-webhook-cert\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.511474 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.511391 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:34.535125 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.535087 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.535276 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.535165 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-tmp\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.535276 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.535205 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-manifests\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.535276 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.535229 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjcxs\" (UniqueName: \"kubernetes.io/projected/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-kube-api-access-kjcxs\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.535439 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.535281 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-webhook-cert\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.535677 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.535650 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-manifests\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.537619 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.537590 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-tmp\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.537792 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.537764 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.537856 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.537834 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-webhook-cert\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.544467 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.544446 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjcxs\" (UniqueName: \"kubernetes.io/projected/ac446fd7-d6e3-4c90-ba24-c7bfac040e85-kube-api-access-kjcxs\") pod \"opendatahub-operator-controller-manager-7877c79489-zgnch\" (UID: \"ac446fd7-d6e3-4c90-ba24-c7bfac040e85\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.604273 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.604238 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:34.612296 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.612269 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:34.748762 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.748727 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:34.773114 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.773091 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch"] Jun 09 13:55:34.775285 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:55:34.775253 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac446fd7_d6e3_4c90_ba24_c7bfac040e85.slice/crio-3bca9abce0d295d9aaf1c027fbb5f56dcf8ba2ea2eb54b2669372c69fb2ab328 WatchSource:0}: Error finding container 3bca9abce0d295d9aaf1c027fbb5f56dcf8ba2ea2eb54b2669372c69fb2ab328: Status 404 returned error can't find the container with id 3bca9abce0d295d9aaf1c027fbb5f56dcf8ba2ea2eb54b2669372c69fb2ab328 Jun 09 13:55:34.777153 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.777132 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 13:55:34.831858 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.831817 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:34.932475 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:34.932438 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:35.553862 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:35.553801 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" event={"ID":"ac446fd7-d6e3-4c90-ba24-c7bfac040e85","Type":"ContainerStarted","Data":"3bca9abce0d295d9aaf1c027fbb5f56dcf8ba2ea2eb54b2669372c69fb2ab328"} Jun 09 13:55:38.571750 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:38.571712 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" event={"ID":"ac446fd7-d6e3-4c90-ba24-c7bfac040e85","Type":"ContainerStarted","Data":"fb8048b59af2e0d4fb9e841c3126462cea83614c6f7d3f383b9325a496a4034d"} Jun 09 13:55:38.780026 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:38.779962 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:38.884714 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:38.884608 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:39.577683 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:39.577646 2558 generic.go:356] "Generic (PLEG): container finished" podID="ac446fd7-d6e3-4c90-ba24-c7bfac040e85" containerID="fb8048b59af2e0d4fb9e841c3126462cea83614c6f7d3f383b9325a496a4034d" exitCode=0 Jun 09 13:55:39.578108 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:39.577727 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" event={"ID":"ac446fd7-d6e3-4c90-ba24-c7bfac040e85","Type":"ContainerDied","Data":"fb8048b59af2e0d4fb9e841c3126462cea83614c6f7d3f383b9325a496a4034d"} Jun 09 13:55:40.584498 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:40.584456 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" event={"ID":"ac446fd7-d6e3-4c90-ba24-c7bfac040e85","Type":"ContainerStarted","Data":"cea391dafbd1290044f9d9cf4a12ed10a2c0ca20b88b3fade1a9379e38142982"} Jun 09 13:55:40.584878 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:40.584550 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:40.607478 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:40.607408 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" podStartSLOduration=2.324819664 podStartE2EDuration="6.607387491s" totalImagesPullingTime="3.269881693s" totalInitContainerRuntime="1.012686134s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:55:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:55:40.60548769 +0000 UTC m=+635.053210071" watchObservedRunningTime="2026-06-09 13:55:40.607387491 +0000 UTC m=+635.055109848" Jun 09 13:55:45.233474 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:45.233430 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:45.332805 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:45.332769 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:51.592364 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:51.592323 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zgnch" Jun 09 13:55:53.437354 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.437322 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:53.585539 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.585502 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:53.609473 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.609438 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl"] Jun 09 13:55:53.619217 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.619191 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:53.623025 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.623002 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 13:55:53.623622 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.623599 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 13:55:53.623720 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.623621 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-s9mkj\"" Jun 09 13:55:53.626819 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.626802 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:55:53.626954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.626831 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 13:55:53.626954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.626919 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 13:55:53.640760 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.640737 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl"] Jun 09 13:55:53.700893 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.700801 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41ee16e5-3335-4461-95b2-da4c1fb74828-cert\") pod \"lws-controller-manager-7d545c9fcc-j49wl\" (UID: \"41ee16e5-3335-4461-95b2-da4c1fb74828\") " pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:53.700893 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.700839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/41ee16e5-3335-4461-95b2-da4c1fb74828-manager-config\") pod \"lws-controller-manager-7d545c9fcc-j49wl\" (UID: \"41ee16e5-3335-4461-95b2-da4c1fb74828\") " pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:53.700893 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.700879 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/41ee16e5-3335-4461-95b2-da4c1fb74828-metrics-cert\") pod \"lws-controller-manager-7d545c9fcc-j49wl\" (UID: \"41ee16e5-3335-4461-95b2-da4c1fb74828\") " pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:53.701144 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.700955 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95dkb\" (UniqueName: \"kubernetes.io/projected/41ee16e5-3335-4461-95b2-da4c1fb74828-kube-api-access-95dkb\") pod \"lws-controller-manager-7d545c9fcc-j49wl\" (UID: \"41ee16e5-3335-4461-95b2-da4c1fb74828\") " pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:53.801440 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.801400 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41ee16e5-3335-4461-95b2-da4c1fb74828-cert\") pod \"lws-controller-manager-7d545c9fcc-j49wl\" (UID: \"41ee16e5-3335-4461-95b2-da4c1fb74828\") " pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:53.801440 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.801445 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/41ee16e5-3335-4461-95b2-da4c1fb74828-manager-config\") pod \"lws-controller-manager-7d545c9fcc-j49wl\" (UID: \"41ee16e5-3335-4461-95b2-da4c1fb74828\") " pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:53.801646 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.801627 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/41ee16e5-3335-4461-95b2-da4c1fb74828-metrics-cert\") pod \"lws-controller-manager-7d545c9fcc-j49wl\" (UID: \"41ee16e5-3335-4461-95b2-da4c1fb74828\") " pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:53.801727 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.801710 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95dkb\" (UniqueName: \"kubernetes.io/projected/41ee16e5-3335-4461-95b2-da4c1fb74828-kube-api-access-95dkb\") pod \"lws-controller-manager-7d545c9fcc-j49wl\" (UID: \"41ee16e5-3335-4461-95b2-da4c1fb74828\") " pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:53.802236 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.802208 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/41ee16e5-3335-4461-95b2-da4c1fb74828-manager-config\") pod \"lws-controller-manager-7d545c9fcc-j49wl\" (UID: \"41ee16e5-3335-4461-95b2-da4c1fb74828\") " pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:53.804218 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.804189 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41ee16e5-3335-4461-95b2-da4c1fb74828-cert\") pod \"lws-controller-manager-7d545c9fcc-j49wl\" (UID: \"41ee16e5-3335-4461-95b2-da4c1fb74828\") " pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:53.804357 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.804307 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/41ee16e5-3335-4461-95b2-da4c1fb74828-metrics-cert\") pod \"lws-controller-manager-7d545c9fcc-j49wl\" (UID: \"41ee16e5-3335-4461-95b2-da4c1fb74828\") " pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:53.826704 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.826680 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95dkb\" (UniqueName: \"kubernetes.io/projected/41ee16e5-3335-4461-95b2-da4c1fb74828-kube-api-access-95dkb\") pod \"lws-controller-manager-7d545c9fcc-j49wl\" (UID: \"41ee16e5-3335-4461-95b2-da4c1fb74828\") " pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:53.928464 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:53.928429 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:54.100109 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:54.100085 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl"] Jun 09 13:55:54.102411 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:55:54.102383 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ee16e5_3335_4461_95b2_da4c1fb74828.slice/crio-c2526ca91258e4a2dc8a5faedc090961d3eea8febeeaf181d00e18233efeed61 WatchSource:0}: Error finding container c2526ca91258e4a2dc8a5faedc090961d3eea8febeeaf181d00e18233efeed61: Status 404 returned error can't find the container with id c2526ca91258e4a2dc8a5faedc090961d3eea8febeeaf181d00e18233efeed61 Jun 09 13:55:54.452464 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:54.452429 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:54.651890 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:54.651852 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:54.654794 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:54.654764 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" event={"ID":"41ee16e5-3335-4461-95b2-da4c1fb74828","Type":"ContainerStarted","Data":"c2526ca91258e4a2dc8a5faedc090961d3eea8febeeaf181d00e18233efeed61"} Jun 09 13:55:54.734544 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:54.734502 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:55.135855 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:55.135738 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:55.562824 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:55.562791 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:57.678416 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:57.678375 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" event={"ID":"41ee16e5-3335-4461-95b2-da4c1fb74828","Type":"ContainerStarted","Data":"d1ce6b5c7e5e9567f25d801ae677e1de3a121e1bc2ff85391c815f306dd7b579"} Jun 09 13:55:57.678797 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:57.678500 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:55:57.700823 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:57.700758 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" podStartSLOduration=2.198304008 podStartE2EDuration="4.700743095s" totalImagesPullingTime="2.502439087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:55:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:55:57.698705887 +0000 UTC m=+652.146428243" watchObservedRunningTime="2026-06-09 13:55:57.700743095 +0000 UTC m=+652.148465450" Jun 09 13:55:59.243901 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:59.243863 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:59.351665 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:59.351633 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:55:59.547223 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:55:59.547134 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:01.133061 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.133010 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28"] Jun 09 13:56:01.136902 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.136884 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" Jun 09 13:56:01.141700 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.141680 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6xmqb\"" Jun 09 13:56:01.141839 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.141680 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 13:56:01.142773 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.142755 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 13:56:01.161285 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.161256 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28"] Jun 09 13:56:01.170994 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.170951 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdxlp\" (UniqueName: \"kubernetes.io/projected/369eaf5d-d19b-46a9-b86e-f89127376d2c-kube-api-access-fdxlp\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28\" (UID: \"369eaf5d-d19b-46a9-b86e-f89127376d2c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" Jun 09 13:56:01.171136 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.171031 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/369eaf5d-d19b-46a9-b86e-f89127376d2c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28\" (UID: \"369eaf5d-d19b-46a9-b86e-f89127376d2c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" Jun 09 13:56:01.171136 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.171095 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/369eaf5d-d19b-46a9-b86e-f89127376d2c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28\" (UID: \"369eaf5d-d19b-46a9-b86e-f89127376d2c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" Jun 09 13:56:01.272135 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.272098 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdxlp\" (UniqueName: \"kubernetes.io/projected/369eaf5d-d19b-46a9-b86e-f89127376d2c-kube-api-access-fdxlp\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28\" (UID: \"369eaf5d-d19b-46a9-b86e-f89127376d2c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" Jun 09 13:56:01.272351 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.272153 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/369eaf5d-d19b-46a9-b86e-f89127376d2c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28\" (UID: \"369eaf5d-d19b-46a9-b86e-f89127376d2c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" Jun 09 13:56:01.272351 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.272200 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/369eaf5d-d19b-46a9-b86e-f89127376d2c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28\" (UID: \"369eaf5d-d19b-46a9-b86e-f89127376d2c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" Jun 09 13:56:01.272580 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.272556 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/369eaf5d-d19b-46a9-b86e-f89127376d2c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28\" (UID: \"369eaf5d-d19b-46a9-b86e-f89127376d2c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" Jun 09 13:56:01.272649 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.272591 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/369eaf5d-d19b-46a9-b86e-f89127376d2c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28\" (UID: \"369eaf5d-d19b-46a9-b86e-f89127376d2c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" Jun 09 13:56:01.290332 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.290292 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdxlp\" (UniqueName: \"kubernetes.io/projected/369eaf5d-d19b-46a9-b86e-f89127376d2c-kube-api-access-fdxlp\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28\" (UID: \"369eaf5d-d19b-46a9-b86e-f89127376d2c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" Jun 09 13:56:01.445865 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.445762 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" Jun 09 13:56:01.587230 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.587201 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28"] Jun 09 13:56:01.589020 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:56:01.588972 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod369eaf5d_d19b_46a9_b86e_f89127376d2c.slice/crio-aba7e551032955ee011ac3846a2c57c0f83621022c29b9049e30a12186e3f296 WatchSource:0}: Error finding container aba7e551032955ee011ac3846a2c57c0f83621022c29b9049e30a12186e3f296: Status 404 returned error can't find the container with id aba7e551032955ee011ac3846a2c57c0f83621022c29b9049e30a12186e3f296 Jun 09 13:56:01.698963 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.698876 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" event={"ID":"369eaf5d-d19b-46a9-b86e-f89127376d2c","Type":"ContainerStarted","Data":"c4d2bd6f01b10c2327238d8c196b1d62e7e3ad6dafa8c195a85219bc15ff5933"} Jun 09 13:56:01.698963 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:01.698934 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" event={"ID":"369eaf5d-d19b-46a9-b86e-f89127376d2c","Type":"ContainerStarted","Data":"aba7e551032955ee011ac3846a2c57c0f83621022c29b9049e30a12186e3f296"} Jun 09 13:56:02.705880 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:02.705782 2558 generic.go:356] "Generic (PLEG): container finished" podID="369eaf5d-d19b-46a9-b86e-f89127376d2c" containerID="c4d2bd6f01b10c2327238d8c196b1d62e7e3ad6dafa8c195a85219bc15ff5933" exitCode=0 Jun 09 13:56:02.706360 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:02.705876 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" event={"ID":"369eaf5d-d19b-46a9-b86e-f89127376d2c","Type":"ContainerDied","Data":"c4d2bd6f01b10c2327238d8c196b1d62e7e3ad6dafa8c195a85219bc15ff5933"} Jun 09 13:56:04.722286 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:04.722237 2558 generic.go:356] "Generic (PLEG): container finished" podID="369eaf5d-d19b-46a9-b86e-f89127376d2c" containerID="c4347a6c4566fc74aab782591b36743bb24267754eb2fd5e0f04195120d07c94" exitCode=0 Jun 09 13:56:04.722725 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:04.722322 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" event={"ID":"369eaf5d-d19b-46a9-b86e-f89127376d2c","Type":"ContainerDied","Data":"c4347a6c4566fc74aab782591b36743bb24267754eb2fd5e0f04195120d07c94"} Jun 09 13:56:05.314433 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:05.314398 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:05.423251 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:05.423217 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:05.571349 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:05.571254 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:05.660061 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:05.660018 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:05.729901 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:05.729870 2558 generic.go:356] "Generic (PLEG): container finished" podID="369eaf5d-d19b-46a9-b86e-f89127376d2c" containerID="7ebb31522c1231b40f01382115ec0e72ab5c760d3450aef54f724d5fda8feda1" exitCode=0 Jun 09 13:56:05.730303 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:05.729938 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" event={"ID":"369eaf5d-d19b-46a9-b86e-f89127376d2c","Type":"ContainerDied","Data":"7ebb31522c1231b40f01382115ec0e72ab5c760d3450aef54f724d5fda8feda1"} Jun 09 13:56:06.651522 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:06.651483 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:06.746372 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:06.746338 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:06.882850 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:06.882809 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" Jun 09 13:56:07.024945 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:07.024905 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/369eaf5d-d19b-46a9-b86e-f89127376d2c-bundle\") pod \"369eaf5d-d19b-46a9-b86e-f89127376d2c\" (UID: \"369eaf5d-d19b-46a9-b86e-f89127376d2c\") " Jun 09 13:56:07.025169 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:07.024972 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdxlp\" (UniqueName: \"kubernetes.io/projected/369eaf5d-d19b-46a9-b86e-f89127376d2c-kube-api-access-fdxlp\") pod \"369eaf5d-d19b-46a9-b86e-f89127376d2c\" (UID: \"369eaf5d-d19b-46a9-b86e-f89127376d2c\") " Jun 09 13:56:07.025169 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:07.025024 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/369eaf5d-d19b-46a9-b86e-f89127376d2c-util\") pod \"369eaf5d-d19b-46a9-b86e-f89127376d2c\" (UID: \"369eaf5d-d19b-46a9-b86e-f89127376d2c\") " Jun 09 13:56:07.025838 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:07.025808 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/369eaf5d-d19b-46a9-b86e-f89127376d2c-bundle" (OuterVolumeSpecName: "bundle") pod "369eaf5d-d19b-46a9-b86e-f89127376d2c" (UID: "369eaf5d-d19b-46a9-b86e-f89127376d2c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:56:07.027404 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:07.027377 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/369eaf5d-d19b-46a9-b86e-f89127376d2c-kube-api-access-fdxlp" (OuterVolumeSpecName: "kube-api-access-fdxlp") pod "369eaf5d-d19b-46a9-b86e-f89127376d2c" (UID: "369eaf5d-d19b-46a9-b86e-f89127376d2c"). InnerVolumeSpecName "kube-api-access-fdxlp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:56:07.029580 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:07.029554 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/369eaf5d-d19b-46a9-b86e-f89127376d2c-util" (OuterVolumeSpecName: "util") pod "369eaf5d-d19b-46a9-b86e-f89127376d2c" (UID: "369eaf5d-d19b-46a9-b86e-f89127376d2c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:56:07.125709 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:07.125663 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/369eaf5d-d19b-46a9-b86e-f89127376d2c-bundle\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:56:07.125709 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:07.125702 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdxlp\" (UniqueName: \"kubernetes.io/projected/369eaf5d-d19b-46a9-b86e-f89127376d2c-kube-api-access-fdxlp\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:56:07.125709 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:07.125713 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/369eaf5d-d19b-46a9-b86e-f89127376d2c-util\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:56:07.741292 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:07.741257 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" event={"ID":"369eaf5d-d19b-46a9-b86e-f89127376d2c","Type":"ContainerDied","Data":"aba7e551032955ee011ac3846a2c57c0f83621022c29b9049e30a12186e3f296"} Jun 09 13:56:07.741445 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:07.741301 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlf28" Jun 09 13:56:07.741445 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:07.741307 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aba7e551032955ee011ac3846a2c57c0f83621022c29b9049e30a12186e3f296" Jun 09 13:56:08.685240 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:08.685211 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d545c9fcc-j49wl" Jun 09 13:56:19.865083 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:19.865046 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:20.018721 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:20.018679 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:21.680526 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:21.680483 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:21.837001 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:21.836959 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:22.163631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.163598 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2"] Jun 09 13:56:22.163937 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.163925 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="369eaf5d-d19b-46a9-b86e-f89127376d2c" containerName="extract" Jun 09 13:56:22.164003 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.163939 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="369eaf5d-d19b-46a9-b86e-f89127376d2c" containerName="extract" Jun 09 13:56:22.164003 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.163950 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="369eaf5d-d19b-46a9-b86e-f89127376d2c" containerName="pull" Jun 09 13:56:22.164003 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.163956 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="369eaf5d-d19b-46a9-b86e-f89127376d2c" containerName="pull" Jun 09 13:56:22.164003 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.163970 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="369eaf5d-d19b-46a9-b86e-f89127376d2c" containerName="util" Jun 09 13:56:22.164003 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.163975 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="369eaf5d-d19b-46a9-b86e-f89127376d2c" containerName="util" Jun 09 13:56:22.164161 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.164075 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="369eaf5d-d19b-46a9-b86e-f89127376d2c" containerName="extract" Jun 09 13:56:22.168474 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.168456 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" Jun 09 13:56:22.175312 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.175289 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 13:56:22.175428 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.175345 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6xmqb\"" Jun 09 13:56:22.176408 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.176385 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 13:56:22.257232 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.257199 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:22.268472 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.268442 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ffd1928-8883-4292-a7ea-d27346040e9b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2\" (UID: \"1ffd1928-8883-4292-a7ea-d27346040e9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" Jun 09 13:56:22.268639 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.268478 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ffd1928-8883-4292-a7ea-d27346040e9b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2\" (UID: \"1ffd1928-8883-4292-a7ea-d27346040e9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" Jun 09 13:56:22.268639 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.268501 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcbxm\" (UniqueName: \"kubernetes.io/projected/1ffd1928-8883-4292-a7ea-d27346040e9b-kube-api-access-qcbxm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2\" (UID: \"1ffd1928-8883-4292-a7ea-d27346040e9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" Jun 09 13:56:22.276921 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.276887 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2"] Jun 09 13:56:22.369020 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.368965 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ffd1928-8883-4292-a7ea-d27346040e9b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2\" (UID: \"1ffd1928-8883-4292-a7ea-d27346040e9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" Jun 09 13:56:22.369020 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.369026 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ffd1928-8883-4292-a7ea-d27346040e9b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2\" (UID: \"1ffd1928-8883-4292-a7ea-d27346040e9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" Jun 09 13:56:22.369225 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.369047 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcbxm\" (UniqueName: \"kubernetes.io/projected/1ffd1928-8883-4292-a7ea-d27346040e9b-kube-api-access-qcbxm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2\" (UID: \"1ffd1928-8883-4292-a7ea-d27346040e9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" Jun 09 13:56:22.369374 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.369354 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ffd1928-8883-4292-a7ea-d27346040e9b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2\" (UID: \"1ffd1928-8883-4292-a7ea-d27346040e9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" Jun 09 13:56:22.369459 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.369438 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ffd1928-8883-4292-a7ea-d27346040e9b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2\" (UID: \"1ffd1928-8883-4292-a7ea-d27346040e9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" Jun 09 13:56:22.402026 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.401964 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcbxm\" (UniqueName: \"kubernetes.io/projected/1ffd1928-8883-4292-a7ea-d27346040e9b-kube-api-access-qcbxm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2\" (UID: \"1ffd1928-8883-4292-a7ea-d27346040e9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" Jun 09 13:56:22.477767 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.477676 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" Jun 09 13:56:22.559640 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.559604 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:22.638541 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.638516 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2"] Jun 09 13:56:22.640453 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:56:22.640420 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ffd1928_8883_4292_a7ea_d27346040e9b.slice/crio-6368e04beb7c2636aa2b1bd021ee356f5f91ab7177bdd222861e7a432c698fb4 WatchSource:0}: Error finding container 6368e04beb7c2636aa2b1bd021ee356f5f91ab7177bdd222861e7a432c698fb4: Status 404 returned error can't find the container with id 6368e04beb7c2636aa2b1bd021ee356f5f91ab7177bdd222861e7a432c698fb4 Jun 09 13:56:22.827895 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.827857 2558 generic.go:356] "Generic (PLEG): container finished" podID="1ffd1928-8883-4292-a7ea-d27346040e9b" containerID="45dee46d95a0d874963b6f957c3bad606da8e8c4529ae9ebf7300d3e621f6245" exitCode=0 Jun 09 13:56:22.828292 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.827938 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" event={"ID":"1ffd1928-8883-4292-a7ea-d27346040e9b","Type":"ContainerDied","Data":"45dee46d95a0d874963b6f957c3bad606da8e8c4529ae9ebf7300d3e621f6245"} Jun 09 13:56:22.828292 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:22.828009 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" event={"ID":"1ffd1928-8883-4292-a7ea-d27346040e9b","Type":"ContainerStarted","Data":"6368e04beb7c2636aa2b1bd021ee356f5f91ab7177bdd222861e7a432c698fb4"} Jun 09 13:56:23.968153 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:23.968117 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:24.839954 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:24.839917 2558 generic.go:356] "Generic (PLEG): container finished" podID="1ffd1928-8883-4292-a7ea-d27346040e9b" containerID="8b94b08a3feffab04b3a3fe8bf4bfad92aa9ca24bbe8fcc1826066dc3daa4a36" exitCode=0 Jun 09 13:56:24.840146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:24.839966 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" event={"ID":"1ffd1928-8883-4292-a7ea-d27346040e9b","Type":"ContainerDied","Data":"8b94b08a3feffab04b3a3fe8bf4bfad92aa9ca24bbe8fcc1826066dc3daa4a36"} Jun 09 13:56:25.847254 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:25.847216 2558 generic.go:356] "Generic (PLEG): container finished" podID="1ffd1928-8883-4292-a7ea-d27346040e9b" containerID="65df7e6f5e600834003fcc0b52ab04c69f34820a5563b683707eb077bc07247e" exitCode=0 Jun 09 13:56:25.847643 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:25.847257 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" event={"ID":"1ffd1928-8883-4292-a7ea-d27346040e9b","Type":"ContainerDied","Data":"65df7e6f5e600834003fcc0b52ab04c69f34820a5563b683707eb077bc07247e"} Jun 09 13:56:26.988828 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:26.988802 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" Jun 09 13:56:27.114529 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:27.114441 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcbxm\" (UniqueName: \"kubernetes.io/projected/1ffd1928-8883-4292-a7ea-d27346040e9b-kube-api-access-qcbxm\") pod \"1ffd1928-8883-4292-a7ea-d27346040e9b\" (UID: \"1ffd1928-8883-4292-a7ea-d27346040e9b\") " Jun 09 13:56:27.114529 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:27.114497 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ffd1928-8883-4292-a7ea-d27346040e9b-util\") pod \"1ffd1928-8883-4292-a7ea-d27346040e9b\" (UID: \"1ffd1928-8883-4292-a7ea-d27346040e9b\") " Jun 09 13:56:27.114529 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:27.114514 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ffd1928-8883-4292-a7ea-d27346040e9b-bundle\") pod \"1ffd1928-8883-4292-a7ea-d27346040e9b\" (UID: \"1ffd1928-8883-4292-a7ea-d27346040e9b\") " Jun 09 13:56:27.115804 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:27.115763 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ffd1928-8883-4292-a7ea-d27346040e9b-bundle" (OuterVolumeSpecName: "bundle") pod "1ffd1928-8883-4292-a7ea-d27346040e9b" (UID: "1ffd1928-8883-4292-a7ea-d27346040e9b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:56:27.116740 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:27.116709 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ffd1928-8883-4292-a7ea-d27346040e9b-kube-api-access-qcbxm" (OuterVolumeSpecName: "kube-api-access-qcbxm") pod "1ffd1928-8883-4292-a7ea-d27346040e9b" (UID: "1ffd1928-8883-4292-a7ea-d27346040e9b"). InnerVolumeSpecName "kube-api-access-qcbxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:56:27.120440 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:27.120418 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ffd1928-8883-4292-a7ea-d27346040e9b-util" (OuterVolumeSpecName: "util") pod "1ffd1928-8883-4292-a7ea-d27346040e9b" (UID: "1ffd1928-8883-4292-a7ea-d27346040e9b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:56:27.215886 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:27.215852 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ffd1928-8883-4292-a7ea-d27346040e9b-util\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:56:27.215886 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:27.215881 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ffd1928-8883-4292-a7ea-d27346040e9b-bundle\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:56:27.215886 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:27.215891 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcbxm\" (UniqueName: \"kubernetes.io/projected/1ffd1928-8883-4292-a7ea-d27346040e9b-kube-api-access-qcbxm\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:56:27.859190 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:27.859153 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" event={"ID":"1ffd1928-8883-4292-a7ea-d27346040e9b","Type":"ContainerDied","Data":"6368e04beb7c2636aa2b1bd021ee356f5f91ab7177bdd222861e7a432c698fb4"} Jun 09 13:56:27.859371 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:27.859231 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6368e04beb7c2636aa2b1bd021ee356f5f91ab7177bdd222861e7a432c698fb4" Jun 09 13:56:27.859371 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:27.859165 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a696s2" Jun 09 13:56:29.738914 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.738860 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5f4cf5f6dc-cb5lt"] Jun 09 13:56:29.739672 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.739645 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ffd1928-8883-4292-a7ea-d27346040e9b" containerName="extract" Jun 09 13:56:29.739672 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.739674 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ffd1928-8883-4292-a7ea-d27346040e9b" containerName="extract" Jun 09 13:56:29.739902 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.739689 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ffd1928-8883-4292-a7ea-d27346040e9b" containerName="util" Jun 09 13:56:29.739902 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.739697 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ffd1928-8883-4292-a7ea-d27346040e9b" containerName="util" Jun 09 13:56:29.739902 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.739722 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ffd1928-8883-4292-a7ea-d27346040e9b" containerName="pull" Jun 09 13:56:29.739902 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.739732 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ffd1928-8883-4292-a7ea-d27346040e9b" containerName="pull" Jun 09 13:56:29.739902 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.739858 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ffd1928-8883-4292-a7ea-d27346040e9b" containerName="extract" Jun 09 13:56:29.743235 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.743210 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5f4cf5f6dc-cb5lt" Jun 09 13:56:29.745748 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.745726 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 13:56:29.745889 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.745864 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rzg4m\"" Jun 09 13:56:29.752774 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.752750 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5f4cf5f6dc-cb5lt"] Jun 09 13:56:29.781162 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.781134 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:29.837330 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.837289 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n8wq\" (UniqueName: \"kubernetes.io/projected/76f28e95-3427-404e-ae80-9673e4fe5f9d-kube-api-access-9n8wq\") pod \"dashboard-redirect-5f4cf5f6dc-cb5lt\" (UID: \"76f28e95-3427-404e-ae80-9673e4fe5f9d\") " pod="opendatahub/dashboard-redirect-5f4cf5f6dc-cb5lt" Jun 09 13:56:29.837518 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.837395 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/76f28e95-3427-404e-ae80-9673e4fe5f9d-redirect-config\") pod \"dashboard-redirect-5f4cf5f6dc-cb5lt\" (UID: \"76f28e95-3427-404e-ae80-9673e4fe5f9d\") " pod="opendatahub/dashboard-redirect-5f4cf5f6dc-cb5lt" Jun 09 13:56:29.938053 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.938010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n8wq\" (UniqueName: \"kubernetes.io/projected/76f28e95-3427-404e-ae80-9673e4fe5f9d-kube-api-access-9n8wq\") pod \"dashboard-redirect-5f4cf5f6dc-cb5lt\" (UID: \"76f28e95-3427-404e-ae80-9673e4fe5f9d\") " pod="opendatahub/dashboard-redirect-5f4cf5f6dc-cb5lt" Jun 09 13:56:29.938245 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.938085 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/76f28e95-3427-404e-ae80-9673e4fe5f9d-redirect-config\") pod \"dashboard-redirect-5f4cf5f6dc-cb5lt\" (UID: \"76f28e95-3427-404e-ae80-9673e4fe5f9d\") " pod="opendatahub/dashboard-redirect-5f4cf5f6dc-cb5lt" Jun 09 13:56:29.938769 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.938750 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/76f28e95-3427-404e-ae80-9673e4fe5f9d-redirect-config\") pod \"dashboard-redirect-5f4cf5f6dc-cb5lt\" (UID: \"76f28e95-3427-404e-ae80-9673e4fe5f9d\") " pod="opendatahub/dashboard-redirect-5f4cf5f6dc-cb5lt" Jun 09 13:56:29.948009 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:29.947952 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n8wq\" (UniqueName: \"kubernetes.io/projected/76f28e95-3427-404e-ae80-9673e4fe5f9d-kube-api-access-9n8wq\") pod \"dashboard-redirect-5f4cf5f6dc-cb5lt\" (UID: \"76f28e95-3427-404e-ae80-9673e4fe5f9d\") " pod="opendatahub/dashboard-redirect-5f4cf5f6dc-cb5lt" Jun 09 13:56:30.056476 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:30.056367 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5f4cf5f6dc-cb5lt" Jun 09 13:56:30.202092 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:30.202062 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5f4cf5f6dc-cb5lt"] Jun 09 13:56:30.204199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:56:30.204161 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f28e95_3427_404e_ae80_9673e4fe5f9d.slice/crio-4167f6e8f151333207bf8d4b6d756d7b60bbad227f99da66f9dfec2787932062 WatchSource:0}: Error finding container 4167f6e8f151333207bf8d4b6d756d7b60bbad227f99da66f9dfec2787932062: Status 404 returned error can't find the container with id 4167f6e8f151333207bf8d4b6d756d7b60bbad227f99da66f9dfec2787932062 Jun 09 13:56:30.875738 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:30.875705 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5f4cf5f6dc-cb5lt" event={"ID":"76f28e95-3427-404e-ae80-9673e4fe5f9d","Type":"ContainerStarted","Data":"4167f6e8f151333207bf8d4b6d756d7b60bbad227f99da66f9dfec2787932062"} Jun 09 13:56:31.357791 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:31.357755 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:31.462086 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:31.462045 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:32.010895 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:32.010858 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:32.888744 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:32.888700 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5f4cf5f6dc-cb5lt" event={"ID":"76f28e95-3427-404e-ae80-9673e4fe5f9d","Type":"ContainerStarted","Data":"1e1a7b3f20ac49cb9efc63f2b0f90c4939184ef70e70f2f6d6bed8c12bde2eb1"} Jun 09 13:56:32.908590 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:32.908472 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5f4cf5f6dc-cb5lt" podStartSLOduration=1.4603840049999999 podStartE2EDuration="3.90845096s" totalImagesPullingTime="2.448066955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:56:32.906668259 +0000 UTC m=+687.354390607" watchObservedRunningTime="2026-06-09 13:56:32.90845096 +0000 UTC m=+687.356173317" Jun 09 13:56:34.323781 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:34.323746 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:34.420042 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:34.420002 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:36.504182 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.504143 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:36.610429 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.610386 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:36.838580 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.838490 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl"] Jun 09 13:56:36.842693 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.842673 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.848930 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.848901 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-zspc5\"" Jun 09 13:56:36.849097 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.848943 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 13:56:36.893975 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.893936 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.894166 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.894010 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.894166 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.894081 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.894166 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.894133 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.894287 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.894162 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrzrx\" (UniqueName: \"kubernetes.io/projected/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-kube-api-access-jrzrx\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.894287 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.894215 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.894287 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.894235 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.894287 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.894278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.894459 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.894309 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.912311 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.912269 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:36.947558 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.947524 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl"] Jun 09 13:56:36.995124 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.995080 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.995124 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.995129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.995392 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.995168 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.995392 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.995206 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.995392 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.995287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.995392 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.995319 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.995392 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.995346 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrzrx\" (UniqueName: \"kubernetes.io/projected/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-kube-api-access-jrzrx\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.995658 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.995400 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.995658 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.995431 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.995658 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.995510 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.995827 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.995739 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.995827 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.995804 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.995940 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.995883 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.996273 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.996249 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.997765 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.997743 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:36.998006 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:36.997969 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:37.018807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:37.018768 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:37.019119 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:37.019095 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrzrx\" (UniqueName: \"kubernetes.io/projected/6aa33ab1-78d7-4cc5-906c-03f6131f1ec6-kube-api-access-jrzrx\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bsrxl\" (UID: \"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:37.069367 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:37.069333 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:37.155245 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:37.155149 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:37.232932 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:37.232895 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:37.298739 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:37.298709 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl"] Jun 09 13:56:37.300682 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:56:37.300653 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa33ab1_78d7_4cc5_906c_03f6131f1ec6.slice/crio-f70b5a6379032172d641b00222d56a3dd838f2ec4471dd54449caba4703a018f WatchSource:0}: Error finding container f70b5a6379032172d641b00222d56a3dd838f2ec4471dd54449caba4703a018f: Status 404 returned error can't find the container with id f70b5a6379032172d641b00222d56a3dd838f2ec4471dd54449caba4703a018f Jun 09 13:56:37.866653 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:37.866609 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:37.916626 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:37.916588 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" event={"ID":"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6","Type":"ContainerStarted","Data":"f70b5a6379032172d641b00222d56a3dd838f2ec4471dd54449caba4703a018f"} Jun 09 13:56:40.672927 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:40.672884 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 13:56:40.673225 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:40.672966 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 13:56:40.673225 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:40.673019 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 13:56:40.935613 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:40.935519 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" event={"ID":"6aa33ab1-78d7-4cc5-906c-03f6131f1ec6","Type":"ContainerStarted","Data":"11bca1fd2a2d69089e133de231d9a5c14c07edc63429dad78f02b40ec109e8e7"} Jun 09 13:56:40.967887 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:40.967826 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" podStartSLOduration=1.597910742 podStartE2EDuration="4.967804048s" totalImagesPullingTime="3.369893306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:56:40.965345734 +0000 UTC m=+695.413068090" watchObservedRunningTime="2026-06-09 13:56:40.967804048 +0000 UTC m=+695.415526403" Jun 09 13:56:41.155484 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:41.155442 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:41.160304 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:41.160277 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:41.945273 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:41.945244 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:41.945658 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:41.945318 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bsrxl" Jun 09 13:56:54.961749 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:54.961530 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:55.067518 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.067480 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:55.087037 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.086976 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s7skw"] Jun 09 13:56:55.091027 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.091001 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s7skw" Jun 09 13:56:55.093740 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.093704 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-sq2c4\"" Jun 09 13:56:55.093740 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.093729 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 13:56:55.094006 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.093729 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 13:56:55.101227 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.101196 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s7skw"] Jun 09 13:56:55.159034 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.158996 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:56:55.172263 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.172235 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5tmk\" (UniqueName: \"kubernetes.io/projected/46d8e47d-bd58-43bf-a25f-87ed5cc37a91-kube-api-access-n5tmk\") pod \"kuadrant-operator-catalog-s7skw\" (UID: \"46d8e47d-bd58-43bf-a25f-87ed5cc37a91\") " pod="kuadrant-system/kuadrant-operator-catalog-s7skw" Jun 09 13:56:55.273539 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.273502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5tmk\" (UniqueName: \"kubernetes.io/projected/46d8e47d-bd58-43bf-a25f-87ed5cc37a91-kube-api-access-n5tmk\") pod \"kuadrant-operator-catalog-s7skw\" (UID: \"46d8e47d-bd58-43bf-a25f-87ed5cc37a91\") " pod="kuadrant-system/kuadrant-operator-catalog-s7skw" Jun 09 13:56:55.282929 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.282898 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5tmk\" (UniqueName: \"kubernetes.io/projected/46d8e47d-bd58-43bf-a25f-87ed5cc37a91-kube-api-access-n5tmk\") pod \"kuadrant-operator-catalog-s7skw\" (UID: \"46d8e47d-bd58-43bf-a25f-87ed5cc37a91\") " pod="kuadrant-system/kuadrant-operator-catalog-s7skw" Jun 09 13:56:55.401651 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.401619 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s7skw" Jun 09 13:56:55.435492 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.435461 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s7skw"] Jun 09 13:56:55.538901 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.538876 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s7skw"] Jun 09 13:56:55.541045 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:56:55.541015 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d8e47d_bd58_43bf_a25f_87ed5cc37a91.slice/crio-73ddea8b6454bdecacfdbaf419882d6eb424fad8a67975ec807e22aeaed82a0f WatchSource:0}: Error finding container 73ddea8b6454bdecacfdbaf419882d6eb424fad8a67975ec807e22aeaed82a0f: Status 404 returned error can't find the container with id 73ddea8b6454bdecacfdbaf419882d6eb424fad8a67975ec807e22aeaed82a0f Jun 09 13:56:55.647040 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.647002 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bgjl6"] Jun 09 13:56:55.651455 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.651437 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bgjl6" Jun 09 13:56:55.663422 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.663388 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bgjl6"] Jun 09 13:56:55.778640 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.778599 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv4kp\" (UniqueName: \"kubernetes.io/projected/7f65958a-cdba-482b-bca8-93e80f36d383-kube-api-access-jv4kp\") pod \"kuadrant-operator-catalog-bgjl6\" (UID: \"7f65958a-cdba-482b-bca8-93e80f36d383\") " pod="kuadrant-system/kuadrant-operator-catalog-bgjl6" Jun 09 13:56:55.879623 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.879521 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv4kp\" (UniqueName: \"kubernetes.io/projected/7f65958a-cdba-482b-bca8-93e80f36d383-kube-api-access-jv4kp\") pod \"kuadrant-operator-catalog-bgjl6\" (UID: \"7f65958a-cdba-482b-bca8-93e80f36d383\") " pod="kuadrant-system/kuadrant-operator-catalog-bgjl6" Jun 09 13:56:55.889092 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.889065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv4kp\" (UniqueName: \"kubernetes.io/projected/7f65958a-cdba-482b-bca8-93e80f36d383-kube-api-access-jv4kp\") pod \"kuadrant-operator-catalog-bgjl6\" (UID: \"7f65958a-cdba-482b-bca8-93e80f36d383\") " pod="kuadrant-system/kuadrant-operator-catalog-bgjl6" Jun 09 13:56:55.969099 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:55.969065 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bgjl6" Jun 09 13:56:56.012275 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:56.012242 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s7skw" event={"ID":"46d8e47d-bd58-43bf-a25f-87ed5cc37a91","Type":"ContainerStarted","Data":"73ddea8b6454bdecacfdbaf419882d6eb424fad8a67975ec807e22aeaed82a0f"} Jun 09 13:56:56.106153 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:56.106121 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bgjl6"] Jun 09 13:56:56.107961 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:56:56.107934 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f65958a_cdba_482b_bca8_93e80f36d383.slice/crio-0258e2a12c3c424a9c05d8a15366c0aef87ea6d9795a507fec5cab36d2d196ae WatchSource:0}: Error finding container 0258e2a12c3c424a9c05d8a15366c0aef87ea6d9795a507fec5cab36d2d196ae: Status 404 returned error can't find the container with id 0258e2a12c3c424a9c05d8a15366c0aef87ea6d9795a507fec5cab36d2d196ae Jun 09 13:56:57.022143 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:57.022102 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bgjl6" event={"ID":"7f65958a-cdba-482b-bca8-93e80f36d383","Type":"ContainerStarted","Data":"0258e2a12c3c424a9c05d8a15366c0aef87ea6d9795a507fec5cab36d2d196ae"} Jun 09 13:56:59.033329 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:59.033289 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bgjl6" event={"ID":"7f65958a-cdba-482b-bca8-93e80f36d383","Type":"ContainerStarted","Data":"193d8d4a7f5031c353a8d49658ccf30a292a9658825a94e6c2c3ae5dfd08b4e9"} Jun 09 13:56:59.034793 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:59.034768 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s7skw" event={"ID":"46d8e47d-bd58-43bf-a25f-87ed5cc37a91","Type":"ContainerStarted","Data":"5c2f9ea28a4cb38a784d4e442eb6d53e07a78b03b8b749b70f7b574aae0bc82d"} Jun 09 13:56:59.034948 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:59.034869 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-s7skw" podUID="46d8e47d-bd58-43bf-a25f-87ed5cc37a91" containerName="registry-server" containerID="cri-o://5c2f9ea28a4cb38a784d4e442eb6d53e07a78b03b8b749b70f7b574aae0bc82d" gracePeriod=2 Jun 09 13:56:59.049119 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:59.049072 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bgjl6" podStartSLOduration=2.183877181 podStartE2EDuration="4.049058172s" totalImagesPullingTime="1.865180991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:56:59.04835521 +0000 UTC m=+713.496077570" watchObservedRunningTime="2026-06-09 13:56:59.049058172 +0000 UTC m=+713.496780518" Jun 09 13:56:59.064803 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:59.064751 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-s7skw" podStartSLOduration=1.635410821 podStartE2EDuration="4.064733361s" totalImagesPullingTime="2.42932254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:56:59.062449101 +0000 UTC m=+713.510171481" watchObservedRunningTime="2026-06-09 13:56:59.064733361 +0000 UTC m=+713.512455717" Jun 09 13:56:59.293293 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:59.293234 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s7skw" Jun 09 13:56:59.412877 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:59.412836 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5tmk\" (UniqueName: \"kubernetes.io/projected/46d8e47d-bd58-43bf-a25f-87ed5cc37a91-kube-api-access-n5tmk\") pod \"46d8e47d-bd58-43bf-a25f-87ed5cc37a91\" (UID: \"46d8e47d-bd58-43bf-a25f-87ed5cc37a91\") " Jun 09 13:56:59.415412 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:59.415382 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46d8e47d-bd58-43bf-a25f-87ed5cc37a91-kube-api-access-n5tmk" (OuterVolumeSpecName: "kube-api-access-n5tmk") pod "46d8e47d-bd58-43bf-a25f-87ed5cc37a91" (UID: "46d8e47d-bd58-43bf-a25f-87ed5cc37a91"). InnerVolumeSpecName "kube-api-access-n5tmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:56:59.513707 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:56:59.513670 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5tmk\" (UniqueName: \"kubernetes.io/projected/46d8e47d-bd58-43bf-a25f-87ed5cc37a91-kube-api-access-n5tmk\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:57:00.041152 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:00.041114 2558 generic.go:356] "Generic (PLEG): container finished" podID="46d8e47d-bd58-43bf-a25f-87ed5cc37a91" containerID="5c2f9ea28a4cb38a784d4e442eb6d53e07a78b03b8b749b70f7b574aae0bc82d" exitCode=0 Jun 09 13:57:00.041628 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:00.041159 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s7skw" Jun 09 13:57:00.041628 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:00.041199 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s7skw" event={"ID":"46d8e47d-bd58-43bf-a25f-87ed5cc37a91","Type":"ContainerDied","Data":"5c2f9ea28a4cb38a784d4e442eb6d53e07a78b03b8b749b70f7b574aae0bc82d"} Jun 09 13:57:00.041628 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:00.041248 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s7skw" event={"ID":"46d8e47d-bd58-43bf-a25f-87ed5cc37a91","Type":"ContainerDied","Data":"73ddea8b6454bdecacfdbaf419882d6eb424fad8a67975ec807e22aeaed82a0f"} Jun 09 13:57:00.041628 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:00.041269 2558 scope.go:117] "RemoveContainer" containerID="5c2f9ea28a4cb38a784d4e442eb6d53e07a78b03b8b749b70f7b574aae0bc82d" Jun 09 13:57:00.051122 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:00.051092 2558 scope.go:117] "RemoveContainer" containerID="5c2f9ea28a4cb38a784d4e442eb6d53e07a78b03b8b749b70f7b574aae0bc82d" Jun 09 13:57:00.051402 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:57:00.051382 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c2f9ea28a4cb38a784d4e442eb6d53e07a78b03b8b749b70f7b574aae0bc82d\": container with ID starting with 5c2f9ea28a4cb38a784d4e442eb6d53e07a78b03b8b749b70f7b574aae0bc82d not found: ID does not exist" containerID="5c2f9ea28a4cb38a784d4e442eb6d53e07a78b03b8b749b70f7b574aae0bc82d" Jun 09 13:57:00.051458 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:00.051412 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c2f9ea28a4cb38a784d4e442eb6d53e07a78b03b8b749b70f7b574aae0bc82d"} err="failed to get container status \"5c2f9ea28a4cb38a784d4e442eb6d53e07a78b03b8b749b70f7b574aae0bc82d\": rpc error: code = NotFound desc = could not find container \"5c2f9ea28a4cb38a784d4e442eb6d53e07a78b03b8b749b70f7b574aae0bc82d\": container with ID starting with 5c2f9ea28a4cb38a784d4e442eb6d53e07a78b03b8b749b70f7b574aae0bc82d not found: ID does not exist" Jun 09 13:57:00.058051 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:00.058027 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s7skw"] Jun 09 13:57:00.061292 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:00.061264 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s7skw"] Jun 09 13:57:01.945565 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:01.945529 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46d8e47d-bd58-43bf-a25f-87ed5cc37a91" path="/var/lib/kubelet/pods/46d8e47d-bd58-43bf-a25f-87ed5cc37a91/volumes" Jun 09 13:57:05.969598 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:05.969567 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-bgjl6" Jun 09 13:57:05.969965 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:05.969654 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-bgjl6" Jun 09 13:57:05.991941 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:05.991917 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-bgjl6" Jun 09 13:57:06.094840 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:06.094808 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-bgjl6" Jun 09 13:57:10.401670 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.401631 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh"] Jun 09 13:57:10.402065 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.402056 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46d8e47d-bd58-43bf-a25f-87ed5cc37a91" containerName="registry-server" Jun 09 13:57:10.402109 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.402071 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="46d8e47d-bd58-43bf-a25f-87ed5cc37a91" containerName="registry-server" Jun 09 13:57:10.402193 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.402160 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="46d8e47d-bd58-43bf-a25f-87ed5cc37a91" containerName="registry-server" Jun 09 13:57:10.411086 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.411046 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" Jun 09 13:57:10.413956 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.413932 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fkk6q\"" Jun 09 13:57:10.414667 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.414646 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh"] Jun 09 13:57:10.416327 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.416293 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh\" (UID: \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" Jun 09 13:57:10.416448 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.416349 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh\" (UID: \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" Jun 09 13:57:10.416516 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.416445 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p8dz\" (UniqueName: \"kubernetes.io/projected/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-kube-api-access-4p8dz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh\" (UID: \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" Jun 09 13:57:10.517667 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.517631 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh\" (UID: \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" Jun 09 13:57:10.517854 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.517715 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p8dz\" (UniqueName: \"kubernetes.io/projected/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-kube-api-access-4p8dz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh\" (UID: \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" Jun 09 13:57:10.517854 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.517817 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh\" (UID: \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" Jun 09 13:57:10.518149 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.518127 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh\" (UID: \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" Jun 09 13:57:10.518203 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.518145 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh\" (UID: \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" Jun 09 13:57:10.526249 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.526221 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p8dz\" (UniqueName: \"kubernetes.io/projected/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-kube-api-access-4p8dz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh\" (UID: \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" Jun 09 13:57:10.721751 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.721644 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" Jun 09 13:57:10.867774 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:10.867727 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh"] Jun 09 13:57:10.868956 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:57:10.868914 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac6da1d_7c1d_4a0a_97b6_86e93628bd5c.slice/crio-ed0bb109da2c498042c4cc502526cd9048295305580fe835aa5128b846fc1bac WatchSource:0}: Error finding container ed0bb109da2c498042c4cc502526cd9048295305580fe835aa5128b846fc1bac: Status 404 returned error can't find the container with id ed0bb109da2c498042c4cc502526cd9048295305580fe835aa5128b846fc1bac Jun 09 13:57:11.006857 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.006828 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v"] Jun 09 13:57:11.010491 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.010473 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" Jun 09 13:57:11.017739 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.017710 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v"] Jun 09 13:57:11.021040 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.021000 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v\" (UID: \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" Jun 09 13:57:11.021146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.021055 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v\" (UID: \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" Jun 09 13:57:11.021146 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.021097 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xstt\" (UniqueName: \"kubernetes.io/projected/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-kube-api-access-7xstt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v\" (UID: \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" Jun 09 13:57:11.099770 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.099733 2558 generic.go:356] "Generic (PLEG): container finished" podID="0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c" containerID="c13fda351a8c1e82ffdde8014dcf0db4c973a50008ad4b336fb9ec54212c6829" exitCode=0 Jun 09 13:57:11.099937 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.099822 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" event={"ID":"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c","Type":"ContainerDied","Data":"c13fda351a8c1e82ffdde8014dcf0db4c973a50008ad4b336fb9ec54212c6829"} Jun 09 13:57:11.099937 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.099868 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" event={"ID":"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c","Type":"ContainerStarted","Data":"ed0bb109da2c498042c4cc502526cd9048295305580fe835aa5128b846fc1bac"} Jun 09 13:57:11.121699 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.121671 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xstt\" (UniqueName: \"kubernetes.io/projected/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-kube-api-access-7xstt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v\" (UID: \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" Jun 09 13:57:11.121846 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.121741 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v\" (UID: \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" Jun 09 13:57:11.121846 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.121763 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v\" (UID: \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" Jun 09 13:57:11.122167 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.122142 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v\" (UID: \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" Jun 09 13:57:11.122167 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.122160 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v\" (UID: \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" Jun 09 13:57:11.130731 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.130709 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xstt\" (UniqueName: \"kubernetes.io/projected/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-kube-api-access-7xstt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v\" (UID: \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" Jun 09 13:57:11.361107 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.361017 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" Jun 09 13:57:11.502372 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.502345 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v"] Jun 09 13:57:11.504199 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:57:11.504175 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda10dbe76_ba51_4c4b_a1f7_f6128b91c1e0.slice/crio-fa93f97cfe2dda26dcb8cf2bd5899117432858f0db0ad7238aca49c2412d8585 WatchSource:0}: Error finding container fa93f97cfe2dda26dcb8cf2bd5899117432858f0db0ad7238aca49c2412d8585: Status 404 returned error can't find the container with id fa93f97cfe2dda26dcb8cf2bd5899117432858f0db0ad7238aca49c2412d8585 Jun 09 13:57:11.596769 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.596737 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr"] Jun 09 13:57:11.600595 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.600578 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" Jun 09 13:57:11.609575 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.609542 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr"] Jun 09 13:57:11.627957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.627930 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpvc5\" (UniqueName: \"kubernetes.io/projected/186eef70-b03c-4b7e-8676-e0e59ccdc629-kube-api-access-kpvc5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr\" (UID: \"186eef70-b03c-4b7e-8676-e0e59ccdc629\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" Jun 09 13:57:11.628095 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.627975 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/186eef70-b03c-4b7e-8676-e0e59ccdc629-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr\" (UID: \"186eef70-b03c-4b7e-8676-e0e59ccdc629\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" Jun 09 13:57:11.628095 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.628065 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/186eef70-b03c-4b7e-8676-e0e59ccdc629-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr\" (UID: \"186eef70-b03c-4b7e-8676-e0e59ccdc629\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" Jun 09 13:57:11.729391 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.729353 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/186eef70-b03c-4b7e-8676-e0e59ccdc629-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr\" (UID: \"186eef70-b03c-4b7e-8676-e0e59ccdc629\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" Jun 09 13:57:11.729536 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.729439 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpvc5\" (UniqueName: \"kubernetes.io/projected/186eef70-b03c-4b7e-8676-e0e59ccdc629-kube-api-access-kpvc5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr\" (UID: \"186eef70-b03c-4b7e-8676-e0e59ccdc629\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" Jun 09 13:57:11.729536 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.729466 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/186eef70-b03c-4b7e-8676-e0e59ccdc629-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr\" (UID: \"186eef70-b03c-4b7e-8676-e0e59ccdc629\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" Jun 09 13:57:11.729828 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.729775 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/186eef70-b03c-4b7e-8676-e0e59ccdc629-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr\" (UID: \"186eef70-b03c-4b7e-8676-e0e59ccdc629\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" Jun 09 13:57:11.729828 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.729762 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/186eef70-b03c-4b7e-8676-e0e59ccdc629-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr\" (UID: \"186eef70-b03c-4b7e-8676-e0e59ccdc629\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" Jun 09 13:57:11.739521 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.739484 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpvc5\" (UniqueName: \"kubernetes.io/projected/186eef70-b03c-4b7e-8676-e0e59ccdc629-kube-api-access-kpvc5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr\" (UID: \"186eef70-b03c-4b7e-8676-e0e59ccdc629\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" Jun 09 13:57:11.910850 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.910776 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" Jun 09 13:57:11.996606 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:11.996576 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw"] Jun 09 13:57:12.000356 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.000335 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" Jun 09 13:57:12.008826 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.008731 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw"] Jun 09 13:57:12.033364 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.033037 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f066217-5758-41e5-8cd2-b7db3d329dd7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw\" (UID: \"4f066217-5758-41e5-8cd2-b7db3d329dd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" Jun 09 13:57:12.033364 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.033250 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f066217-5758-41e5-8cd2-b7db3d329dd7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw\" (UID: \"4f066217-5758-41e5-8cd2-b7db3d329dd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" Jun 09 13:57:12.033364 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.033278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzflp\" (UniqueName: \"kubernetes.io/projected/4f066217-5758-41e5-8cd2-b7db3d329dd7-kube-api-access-nzflp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw\" (UID: \"4f066217-5758-41e5-8cd2-b7db3d329dd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" Jun 09 13:57:12.069026 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.069001 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr"] Jun 09 13:57:12.071951 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:57:12.071926 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186eef70_b03c_4b7e_8676_e0e59ccdc629.slice/crio-6689bd0d1ecf2d3cb3b3ac906eff01939b5583d8be286c5ba516a13aea645265 WatchSource:0}: Error finding container 6689bd0d1ecf2d3cb3b3ac906eff01939b5583d8be286c5ba516a13aea645265: Status 404 returned error can't find the container with id 6689bd0d1ecf2d3cb3b3ac906eff01939b5583d8be286c5ba516a13aea645265 Jun 09 13:57:12.108147 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.108118 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" event={"ID":"186eef70-b03c-4b7e-8676-e0e59ccdc629","Type":"ContainerStarted","Data":"6689bd0d1ecf2d3cb3b3ac906eff01939b5583d8be286c5ba516a13aea645265"} Jun 09 13:57:12.110324 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.110293 2558 generic.go:356] "Generic (PLEG): container finished" podID="0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c" containerID="c5bbe2224feac4488138f51f89254326e822ebec2db0972037f84db38b311a94" exitCode=0 Jun 09 13:57:12.110420 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.110375 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" event={"ID":"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c","Type":"ContainerDied","Data":"c5bbe2224feac4488138f51f89254326e822ebec2db0972037f84db38b311a94"} Jun 09 13:57:12.112450 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.112431 2558 generic.go:356] "Generic (PLEG): container finished" podID="a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0" containerID="8fb749a389077329d20ba5b2530c57765d210a16aab67f08e7157498c098c6dd" exitCode=0 Jun 09 13:57:12.112544 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.112512 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" event={"ID":"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0","Type":"ContainerDied","Data":"8fb749a389077329d20ba5b2530c57765d210a16aab67f08e7157498c098c6dd"} Jun 09 13:57:12.112595 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.112555 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" event={"ID":"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0","Type":"ContainerStarted","Data":"fa93f97cfe2dda26dcb8cf2bd5899117432858f0db0ad7238aca49c2412d8585"} Jun 09 13:57:12.133950 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.133922 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f066217-5758-41e5-8cd2-b7db3d329dd7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw\" (UID: \"4f066217-5758-41e5-8cd2-b7db3d329dd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" Jun 09 13:57:12.134122 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.134033 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f066217-5758-41e5-8cd2-b7db3d329dd7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw\" (UID: \"4f066217-5758-41e5-8cd2-b7db3d329dd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" Jun 09 13:57:12.134122 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.134063 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzflp\" (UniqueName: \"kubernetes.io/projected/4f066217-5758-41e5-8cd2-b7db3d329dd7-kube-api-access-nzflp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw\" (UID: \"4f066217-5758-41e5-8cd2-b7db3d329dd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" Jun 09 13:57:12.134355 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.134328 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f066217-5758-41e5-8cd2-b7db3d329dd7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw\" (UID: \"4f066217-5758-41e5-8cd2-b7db3d329dd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" Jun 09 13:57:12.134355 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.134347 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f066217-5758-41e5-8cd2-b7db3d329dd7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw\" (UID: \"4f066217-5758-41e5-8cd2-b7db3d329dd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" Jun 09 13:57:12.148402 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.148375 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzflp\" (UniqueName: \"kubernetes.io/projected/4f066217-5758-41e5-8cd2-b7db3d329dd7-kube-api-access-nzflp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw\" (UID: \"4f066217-5758-41e5-8cd2-b7db3d329dd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" Jun 09 13:57:12.314733 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.314696 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" Jun 09 13:57:12.453607 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:12.453581 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw"] Jun 09 13:57:12.456400 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:57:12.456365 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f066217_5758_41e5_8cd2_b7db3d329dd7.slice/crio-887e78d52b3ea7e7c720140b2da5747ff905eccb13163bc92b3dd62e676e7952 WatchSource:0}: Error finding container 887e78d52b3ea7e7c720140b2da5747ff905eccb13163bc92b3dd62e676e7952: Status 404 returned error can't find the container with id 887e78d52b3ea7e7c720140b2da5747ff905eccb13163bc92b3dd62e676e7952 Jun 09 13:57:13.119256 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:13.119224 2558 generic.go:356] "Generic (PLEG): container finished" podID="a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0" containerID="4be6c10f6b6749cc2d7c6c2b1899fc371df7197ec32d0fbe0eb3407a70e3b440" exitCode=0 Jun 09 13:57:13.119601 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:13.119272 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" event={"ID":"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0","Type":"ContainerDied","Data":"4be6c10f6b6749cc2d7c6c2b1899fc371df7197ec32d0fbe0eb3407a70e3b440"} Jun 09 13:57:13.121119 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:13.121095 2558 generic.go:356] "Generic (PLEG): container finished" podID="186eef70-b03c-4b7e-8676-e0e59ccdc629" containerID="22627403aaa05633e2f2d358d6daf5c3e3e66a03c33c7626fd225ad9ab7d12e3" exitCode=0 Jun 09 13:57:13.121235 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:13.121187 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" event={"ID":"186eef70-b03c-4b7e-8676-e0e59ccdc629","Type":"ContainerDied","Data":"22627403aaa05633e2f2d358d6daf5c3e3e66a03c33c7626fd225ad9ab7d12e3"} Jun 09 13:57:13.123816 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:13.123782 2558 generic.go:356] "Generic (PLEG): container finished" podID="0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c" containerID="30fb487a7f1a45086b26937e02bf3d4580a00b782f2f0708550d830aa19fa413" exitCode=0 Jun 09 13:57:13.123890 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:13.123810 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" event={"ID":"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c","Type":"ContainerDied","Data":"30fb487a7f1a45086b26937e02bf3d4580a00b782f2f0708550d830aa19fa413"} Jun 09 13:57:13.125758 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:13.125737 2558 generic.go:356] "Generic (PLEG): container finished" podID="4f066217-5758-41e5-8cd2-b7db3d329dd7" containerID="a15d0eecf86ef0a29ebe4f94d3d7a5b80639af6f529f3b64877e99dcc04181ed" exitCode=0 Jun 09 13:57:13.125854 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:13.125817 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" event={"ID":"4f066217-5758-41e5-8cd2-b7db3d329dd7","Type":"ContainerDied","Data":"a15d0eecf86ef0a29ebe4f94d3d7a5b80639af6f529f3b64877e99dcc04181ed"} Jun 09 13:57:13.125933 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:13.125912 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" event={"ID":"4f066217-5758-41e5-8cd2-b7db3d329dd7","Type":"ContainerStarted","Data":"887e78d52b3ea7e7c720140b2da5747ff905eccb13163bc92b3dd62e676e7952"} Jun 09 13:57:14.136261 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.136166 2558 generic.go:356] "Generic (PLEG): container finished" podID="186eef70-b03c-4b7e-8676-e0e59ccdc629" containerID="441667e9190122c41f33bae4edb6e17e39f2546562237032f16e203d4615aab5" exitCode=0 Jun 09 13:57:14.136261 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.136213 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" event={"ID":"186eef70-b03c-4b7e-8676-e0e59ccdc629","Type":"ContainerDied","Data":"441667e9190122c41f33bae4edb6e17e39f2546562237032f16e203d4615aab5"} Jun 09 13:57:14.138114 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.138094 2558 generic.go:356] "Generic (PLEG): container finished" podID="4f066217-5758-41e5-8cd2-b7db3d329dd7" containerID="93aa526ce29a153733efd4844a34d88419813d06399f55a1886ce61c52d7216f" exitCode=0 Jun 09 13:57:14.138226 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.138183 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" event={"ID":"4f066217-5758-41e5-8cd2-b7db3d329dd7","Type":"ContainerDied","Data":"93aa526ce29a153733efd4844a34d88419813d06399f55a1886ce61c52d7216f"} Jun 09 13:57:14.140456 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.140429 2558 generic.go:356] "Generic (PLEG): container finished" podID="a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0" containerID="9b5519bfa972073b3549bfd170962a7756fd2824716dedb9b3e667d920f6a6db" exitCode=0 Jun 09 13:57:14.140555 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.140526 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" event={"ID":"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0","Type":"ContainerDied","Data":"9b5519bfa972073b3549bfd170962a7756fd2824716dedb9b3e667d920f6a6db"} Jun 09 13:57:14.280663 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.280637 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" Jun 09 13:57:14.351034 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.351005 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-util\") pod \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\" (UID: \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\") " Jun 09 13:57:14.351189 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.351088 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p8dz\" (UniqueName: \"kubernetes.io/projected/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-kube-api-access-4p8dz\") pod \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\" (UID: \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\") " Jun 09 13:57:14.351189 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.351145 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-bundle\") pod \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\" (UID: \"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c\") " Jun 09 13:57:14.351777 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.351754 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-bundle" (OuterVolumeSpecName: "bundle") pod "0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c" (UID: "0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:57:14.353305 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.353286 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-kube-api-access-4p8dz" (OuterVolumeSpecName: "kube-api-access-4p8dz") pod "0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c" (UID: "0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c"). InnerVolumeSpecName "kube-api-access-4p8dz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:57:14.356246 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.356220 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-util" (OuterVolumeSpecName: "util") pod "0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c" (UID: "0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:57:14.452715 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.452617 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-bundle\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:57:14.452715 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.452658 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-util\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:57:14.452715 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:14.452671 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p8dz\" (UniqueName: \"kubernetes.io/projected/0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c-kube-api-access-4p8dz\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:57:15.148677 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.148644 2558 generic.go:356] "Generic (PLEG): container finished" podID="186eef70-b03c-4b7e-8676-e0e59ccdc629" containerID="6167a16d7cbe21aacddd02579014d73ec8db8b9fadd9440a7751260e65fc890a" exitCode=0 Jun 09 13:57:15.149187 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.148731 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" event={"ID":"186eef70-b03c-4b7e-8676-e0e59ccdc629","Type":"ContainerDied","Data":"6167a16d7cbe21aacddd02579014d73ec8db8b9fadd9440a7751260e65fc890a"} Jun 09 13:57:15.150699 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.150675 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" event={"ID":"0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c","Type":"ContainerDied","Data":"ed0bb109da2c498042c4cc502526cd9048295305580fe835aa5128b846fc1bac"} Jun 09 13:57:15.150824 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.150711 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed0bb109da2c498042c4cc502526cd9048295305580fe835aa5128b846fc1bac" Jun 09 13:57:15.150824 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.150682 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh" Jun 09 13:57:15.152972 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.152950 2558 generic.go:356] "Generic (PLEG): container finished" podID="4f066217-5758-41e5-8cd2-b7db3d329dd7" containerID="3cc4a6a919041c14c52b0629a0b47af1d7188d857dec6135530131c37d4ff4f8" exitCode=0 Jun 09 13:57:15.153079 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.153004 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" event={"ID":"4f066217-5758-41e5-8cd2-b7db3d329dd7","Type":"ContainerDied","Data":"3cc4a6a919041c14c52b0629a0b47af1d7188d857dec6135530131c37d4ff4f8"} Jun 09 13:57:15.290221 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.290194 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" Jun 09 13:57:15.360453 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.360414 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xstt\" (UniqueName: \"kubernetes.io/projected/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-kube-api-access-7xstt\") pod \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\" (UID: \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\") " Jun 09 13:57:15.360649 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.360479 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-bundle\") pod \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\" (UID: \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\") " Jun 09 13:57:15.360649 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.360509 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-util\") pod \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\" (UID: \"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0\") " Jun 09 13:57:15.361018 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.360959 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-bundle" (OuterVolumeSpecName: "bundle") pod "a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0" (UID: "a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:57:15.362631 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.362608 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-kube-api-access-7xstt" (OuterVolumeSpecName: "kube-api-access-7xstt") pod "a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0" (UID: "a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0"). InnerVolumeSpecName "kube-api-access-7xstt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:57:15.369051 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.369024 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-util" (OuterVolumeSpecName: "util") pod "a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0" (UID: "a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:57:15.462259 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.462179 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xstt\" (UniqueName: \"kubernetes.io/projected/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-kube-api-access-7xstt\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:57:15.462259 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.462207 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-bundle\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:57:15.462259 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:15.462217 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0-util\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:57:16.160713 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.160678 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" Jun 09 13:57:16.161110 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.160687 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v" event={"ID":"a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0","Type":"ContainerDied","Data":"fa93f97cfe2dda26dcb8cf2bd5899117432858f0db0ad7238aca49c2412d8585"} Jun 09 13:57:16.161110 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.160795 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa93f97cfe2dda26dcb8cf2bd5899117432858f0db0ad7238aca49c2412d8585" Jun 09 13:57:16.324642 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.324619 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" Jun 09 13:57:16.326694 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.326674 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" Jun 09 13:57:16.371754 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.371728 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/186eef70-b03c-4b7e-8676-e0e59ccdc629-util\") pod \"186eef70-b03c-4b7e-8676-e0e59ccdc629\" (UID: \"186eef70-b03c-4b7e-8676-e0e59ccdc629\") " Jun 09 13:57:16.371913 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.371778 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/186eef70-b03c-4b7e-8676-e0e59ccdc629-bundle\") pod \"186eef70-b03c-4b7e-8676-e0e59ccdc629\" (UID: \"186eef70-b03c-4b7e-8676-e0e59ccdc629\") " Jun 09 13:57:16.371913 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.371801 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f066217-5758-41e5-8cd2-b7db3d329dd7-util\") pod \"4f066217-5758-41e5-8cd2-b7db3d329dd7\" (UID: \"4f066217-5758-41e5-8cd2-b7db3d329dd7\") " Jun 09 13:57:16.371913 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.371877 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzflp\" (UniqueName: \"kubernetes.io/projected/4f066217-5758-41e5-8cd2-b7db3d329dd7-kube-api-access-nzflp\") pod \"4f066217-5758-41e5-8cd2-b7db3d329dd7\" (UID: \"4f066217-5758-41e5-8cd2-b7db3d329dd7\") " Jun 09 13:57:16.371913 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.371903 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f066217-5758-41e5-8cd2-b7db3d329dd7-bundle\") pod \"4f066217-5758-41e5-8cd2-b7db3d329dd7\" (UID: \"4f066217-5758-41e5-8cd2-b7db3d329dd7\") " Jun 09 13:57:16.372324 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.371934 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpvc5\" (UniqueName: \"kubernetes.io/projected/186eef70-b03c-4b7e-8676-e0e59ccdc629-kube-api-access-kpvc5\") pod \"186eef70-b03c-4b7e-8676-e0e59ccdc629\" (UID: \"186eef70-b03c-4b7e-8676-e0e59ccdc629\") " Jun 09 13:57:16.372324 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.372267 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186eef70-b03c-4b7e-8676-e0e59ccdc629-bundle" (OuterVolumeSpecName: "bundle") pod "186eef70-b03c-4b7e-8676-e0e59ccdc629" (UID: "186eef70-b03c-4b7e-8676-e0e59ccdc629"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:57:16.372679 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.372640 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f066217-5758-41e5-8cd2-b7db3d329dd7-bundle" (OuterVolumeSpecName: "bundle") pod "4f066217-5758-41e5-8cd2-b7db3d329dd7" (UID: "4f066217-5758-41e5-8cd2-b7db3d329dd7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:57:16.374850 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.374816 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/186eef70-b03c-4b7e-8676-e0e59ccdc629-kube-api-access-kpvc5" (OuterVolumeSpecName: "kube-api-access-kpvc5") pod "186eef70-b03c-4b7e-8676-e0e59ccdc629" (UID: "186eef70-b03c-4b7e-8676-e0e59ccdc629"). InnerVolumeSpecName "kube-api-access-kpvc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:57:16.375007 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.374966 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f066217-5758-41e5-8cd2-b7db3d329dd7-kube-api-access-nzflp" (OuterVolumeSpecName: "kube-api-access-nzflp") pod "4f066217-5758-41e5-8cd2-b7db3d329dd7" (UID: "4f066217-5758-41e5-8cd2-b7db3d329dd7"). InnerVolumeSpecName "kube-api-access-nzflp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:57:16.378664 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.378638 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f066217-5758-41e5-8cd2-b7db3d329dd7-util" (OuterVolumeSpecName: "util") pod "4f066217-5758-41e5-8cd2-b7db3d329dd7" (UID: "4f066217-5758-41e5-8cd2-b7db3d329dd7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:57:16.379001 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.378944 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186eef70-b03c-4b7e-8676-e0e59ccdc629-util" (OuterVolumeSpecName: "util") pod "186eef70-b03c-4b7e-8676-e0e59ccdc629" (UID: "186eef70-b03c-4b7e-8676-e0e59ccdc629"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:57:16.473402 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.473306 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzflp\" (UniqueName: \"kubernetes.io/projected/4f066217-5758-41e5-8cd2-b7db3d329dd7-kube-api-access-nzflp\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:57:16.473402 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.473340 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f066217-5758-41e5-8cd2-b7db3d329dd7-bundle\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:57:16.473402 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.473356 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpvc5\" (UniqueName: \"kubernetes.io/projected/186eef70-b03c-4b7e-8676-e0e59ccdc629-kube-api-access-kpvc5\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:57:16.473402 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.473367 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/186eef70-b03c-4b7e-8676-e0e59ccdc629-util\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:57:16.473402 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.473380 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/186eef70-b03c-4b7e-8676-e0e59ccdc629-bundle\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:57:16.473402 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:16.473390 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f066217-5758-41e5-8cd2-b7db3d329dd7-util\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:57:17.167605 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:17.167566 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" event={"ID":"186eef70-b03c-4b7e-8676-e0e59ccdc629","Type":"ContainerDied","Data":"6689bd0d1ecf2d3cb3b3ac906eff01939b5583d8be286c5ba516a13aea645265"} Jun 09 13:57:17.168041 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:17.167620 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6689bd0d1ecf2d3cb3b3ac906eff01939b5583d8be286c5ba516a13aea645265" Jun 09 13:57:17.168041 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:17.167579 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr" Jun 09 13:57:17.169580 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:17.169562 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" Jun 09 13:57:17.169701 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:17.169605 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw" event={"ID":"4f066217-5758-41e5-8cd2-b7db3d329dd7","Type":"ContainerDied","Data":"887e78d52b3ea7e7c720140b2da5747ff905eccb13163bc92b3dd62e676e7952"} Jun 09 13:57:17.169701 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:17.169654 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="887e78d52b3ea7e7c720140b2da5747ff905eccb13163bc92b3dd62e676e7952" Jun 09 13:57:24.210115 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:24.210078 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:26.446809 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.446776 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x"] Jun 09 13:57:26.447234 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447147 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c" containerName="util" Jun 09 13:57:26.447234 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447159 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c" containerName="util" Jun 09 13:57:26.447234 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447167 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c" containerName="pull" Jun 09 13:57:26.447234 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447174 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c" containerName="pull" Jun 09 13:57:26.447234 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447188 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0" containerName="pull" Jun 09 13:57:26.447234 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447193 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0" containerName="pull" Jun 09 13:57:26.447234 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447202 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f066217-5758-41e5-8cd2-b7db3d329dd7" containerName="extract" Jun 09 13:57:26.447234 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447207 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f066217-5758-41e5-8cd2-b7db3d329dd7" containerName="extract" Jun 09 13:57:26.447234 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447215 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186eef70-b03c-4b7e-8676-e0e59ccdc629" containerName="util" Jun 09 13:57:26.447234 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447221 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="186eef70-b03c-4b7e-8676-e0e59ccdc629" containerName="util" Jun 09 13:57:26.447234 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447227 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0" containerName="extract" Jun 09 13:57:26.447234 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447232 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0" containerName="extract" Jun 09 13:57:26.447234 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447241 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f066217-5758-41e5-8cd2-b7db3d329dd7" containerName="util" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447246 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f066217-5758-41e5-8cd2-b7db3d329dd7" containerName="util" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447258 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186eef70-b03c-4b7e-8676-e0e59ccdc629" containerName="extract" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447263 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="186eef70-b03c-4b7e-8676-e0e59ccdc629" containerName="extract" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447271 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0" containerName="util" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447275 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0" containerName="util" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447281 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c" containerName="extract" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447285 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c" containerName="extract" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447290 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186eef70-b03c-4b7e-8676-e0e59ccdc629" containerName="pull" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447295 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="186eef70-b03c-4b7e-8676-e0e59ccdc629" containerName="pull" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447301 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f066217-5758-41e5-8cd2-b7db3d329dd7" containerName="pull" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447306 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f066217-5758-41e5-8cd2-b7db3d329dd7" containerName="pull" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447360 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0" containerName="extract" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447369 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c" containerName="extract" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447375 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f066217-5758-41e5-8cd2-b7db3d329dd7" containerName="extract" Jun 09 13:57:26.447697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.447382 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="186eef70-b03c-4b7e-8676-e0e59ccdc629" containerName="extract" Jun 09 13:57:26.450331 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.450313 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:57:26.457080 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.456728 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ssmrw\"" Jun 09 13:57:26.465494 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.465463 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x"] Jun 09 13:57:26.563596 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.563552 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxnj7\" (UniqueName: \"kubernetes.io/projected/292e1c59-d336-40ad-80c3-f35b6cd453e0-kube-api-access-vxnj7\") pod \"limitador-operator-controller-manager-859d7b78bd-cck7x\" (UID: \"292e1c59-d336-40ad-80c3-f35b6cd453e0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:57:26.665123 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.665085 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxnj7\" (UniqueName: \"kubernetes.io/projected/292e1c59-d336-40ad-80c3-f35b6cd453e0-kube-api-access-vxnj7\") pod \"limitador-operator-controller-manager-859d7b78bd-cck7x\" (UID: \"292e1c59-d336-40ad-80c3-f35b6cd453e0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:57:26.676276 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.676240 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxnj7\" (UniqueName: \"kubernetes.io/projected/292e1c59-d336-40ad-80c3-f35b6cd453e0-kube-api-access-vxnj7\") pod \"limitador-operator-controller-manager-859d7b78bd-cck7x\" (UID: \"292e1c59-d336-40ad-80c3-f35b6cd453e0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:57:26.760009 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.759946 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:57:26.900324 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:26.900301 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x"] Jun 09 13:57:26.901692 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:57:26.901663 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292e1c59_d336_40ad_80c3_f35b6cd453e0.slice/crio-6481cddf77d67a5fef17378d640d7179437577d33ee48c79d32381a87c59b312 WatchSource:0}: Error finding container 6481cddf77d67a5fef17378d640d7179437577d33ee48c79d32381a87c59b312: Status 404 returned error can't find the container with id 6481cddf77d67a5fef17378d640d7179437577d33ee48c79d32381a87c59b312 Jun 09 13:57:27.206382 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:27.206290 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:27.225625 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:27.225592 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" event={"ID":"292e1c59-d336-40ad-80c3-f35b6cd453e0","Type":"ContainerStarted","Data":"6481cddf77d67a5fef17378d640d7179437577d33ee48c79d32381a87c59b312"} Jun 09 13:57:27.996873 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:27.996843 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:29.240250 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:29.240206 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" event={"ID":"292e1c59-d336-40ad-80c3-f35b6cd453e0","Type":"ContainerStarted","Data":"16ffba24dd5066e6cc29a1ae14e8861ee596ebec9634076c567f763e98544f01"} Jun 09 13:57:29.240669 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:29.240310 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:57:29.262727 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:29.262670 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" podStartSLOduration=1.370705918 podStartE2EDuration="3.262652935s" totalImagesPullingTime="1.891947017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:57:29.260485882 +0000 UTC m=+743.708208239" watchObservedRunningTime="2026-06-09 13:57:29.262652935 +0000 UTC m=+743.710375294" Jun 09 13:57:31.675693 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:31.675658 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:31.802583 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:31.802550 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:31.933050 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:31.932943 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:33.440630 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:33.440593 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:34.679064 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:34.679027 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:34.882217 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:34.882185 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:36.679576 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:36.679542 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:38.693589 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:38.693551 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl"] Jun 09 13:57:38.697428 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:38.697409 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:57:38.700450 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:38.700426 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h286c\"" Jun 09 13:57:38.710555 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:38.710528 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl"] Jun 09 13:57:38.783274 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:38.783229 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wx7c\" (UniqueName: \"kubernetes.io/projected/48d40303-fab8-42b0-93ce-9cb63c50c218-kube-api-access-6wx7c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" (UID: \"48d40303-fab8-42b0-93ce-9cb63c50c218\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:57:38.783462 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:38.783287 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48d40303-fab8-42b0-93ce-9cb63c50c218-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" (UID: \"48d40303-fab8-42b0-93ce-9cb63c50c218\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:57:38.883864 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:38.883828 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48d40303-fab8-42b0-93ce-9cb63c50c218-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" (UID: \"48d40303-fab8-42b0-93ce-9cb63c50c218\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:57:38.884079 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:38.883928 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wx7c\" (UniqueName: \"kubernetes.io/projected/48d40303-fab8-42b0-93ce-9cb63c50c218-kube-api-access-6wx7c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" (UID: \"48d40303-fab8-42b0-93ce-9cb63c50c218\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:57:38.884257 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:38.884235 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48d40303-fab8-42b0-93ce-9cb63c50c218-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" (UID: \"48d40303-fab8-42b0-93ce-9cb63c50c218\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:57:38.893210 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:38.893184 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wx7c\" (UniqueName: \"kubernetes.io/projected/48d40303-fab8-42b0-93ce-9cb63c50c218-kube-api-access-6wx7c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" (UID: \"48d40303-fab8-42b0-93ce-9cb63c50c218\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:57:39.007487 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:39.007451 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:57:39.149740 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:39.149686 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl"] Jun 09 13:57:39.152324 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:57:39.152289 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d40303_fab8_42b0_93ce_9cb63c50c218.slice/crio-956a7b4fb98e79406e9af69027bdaad040618517a4aebb660fc39a65787aec82 WatchSource:0}: Error finding container 956a7b4fb98e79406e9af69027bdaad040618517a4aebb660fc39a65787aec82: Status 404 returned error can't find the container with id 956a7b4fb98e79406e9af69027bdaad040618517a4aebb660fc39a65787aec82 Jun 09 13:57:39.298738 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:39.298639 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" event={"ID":"48d40303-fab8-42b0-93ce-9cb63c50c218","Type":"ContainerStarted","Data":"956a7b4fb98e79406e9af69027bdaad040618517a4aebb660fc39a65787aec82"} Jun 09 13:57:39.812636 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:39.812606 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:39.913671 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:39.913623 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:40.249115 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:40.249085 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:57:45.223044 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:45.223002 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:45.322462 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:45.322425 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:45.680859 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:45.680823 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:45.826633 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:45.826590 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:47.346346 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:47.346305 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" event={"ID":"48d40303-fab8-42b0-93ce-9cb63c50c218","Type":"ContainerStarted","Data":"e9037e385d1bfa03fa04e5a707788dc6f90f00c05b07565e9d0b34eeb88295ba"} Jun 09 13:57:47.346740 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:47.346377 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:57:47.380613 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:47.380558 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" podStartSLOduration=2.084498594 podStartE2EDuration="9.380538648s" totalImagesPullingTime="7.296040054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:57:47.376196059 +0000 UTC m=+761.823918414" watchObservedRunningTime="2026-06-09 13:57:47.380538648 +0000 UTC m=+761.828261005" Jun 09 13:57:49.368188 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:49.368157 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:49.474066 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:49.474029 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:49.580226 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:49.580191 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:49.693409 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:49.693324 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:52.974748 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:52.974712 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:53.074523 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:53.074487 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:58.354713 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:58.354679 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:57:59.667693 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:59.667636 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:57:59.772160 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:57:59.772129 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:00.086155 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.086120 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl"] Jun 09 13:58:00.086336 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.086307 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" containerName="manager" containerID="cri-o://e9037e385d1bfa03fa04e5a707788dc6f90f00c05b07565e9d0b34eeb88295ba" gracePeriod=2 Jun 09 13:58:00.097690 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.097661 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl"] Jun 09 13:58:00.101933 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.101894 2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"48d40303-fab8-42b0-93ce-9cb63c50c218\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-m27jl\": pods \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:58:00.113282 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.113256 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x"] Jun 09 13:58:00.113529 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.113488 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" containerName="manager" containerID="cri-o://16ffba24dd5066e6cc29a1ae14e8861ee596ebec9634076c567f763e98544f01" gracePeriod=2 Jun 09 13:58:00.117370 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.117333 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cck7x\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:58:00.117845 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.117817 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2"] Jun 09 13:58:00.118453 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.118429 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" containerName="manager" Jun 09 13:58:00.118535 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.118456 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" containerName="manager" Jun 09 13:58:00.118591 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.118570 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" containerName="manager" Jun 09 13:58:00.119364 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.119337 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:58:00.123112 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.123091 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x"] Jun 09 13:58:00.123205 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.123193 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" Jun 09 13:58:00.126406 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.126375 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cck7x\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:58:00.129413 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.129385 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:58:00.142555 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.142528 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2"] Jun 09 13:58:00.151050 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.151016 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znzsq"] Jun 09 13:58:00.151936 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.151912 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" containerName="manager" Jun 09 13:58:00.152180 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.152155 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" containerName="manager" Jun 09 13:58:00.152417 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.152401 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" containerName="manager" Jun 09 13:58:00.157149 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.157127 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znzsq" Jun 09 13:58:00.168533 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.168476 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cck7x\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:58:00.172479 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.172322 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:58:00.173027 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.173006 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znzsq"] Jun 09 13:58:00.180329 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.180308 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3b882ce-856f-4b15-a859-1e93eef1680b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9dq2\" (UID: \"e3b882ce-856f-4b15-a859-1e93eef1680b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" Jun 09 13:58:00.180423 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.180350 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkj8b\" (UniqueName: \"kubernetes.io/projected/1fa374f4-b237-45cd-ae18-1a454c6003b4-kube-api-access-jkj8b\") pod \"limitador-operator-controller-manager-859d7b78bd-znzsq\" (UID: \"1fa374f4-b237-45cd-ae18-1a454c6003b4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znzsq" Jun 09 13:58:00.180488 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.180455 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dmgs\" (UniqueName: \"kubernetes.io/projected/e3b882ce-856f-4b15-a859-1e93eef1680b-kube-api-access-4dmgs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9dq2\" (UID: \"e3b882ce-856f-4b15-a859-1e93eef1680b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" Jun 09 13:58:00.281794 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.281759 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dmgs\" (UniqueName: \"kubernetes.io/projected/e3b882ce-856f-4b15-a859-1e93eef1680b-kube-api-access-4dmgs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9dq2\" (UID: \"e3b882ce-856f-4b15-a859-1e93eef1680b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" Jun 09 13:58:00.281959 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.281876 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3b882ce-856f-4b15-a859-1e93eef1680b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9dq2\" (UID: \"e3b882ce-856f-4b15-a859-1e93eef1680b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" Jun 09 13:58:00.281959 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.281922 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkj8b\" (UniqueName: \"kubernetes.io/projected/1fa374f4-b237-45cd-ae18-1a454c6003b4-kube-api-access-jkj8b\") pod \"limitador-operator-controller-manager-859d7b78bd-znzsq\" (UID: \"1fa374f4-b237-45cd-ae18-1a454c6003b4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znzsq" Jun 09 13:58:00.282390 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.282302 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3b882ce-856f-4b15-a859-1e93eef1680b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9dq2\" (UID: \"e3b882ce-856f-4b15-a859-1e93eef1680b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" Jun 09 13:58:00.292853 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.292826 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dmgs\" (UniqueName: \"kubernetes.io/projected/e3b882ce-856f-4b15-a859-1e93eef1680b-kube-api-access-4dmgs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9dq2\" (UID: \"e3b882ce-856f-4b15-a859-1e93eef1680b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" Jun 09 13:58:00.293083 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.293049 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkj8b\" (UniqueName: \"kubernetes.io/projected/1fa374f4-b237-45cd-ae18-1a454c6003b4-kube-api-access-jkj8b\") pod \"limitador-operator-controller-manager-859d7b78bd-znzsq\" (UID: \"1fa374f4-b237-45cd-ae18-1a454c6003b4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znzsq" Jun 09 13:58:00.358689 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.358666 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:58:00.361266 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.361241 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cck7x\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:58:00.363117 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.363101 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:58:00.363399 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.363380 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:58:00.365379 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.365355 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cck7x\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:58:00.367494 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.367475 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:58:00.383104 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.383082 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxnj7\" (UniqueName: \"kubernetes.io/projected/292e1c59-d336-40ad-80c3-f35b6cd453e0-kube-api-access-vxnj7\") pod \"292e1c59-d336-40ad-80c3-f35b6cd453e0\" (UID: \"292e1c59-d336-40ad-80c3-f35b6cd453e0\") " Jun 09 13:58:00.383181 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.383125 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48d40303-fab8-42b0-93ce-9cb63c50c218-extensions-socket-volume\") pod \"48d40303-fab8-42b0-93ce-9cb63c50c218\" (UID: \"48d40303-fab8-42b0-93ce-9cb63c50c218\") " Jun 09 13:58:00.383181 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.383168 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wx7c\" (UniqueName: \"kubernetes.io/projected/48d40303-fab8-42b0-93ce-9cb63c50c218-kube-api-access-6wx7c\") pod \"48d40303-fab8-42b0-93ce-9cb63c50c218\" (UID: \"48d40303-fab8-42b0-93ce-9cb63c50c218\") " Jun 09 13:58:00.383632 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.383608 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48d40303-fab8-42b0-93ce-9cb63c50c218-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "48d40303-fab8-42b0-93ce-9cb63c50c218" (UID: "48d40303-fab8-42b0-93ce-9cb63c50c218"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:58:00.385209 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.385184 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/292e1c59-d336-40ad-80c3-f35b6cd453e0-kube-api-access-vxnj7" (OuterVolumeSpecName: "kube-api-access-vxnj7") pod "292e1c59-d336-40ad-80c3-f35b6cd453e0" (UID: "292e1c59-d336-40ad-80c3-f35b6cd453e0"). InnerVolumeSpecName "kube-api-access-vxnj7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:58:00.385357 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.385337 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48d40303-fab8-42b0-93ce-9cb63c50c218-kube-api-access-6wx7c" (OuterVolumeSpecName: "kube-api-access-6wx7c") pod "48d40303-fab8-42b0-93ce-9cb63c50c218" (UID: "48d40303-fab8-42b0-93ce-9cb63c50c218"). InnerVolumeSpecName "kube-api-access-6wx7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:58:00.422264 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.422235 2558 generic.go:356] "Generic (PLEG): container finished" podID="48d40303-fab8-42b0-93ce-9cb63c50c218" containerID="e9037e385d1bfa03fa04e5a707788dc6f90f00c05b07565e9d0b34eeb88295ba" exitCode=0 Jun 09 13:58:00.422365 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.422273 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:58:00.422365 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.422334 2558 scope.go:117] "RemoveContainer" containerID="e9037e385d1bfa03fa04e5a707788dc6f90f00c05b07565e9d0b34eeb88295ba" Jun 09 13:58:00.423893 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.423868 2558 generic.go:356] "Generic (PLEG): container finished" podID="292e1c59-d336-40ad-80c3-f35b6cd453e0" containerID="16ffba24dd5066e6cc29a1ae14e8861ee596ebec9634076c567f763e98544f01" exitCode=0 Jun 09 13:58:00.424027 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.423907 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:58:00.424884 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.424853 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cck7x\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:58:00.427112 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.427089 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:58:00.429432 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.429409 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cck7x\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:58:00.431495 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.431468 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:58:00.432972 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.432952 2558 scope.go:117] "RemoveContainer" containerID="e9037e385d1bfa03fa04e5a707788dc6f90f00c05b07565e9d0b34eeb88295ba" Jun 09 13:58:00.433270 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.433247 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9037e385d1bfa03fa04e5a707788dc6f90f00c05b07565e9d0b34eeb88295ba\": container with ID starting with e9037e385d1bfa03fa04e5a707788dc6f90f00c05b07565e9d0b34eeb88295ba not found: ID does not exist" containerID="e9037e385d1bfa03fa04e5a707788dc6f90f00c05b07565e9d0b34eeb88295ba" Jun 09 13:58:00.433379 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.433276 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9037e385d1bfa03fa04e5a707788dc6f90f00c05b07565e9d0b34eeb88295ba"} err="failed to get container status \"e9037e385d1bfa03fa04e5a707788dc6f90f00c05b07565e9d0b34eeb88295ba\": rpc error: code = NotFound desc = could not find container \"e9037e385d1bfa03fa04e5a707788dc6f90f00c05b07565e9d0b34eeb88295ba\": container with ID starting with e9037e385d1bfa03fa04e5a707788dc6f90f00c05b07565e9d0b34eeb88295ba not found: ID does not exist" Jun 09 13:58:00.433379 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.433294 2558 scope.go:117] "RemoveContainer" containerID="16ffba24dd5066e6cc29a1ae14e8861ee596ebec9634076c567f763e98544f01" Jun 09 13:58:00.436930 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.436905 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cck7x\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:58:00.439116 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.439093 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:58:00.441136 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.441116 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cck7x\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:58:00.441754 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.441742 2558 scope.go:117] "RemoveContainer" containerID="16ffba24dd5066e6cc29a1ae14e8861ee596ebec9634076c567f763e98544f01" Jun 09 13:58:00.442020 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.442004 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16ffba24dd5066e6cc29a1ae14e8861ee596ebec9634076c567f763e98544f01\": container with ID starting with 16ffba24dd5066e6cc29a1ae14e8861ee596ebec9634076c567f763e98544f01 not found: ID does not exist" containerID="16ffba24dd5066e6cc29a1ae14e8861ee596ebec9634076c567f763e98544f01" Jun 09 13:58:00.442072 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.442029 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16ffba24dd5066e6cc29a1ae14e8861ee596ebec9634076c567f763e98544f01"} err="failed to get container status \"16ffba24dd5066e6cc29a1ae14e8861ee596ebec9634076c567f763e98544f01\": rpc error: code = NotFound desc = could not find container \"16ffba24dd5066e6cc29a1ae14e8861ee596ebec9634076c567f763e98544f01\": container with ID starting with 16ffba24dd5066e6cc29a1ae14e8861ee596ebec9634076c567f763e98544f01 not found: ID does not exist" Jun 09 13:58:00.443166 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:00.443147 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:58:00.484720 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.484697 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxnj7\" (UniqueName: \"kubernetes.io/projected/292e1c59-d336-40ad-80c3-f35b6cd453e0-kube-api-access-vxnj7\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:58:00.484720 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.484720 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48d40303-fab8-42b0-93ce-9cb63c50c218-extensions-socket-volume\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:58:00.484720 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.484730 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wx7c\" (UniqueName: \"kubernetes.io/projected/48d40303-fab8-42b0-93ce-9cb63c50c218-kube-api-access-6wx7c\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:58:00.565697 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.565670 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" Jun 09 13:58:00.572456 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.572440 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znzsq" Jun 09 13:58:00.720960 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:58:00.720930 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b882ce_856f_4b15_a859_1e93eef1680b.slice/crio-9f17885232035dc37f169f9be5f9948030dc8fcbbe2c25756f68cee499db25ff WatchSource:0}: Error finding container 9f17885232035dc37f169f9be5f9948030dc8fcbbe2c25756f68cee499db25ff: Status 404 returned error can't find the container with id 9f17885232035dc37f169f9be5f9948030dc8fcbbe2c25756f68cee499db25ff Jun 09 13:58:00.721375 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.721351 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2"] Jun 09 13:58:00.750852 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:00.750829 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znzsq"] Jun 09 13:58:00.760122 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:58:00.760095 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa374f4_b237_45cd_ae18_1a454c6003b4.slice/crio-c14ee971404dc222ffbef79f0fe54b19bc26949c7dca419229eb7f3af974b791 WatchSource:0}: Error finding container c14ee971404dc222ffbef79f0fe54b19bc26949c7dca419229eb7f3af974b791: Status 404 returned error can't find the container with id c14ee971404dc222ffbef79f0fe54b19bc26949c7dca419229eb7f3af974b791 Jun 09 13:58:01.067646 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:01.067614 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:01.161166 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:01.161120 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:01.246871 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:01.246831 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.47:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 09 13:58:01.431826 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:01.431735 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znzsq" event={"ID":"1fa374f4-b237-45cd-ae18-1a454c6003b4","Type":"ContainerStarted","Data":"b9f1ca0757f481da08befd8e64909bd49afbf95a9d691233047244ed73b53ca1"} Jun 09 13:58:01.431826 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:01.431793 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znzsq" event={"ID":"1fa374f4-b237-45cd-ae18-1a454c6003b4","Type":"ContainerStarted","Data":"c14ee971404dc222ffbef79f0fe54b19bc26949c7dca419229eb7f3af974b791"} Jun 09 13:58:01.432101 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:01.431882 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znzsq" Jun 09 13:58:01.434421 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:01.434393 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" event={"ID":"e3b882ce-856f-4b15-a859-1e93eef1680b","Type":"ContainerStarted","Data":"6493a7738d96b252f5e84fe4f4b9a49499e8a8746b030fce827ebbfb580cd315"} Jun 09 13:58:01.434544 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:01.434442 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" event={"ID":"e3b882ce-856f-4b15-a859-1e93eef1680b","Type":"ContainerStarted","Data":"9f17885232035dc37f169f9be5f9948030dc8fcbbe2c25756f68cee499db25ff"} Jun 09 13:58:01.434544 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:01.434497 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" Jun 09 13:58:01.452965 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:01.452920 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znzsq" podStartSLOduration=1.45290627 podStartE2EDuration="1.45290627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:58:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:58:01.450771192 +0000 UTC m=+775.898493562" watchObservedRunningTime="2026-06-09 13:58:01.45290627 +0000 UTC m=+775.900628627" Jun 09 13:58:01.453094 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:01.453070 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cck7x\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:58:01.455085 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:01.455064 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:58:01.457038 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:01.457018 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cck7x\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cck7x" Jun 09 13:58:01.458966 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:01.458947 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m27jl\" is forbidden: User \"system:node:ip-10-0-136-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-4.ec2.internal' and this object" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m27jl" Jun 09 13:58:01.479860 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:01.479815 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" podStartSLOduration=1.479801625 podStartE2EDuration="1.479801625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:58:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:58:01.478165235 +0000 UTC m=+775.925887627" watchObservedRunningTime="2026-06-09 13:58:01.479801625 +0000 UTC m=+775.927523982" Jun 09 13:58:01.946416 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:01.946379 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="292e1c59-d336-40ad-80c3-f35b6cd453e0" path="/var/lib/kubelet/pods/292e1c59-d336-40ad-80c3-f35b6cd453e0/volumes" Jun 09 13:58:01.946910 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:01.946892 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48d40303-fab8-42b0-93ce-9cb63c50c218" path="/var/lib/kubelet/pods/48d40303-fab8-42b0-93ce-9cb63c50c218/volumes" Jun 09 13:58:03.435194 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:03.435157 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:03.534675 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:03.534640 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:03.634772 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:03.634732 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:03.735160 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:03.735128 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:07.254068 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:07.254033 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:07.349481 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:07.349444 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:07.594934 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:07.594850 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:11.896851 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:11.896816 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:11.992539 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:11.992502 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:12.442416 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:12.442387 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znzsq" Jun 09 13:58:12.442612 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:12.442461 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" Jun 09 13:58:31.107793 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.107711 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2"] Jun 09 13:58:31.108195 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.107953 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" podUID="e3b882ce-856f-4b15-a859-1e93eef1680b" containerName="manager" containerID="cri-o://6493a7738d96b252f5e84fe4f4b9a49499e8a8746b030fce827ebbfb580cd315" gracePeriod=10 Jun 09 13:58:31.351865 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.351830 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5"] Jun 09 13:58:31.355043 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.355022 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5" Jun 09 13:58:31.373481 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.373451 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5"] Jun 09 13:58:31.375553 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.375532 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" Jun 09 13:58:31.463747 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.463712 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dmgs\" (UniqueName: \"kubernetes.io/projected/e3b882ce-856f-4b15-a859-1e93eef1680b-kube-api-access-4dmgs\") pod \"e3b882ce-856f-4b15-a859-1e93eef1680b\" (UID: \"e3b882ce-856f-4b15-a859-1e93eef1680b\") " Jun 09 13:58:31.463915 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.463844 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3b882ce-856f-4b15-a859-1e93eef1680b-extensions-socket-volume\") pod \"e3b882ce-856f-4b15-a859-1e93eef1680b\" (UID: \"e3b882ce-856f-4b15-a859-1e93eef1680b\") " Jun 09 13:58:31.464041 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.464019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b36046e5-fbbf-4405-ad97-63db7fb48101-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-grqt5\" (UID: \"b36046e5-fbbf-4405-ad97-63db7fb48101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5" Jun 09 13:58:31.464175 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.464049 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4xfg\" (UniqueName: \"kubernetes.io/projected/b36046e5-fbbf-4405-ad97-63db7fb48101-kube-api-access-c4xfg\") pod \"kuadrant-operator-controller-manager-86878c769f-grqt5\" (UID: \"b36046e5-fbbf-4405-ad97-63db7fb48101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5" Jun 09 13:58:31.464222 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.464200 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3b882ce-856f-4b15-a859-1e93eef1680b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e3b882ce-856f-4b15-a859-1e93eef1680b" (UID: "e3b882ce-856f-4b15-a859-1e93eef1680b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:58:31.466070 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.466047 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3b882ce-856f-4b15-a859-1e93eef1680b-kube-api-access-4dmgs" (OuterVolumeSpecName: "kube-api-access-4dmgs") pod "e3b882ce-856f-4b15-a859-1e93eef1680b" (UID: "e3b882ce-856f-4b15-a859-1e93eef1680b"). InnerVolumeSpecName "kube-api-access-4dmgs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:58:31.565383 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.565343 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b36046e5-fbbf-4405-ad97-63db7fb48101-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-grqt5\" (UID: \"b36046e5-fbbf-4405-ad97-63db7fb48101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5" Jun 09 13:58:31.565383 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.565388 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4xfg\" (UniqueName: \"kubernetes.io/projected/b36046e5-fbbf-4405-ad97-63db7fb48101-kube-api-access-c4xfg\") pod \"kuadrant-operator-controller-manager-86878c769f-grqt5\" (UID: \"b36046e5-fbbf-4405-ad97-63db7fb48101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5" Jun 09 13:58:31.565585 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.565475 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3b882ce-856f-4b15-a859-1e93eef1680b-extensions-socket-volume\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:58:31.565585 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.565491 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dmgs\" (UniqueName: \"kubernetes.io/projected/e3b882ce-856f-4b15-a859-1e93eef1680b-kube-api-access-4dmgs\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:58:31.565801 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.565770 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b36046e5-fbbf-4405-ad97-63db7fb48101-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-grqt5\" (UID: \"b36046e5-fbbf-4405-ad97-63db7fb48101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5" Jun 09 13:58:31.582194 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.582160 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4xfg\" (UniqueName: \"kubernetes.io/projected/b36046e5-fbbf-4405-ad97-63db7fb48101-kube-api-access-c4xfg\") pod \"kuadrant-operator-controller-manager-86878c769f-grqt5\" (UID: \"b36046e5-fbbf-4405-ad97-63db7fb48101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5" Jun 09 13:58:31.608031 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.608002 2558 generic.go:356] "Generic (PLEG): container finished" podID="e3b882ce-856f-4b15-a859-1e93eef1680b" containerID="6493a7738d96b252f5e84fe4f4b9a49499e8a8746b030fce827ebbfb580cd315" exitCode=0 Jun 09 13:58:31.608145 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.608065 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" Jun 09 13:58:31.608145 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.608096 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" event={"ID":"e3b882ce-856f-4b15-a859-1e93eef1680b","Type":"ContainerDied","Data":"6493a7738d96b252f5e84fe4f4b9a49499e8a8746b030fce827ebbfb580cd315"} Jun 09 13:58:31.608235 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.608169 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2" event={"ID":"e3b882ce-856f-4b15-a859-1e93eef1680b","Type":"ContainerDied","Data":"9f17885232035dc37f169f9be5f9948030dc8fcbbe2c25756f68cee499db25ff"} Jun 09 13:58:31.608235 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.608192 2558 scope.go:117] "RemoveContainer" containerID="6493a7738d96b252f5e84fe4f4b9a49499e8a8746b030fce827ebbfb580cd315" Jun 09 13:58:31.617843 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.617817 2558 scope.go:117] "RemoveContainer" containerID="6493a7738d96b252f5e84fe4f4b9a49499e8a8746b030fce827ebbfb580cd315" Jun 09 13:58:31.618137 ip-10-0-136-4 kubenswrapper[2558]: E0609 13:58:31.618120 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6493a7738d96b252f5e84fe4f4b9a49499e8a8746b030fce827ebbfb580cd315\": container with ID starting with 6493a7738d96b252f5e84fe4f4b9a49499e8a8746b030fce827ebbfb580cd315 not found: ID does not exist" containerID="6493a7738d96b252f5e84fe4f4b9a49499e8a8746b030fce827ebbfb580cd315" Jun 09 13:58:31.618193 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.618144 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6493a7738d96b252f5e84fe4f4b9a49499e8a8746b030fce827ebbfb580cd315"} err="failed to get container status \"6493a7738d96b252f5e84fe4f4b9a49499e8a8746b030fce827ebbfb580cd315\": rpc error: code = NotFound desc = could not find container \"6493a7738d96b252f5e84fe4f4b9a49499e8a8746b030fce827ebbfb580cd315\": container with ID starting with 6493a7738d96b252f5e84fe4f4b9a49499e8a8746b030fce827ebbfb580cd315 not found: ID does not exist" Jun 09 13:58:31.647524 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.647491 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2"] Jun 09 13:58:31.649952 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.649930 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9dq2"] Jun 09 13:58:31.684247 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.684218 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5" Jun 09 13:58:31.830632 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.830603 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5"] Jun 09 13:58:31.831416 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:58:31.831393 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb36046e5_fbbf_4405_ad97_63db7fb48101.slice/crio-4233e00c0de6b18aa8e03393b6fb9f48eab4d1b8877b101c7b4d4f2b52d448d9 WatchSource:0}: Error finding container 4233e00c0de6b18aa8e03393b6fb9f48eab4d1b8877b101c7b4d4f2b52d448d9: Status 404 returned error can't find the container with id 4233e00c0de6b18aa8e03393b6fb9f48eab4d1b8877b101c7b4d4f2b52d448d9 Jun 09 13:58:31.945649 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:31.945617 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3b882ce-856f-4b15-a859-1e93eef1680b" path="/var/lib/kubelet/pods/e3b882ce-856f-4b15-a859-1e93eef1680b/volumes" Jun 09 13:58:32.616612 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:32.616580 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5" event={"ID":"b36046e5-fbbf-4405-ad97-63db7fb48101","Type":"ContainerStarted","Data":"357741d06fabc23db8412d261ef194902b4618303400093b4910fb49c34cf048"} Jun 09 13:58:32.617036 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:32.616629 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5" event={"ID":"b36046e5-fbbf-4405-ad97-63db7fb48101","Type":"ContainerStarted","Data":"4233e00c0de6b18aa8e03393b6fb9f48eab4d1b8877b101c7b4d4f2b52d448d9"} Jun 09 13:58:32.617036 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:32.616658 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5" Jun 09 13:58:32.643787 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:32.643738 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5" podStartSLOduration=1.6437212570000002 podStartE2EDuration="1.643721257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:58:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:58:32.639939469 +0000 UTC m=+807.087661827" watchObservedRunningTime="2026-06-09 13:58:32.643721257 +0000 UTC m=+807.091443612" Jun 09 13:58:43.625866 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:43.625827 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-grqt5" Jun 09 13:58:47.400689 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.400655 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc"] Jun 09 13:58:47.401280 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.401263 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3b882ce-856f-4b15-a859-1e93eef1680b" containerName="manager" Jun 09 13:58:47.401332 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.401284 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3b882ce-856f-4b15-a859-1e93eef1680b" containerName="manager" Jun 09 13:58:47.401384 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.401373 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3b882ce-856f-4b15-a859-1e93eef1680b" containerName="manager" Jun 09 13:58:47.406257 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.406234 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.408939 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.408919 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rkn8t\"" Jun 09 13:58:47.424881 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.419761 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.424881 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.419825 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdjgl\" (UniqueName: \"kubernetes.io/projected/d571bcab-0030-44bc-a20b-879906afd588-kube-api-access-cdjgl\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.424881 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.419878 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.424881 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.419904 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.424881 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.419939 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d571bcab-0030-44bc-a20b-879906afd588-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.424881 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.419974 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d571bcab-0030-44bc-a20b-879906afd588-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.424881 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.420043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.424881 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.420099 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc"] Jun 09 13:58:47.424881 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.420110 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.424881 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.420161 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d571bcab-0030-44bc-a20b-879906afd588-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.436311 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.436287 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:47.521388 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.521352 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.521583 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.521408 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdjgl\" (UniqueName: \"kubernetes.io/projected/d571bcab-0030-44bc-a20b-879906afd588-kube-api-access-cdjgl\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.521583 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.521451 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.521583 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.521473 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.521583 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.521501 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d571bcab-0030-44bc-a20b-879906afd588-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.521583 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.521530 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d571bcab-0030-44bc-a20b-879906afd588-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.521853 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.521662 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.521853 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.521742 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.521853 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.521791 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d571bcab-0030-44bc-a20b-879906afd588-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.522066 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.522032 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.522066 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.522057 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.522215 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.522142 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.522269 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.522225 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.522526 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.522509 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d571bcab-0030-44bc-a20b-879906afd588-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.523930 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.523909 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d571bcab-0030-44bc-a20b-879906afd588-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.524199 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.524179 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d571bcab-0030-44bc-a20b-879906afd588-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.532215 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.532177 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdjgl\" (UniqueName: \"kubernetes.io/projected/d571bcab-0030-44bc-a20b-879906afd588-kube-api-access-cdjgl\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.532583 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.532564 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d571bcab-0030-44bc-a20b-879906afd588-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-952cc\" (UID: \"d571bcab-0030-44bc-a20b-879906afd588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.535866 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.535841 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:47.725861 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.725766 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:47.868336 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.868311 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc"] Jun 09 13:58:47.869893 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:58:47.869868 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd571bcab_0030_44bc_a20b_879906afd588.slice/crio-80439b8dcd900edccec516819f8946ca0fbba08bdc7d6973e02aed59ee68d05a WatchSource:0}: Error finding container 80439b8dcd900edccec516819f8946ca0fbba08bdc7d6973e02aed59ee68d05a: Status 404 returned error can't find the container with id 80439b8dcd900edccec516819f8946ca0fbba08bdc7d6973e02aed59ee68d05a Jun 09 13:58:47.872488 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.872446 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 13:58:47.872591 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.872537 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 13:58:47.872641 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:47.872601 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 13:58:48.715047 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:48.715008 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" event={"ID":"d571bcab-0030-44bc-a20b-879906afd588","Type":"ContainerStarted","Data":"fa92dd5bdaa516b1a94a822c6b8132fc6fbfa07b04b409d57ce27de75bb9f046"} Jun 09 13:58:48.715440 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:48.715073 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" event={"ID":"d571bcab-0030-44bc-a20b-879906afd588","Type":"ContainerStarted","Data":"80439b8dcd900edccec516819f8946ca0fbba08bdc7d6973e02aed59ee68d05a"} Jun 09 13:58:48.726043 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:48.726017 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:48.730653 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:48.730631 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:48.740379 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:48.740331 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" podStartSLOduration=1.7403126009999998 podStartE2EDuration="1.740312601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:58:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:58:48.737691932 +0000 UTC m=+823.185414299" watchObservedRunningTime="2026-06-09 13:58:48.740312601 +0000 UTC m=+823.188034958" Jun 09 13:58:49.720635 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:49.720604 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:49.721689 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:49.721669 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 13:58:51.558254 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:51.558221 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:52.109181 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:52.109145 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:52.233772 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:52.233735 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:52.346394 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:52.346355 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:53.015952 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:53.015918 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:53.080382 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:53.080348 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:53.251735 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:53.251697 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxhtp"] Jun 09 13:58:53.255496 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:53.255478 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dxhtp" Jun 09 13:58:53.258239 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:53.258212 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6rxps\"" Jun 09 13:58:53.263284 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:53.263257 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxhtp"] Jun 09 13:58:53.375746 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:53.375643 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt9g4\" (UniqueName: \"kubernetes.io/projected/00fe0514-504f-492f-bc47-ec5ce73b797f-kube-api-access-zt9g4\") pod \"authorino-75d556bd77-dxhtp\" (UID: \"00fe0514-504f-492f-bc47-ec5ce73b797f\") " pod="kuadrant-system/authorino-75d556bd77-dxhtp" Jun 09 13:58:53.477258 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:53.477215 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt9g4\" (UniqueName: \"kubernetes.io/projected/00fe0514-504f-492f-bc47-ec5ce73b797f-kube-api-access-zt9g4\") pod \"authorino-75d556bd77-dxhtp\" (UID: \"00fe0514-504f-492f-bc47-ec5ce73b797f\") " pod="kuadrant-system/authorino-75d556bd77-dxhtp" Jun 09 13:58:53.486957 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:53.486934 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt9g4\" (UniqueName: \"kubernetes.io/projected/00fe0514-504f-492f-bc47-ec5ce73b797f-kube-api-access-zt9g4\") pod \"authorino-75d556bd77-dxhtp\" (UID: \"00fe0514-504f-492f-bc47-ec5ce73b797f\") " pod="kuadrant-system/authorino-75d556bd77-dxhtp" Jun 09 13:58:53.566782 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:53.566734 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dxhtp" Jun 09 13:58:53.709565 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:53.709538 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxhtp"] Jun 09 13:58:53.711508 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:58:53.711479 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00fe0514_504f_492f_bc47_ec5ce73b797f.slice/crio-671a3fa7fc93bcb875d4b5f825cfbbd1a477e2cf128fb938f71aba8894d61001 WatchSource:0}: Error finding container 671a3fa7fc93bcb875d4b5f825cfbbd1a477e2cf128fb938f71aba8894d61001: Status 404 returned error can't find the container with id 671a3fa7fc93bcb875d4b5f825cfbbd1a477e2cf128fb938f71aba8894d61001 Jun 09 13:58:53.743847 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:53.743810 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dxhtp" event={"ID":"00fe0514-504f-492f-bc47-ec5ce73b797f","Type":"ContainerStarted","Data":"671a3fa7fc93bcb875d4b5f825cfbbd1a477e2cf128fb938f71aba8894d61001"} Jun 09 13:58:55.790715 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:55.790653 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:55.888654 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:55.888591 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:58:57.774767 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:57.774722 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dxhtp" event={"ID":"00fe0514-504f-492f-bc47-ec5ce73b797f","Type":"ContainerStarted","Data":"132ca38b8e8791ccaea2ed52407ebbe94d4a2ccbc747136cce34a10610fd3618"} Jun 09 13:58:57.803578 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:58:57.803517 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-dxhtp" podStartSLOduration=1.597569271 podStartE2EDuration="4.80349887s" totalImagesPullingTime="3.205929599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:58:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:58:57.802934709 +0000 UTC m=+832.250657091" watchObservedRunningTime="2026-06-09 13:58:57.80349887 +0000 UTC m=+832.251221227" Jun 09 13:59:14.115211 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:14.115148 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:59:14.203105 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:14.203067 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:59:14.710029 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:14.709967 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:59:26.687476 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:26.687435 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:59:26.784745 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:26.784709 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:59:26.971361 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:26.971267 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:59:28.329862 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.329815 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz"] Jun 09 13:59:28.338606 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.338581 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" Jun 09 13:59:28.345717 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.345690 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 13:59:28.347756 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.347736 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6xmqb\"" Jun 09 13:59:28.347887 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.347737 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 13:59:28.353387 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.353362 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz"] Jun 09 13:59:28.403443 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.403410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6da3fe1d-6c54-48e3-9746-d712068ea38f-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz\" (UID: \"6da3fe1d-6c54-48e3-9746-d712068ea38f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" Jun 09 13:59:28.403600 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.403454 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shnx2\" (UniqueName: \"kubernetes.io/projected/6da3fe1d-6c54-48e3-9746-d712068ea38f-kube-api-access-shnx2\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz\" (UID: \"6da3fe1d-6c54-48e3-9746-d712068ea38f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" Jun 09 13:59:28.403600 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.403485 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6da3fe1d-6c54-48e3-9746-d712068ea38f-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz\" (UID: \"6da3fe1d-6c54-48e3-9746-d712068ea38f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" Jun 09 13:59:28.504416 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.504378 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6da3fe1d-6c54-48e3-9746-d712068ea38f-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz\" (UID: \"6da3fe1d-6c54-48e3-9746-d712068ea38f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" Jun 09 13:59:28.504585 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.504467 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6da3fe1d-6c54-48e3-9746-d712068ea38f-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz\" (UID: \"6da3fe1d-6c54-48e3-9746-d712068ea38f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" Jun 09 13:59:28.504585 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.504491 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shnx2\" (UniqueName: \"kubernetes.io/projected/6da3fe1d-6c54-48e3-9746-d712068ea38f-kube-api-access-shnx2\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz\" (UID: \"6da3fe1d-6c54-48e3-9746-d712068ea38f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" Jun 09 13:59:28.504739 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.504720 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6da3fe1d-6c54-48e3-9746-d712068ea38f-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz\" (UID: \"6da3fe1d-6c54-48e3-9746-d712068ea38f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" Jun 09 13:59:28.504786 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.504767 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6da3fe1d-6c54-48e3-9746-d712068ea38f-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz\" (UID: \"6da3fe1d-6c54-48e3-9746-d712068ea38f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" Jun 09 13:59:28.514815 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.514782 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shnx2\" (UniqueName: \"kubernetes.io/projected/6da3fe1d-6c54-48e3-9746-d712068ea38f-kube-api-access-shnx2\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz\" (UID: \"6da3fe1d-6c54-48e3-9746-d712068ea38f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" Jun 09 13:59:28.648499 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.648406 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" Jun 09 13:59:28.823713 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.823677 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz"] Jun 09 13:59:28.825908 ip-10-0-136-4 kubenswrapper[2558]: W0609 13:59:28.825876 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da3fe1d_6c54_48e3_9746_d712068ea38f.slice/crio-b18ba54772fd40ae3fa8ae933c41b612c7235ad27cc83994d74c7e5fea3529d8 WatchSource:0}: Error finding container b18ba54772fd40ae3fa8ae933c41b612c7235ad27cc83994d74c7e5fea3529d8: Status 404 returned error can't find the container with id b18ba54772fd40ae3fa8ae933c41b612c7235ad27cc83994d74c7e5fea3529d8 Jun 09 13:59:28.959260 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.959226 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" event={"ID":"6da3fe1d-6c54-48e3-9746-d712068ea38f","Type":"ContainerStarted","Data":"0bbfec49652b30f721abaf4d4f8e889793069ac78ed5a9a18df7a46c87c573f0"} Jun 09 13:59:28.959432 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:28.959278 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" event={"ID":"6da3fe1d-6c54-48e3-9746-d712068ea38f","Type":"ContainerStarted","Data":"b18ba54772fd40ae3fa8ae933c41b612c7235ad27cc83994d74c7e5fea3529d8"} Jun 09 13:59:29.966109 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:29.966021 2558 generic.go:356] "Generic (PLEG): container finished" podID="6da3fe1d-6c54-48e3-9746-d712068ea38f" containerID="0bbfec49652b30f721abaf4d4f8e889793069ac78ed5a9a18df7a46c87c573f0" exitCode=0 Jun 09 13:59:29.966488 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:29.966114 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" event={"ID":"6da3fe1d-6c54-48e3-9746-d712068ea38f","Type":"ContainerDied","Data":"0bbfec49652b30f721abaf4d4f8e889793069ac78ed5a9a18df7a46c87c573f0"} Jun 09 13:59:30.975134 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:30.975099 2558 generic.go:356] "Generic (PLEG): container finished" podID="6da3fe1d-6c54-48e3-9746-d712068ea38f" containerID="06f4b32dc76824f5a527aeee0b261b3c34b4bd9b46e5cedd1eb1a7c1bcbf3f08" exitCode=0 Jun 09 13:59:30.975526 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:30.975191 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" event={"ID":"6da3fe1d-6c54-48e3-9746-d712068ea38f","Type":"ContainerDied","Data":"06f4b32dc76824f5a527aeee0b261b3c34b4bd9b46e5cedd1eb1a7c1bcbf3f08"} Jun 09 13:59:31.983345 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:31.983311 2558 generic.go:356] "Generic (PLEG): container finished" podID="6da3fe1d-6c54-48e3-9746-d712068ea38f" containerID="56fcdb26d372968fa39f68a1e074a6c9cd975fc6ed3f556252f98dece23f818f" exitCode=0 Jun 09 13:59:31.983738 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:31.983398 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" event={"ID":"6da3fe1d-6c54-48e3-9746-d712068ea38f","Type":"ContainerDied","Data":"56fcdb26d372968fa39f68a1e074a6c9cd975fc6ed3f556252f98dece23f818f"} Jun 09 13:59:33.127264 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:33.127237 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" Jun 09 13:59:33.148736 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:33.148708 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6da3fe1d-6c54-48e3-9746-d712068ea38f-util\") pod \"6da3fe1d-6c54-48e3-9746-d712068ea38f\" (UID: \"6da3fe1d-6c54-48e3-9746-d712068ea38f\") " Jun 09 13:59:33.148899 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:33.148765 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shnx2\" (UniqueName: \"kubernetes.io/projected/6da3fe1d-6c54-48e3-9746-d712068ea38f-kube-api-access-shnx2\") pod \"6da3fe1d-6c54-48e3-9746-d712068ea38f\" (UID: \"6da3fe1d-6c54-48e3-9746-d712068ea38f\") " Jun 09 13:59:33.148899 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:33.148794 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6da3fe1d-6c54-48e3-9746-d712068ea38f-bundle\") pod \"6da3fe1d-6c54-48e3-9746-d712068ea38f\" (UID: \"6da3fe1d-6c54-48e3-9746-d712068ea38f\") " Jun 09 13:59:33.149307 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:33.149280 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6da3fe1d-6c54-48e3-9746-d712068ea38f-bundle" (OuterVolumeSpecName: "bundle") pod "6da3fe1d-6c54-48e3-9746-d712068ea38f" (UID: "6da3fe1d-6c54-48e3-9746-d712068ea38f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:59:33.150963 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:33.150935 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6da3fe1d-6c54-48e3-9746-d712068ea38f-kube-api-access-shnx2" (OuterVolumeSpecName: "kube-api-access-shnx2") pod "6da3fe1d-6c54-48e3-9746-d712068ea38f" (UID: "6da3fe1d-6c54-48e3-9746-d712068ea38f"). InnerVolumeSpecName "kube-api-access-shnx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:59:33.155736 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:33.155690 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6da3fe1d-6c54-48e3-9746-d712068ea38f-util" (OuterVolumeSpecName: "util") pod "6da3fe1d-6c54-48e3-9746-d712068ea38f" (UID: "6da3fe1d-6c54-48e3-9746-d712068ea38f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:59:33.250150 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:33.250058 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6da3fe1d-6c54-48e3-9746-d712068ea38f-util\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:59:33.250150 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:33.250091 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shnx2\" (UniqueName: \"kubernetes.io/projected/6da3fe1d-6c54-48e3-9746-d712068ea38f-kube-api-access-shnx2\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:59:33.250150 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:33.250102 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6da3fe1d-6c54-48e3-9746-d712068ea38f-bundle\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 13:59:33.997807 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:33.997771 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" event={"ID":"6da3fe1d-6c54-48e3-9746-d712068ea38f","Type":"ContainerDied","Data":"b18ba54772fd40ae3fa8ae933c41b612c7235ad27cc83994d74c7e5fea3529d8"} Jun 09 13:59:33.998055 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:33.997834 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b18ba54772fd40ae3fa8ae933c41b612c7235ad27cc83994d74c7e5fea3529d8" Jun 09 13:59:33.998055 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:33.997785 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486hhxz" Jun 09 13:59:38.667691 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:38.667650 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:59:51.786823 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:51.786783 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:59:51.889761 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:51.889719 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:59:56.456442 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:56.456350 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 13:59:56.557167 ip-10-0-136-4 kubenswrapper[2558]: I0609 13:59:56.557127 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:00:05.967688 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:05.967658 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gp8mh_94fe717f-e61a-483a-bac8-be82ca3c7dc2/ovn-acl-logging/0.log" Jun 09 14:00:05.970584 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:05.970562 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gp8mh_94fe717f-e61a-483a-bac8-be82ca3c7dc2/ovn-acl-logging/0.log" Jun 09 14:00:10.410963 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:10.410927 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:00:21.273009 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.272960 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:00:21.402580 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.402544 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:00:21.509098 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.509064 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n5q88"] Jun 09 14:00:21.509455 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.509443 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6da3fe1d-6c54-48e3-9746-d712068ea38f" containerName="pull" Jun 09 14:00:21.509501 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.509458 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6da3fe1d-6c54-48e3-9746-d712068ea38f" containerName="pull" Jun 09 14:00:21.509501 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.509467 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6da3fe1d-6c54-48e3-9746-d712068ea38f" containerName="extract" Jun 09 14:00:21.509501 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.509473 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6da3fe1d-6c54-48e3-9746-d712068ea38f" containerName="extract" Jun 09 14:00:21.509501 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.509480 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6da3fe1d-6c54-48e3-9746-d712068ea38f" containerName="util" Jun 09 14:00:21.509501 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.509485 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6da3fe1d-6c54-48e3-9746-d712068ea38f" containerName="util" Jun 09 14:00:21.509655 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.509560 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6da3fe1d-6c54-48e3-9746-d712068ea38f" containerName="extract" Jun 09 14:00:21.512625 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.512603 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n5q88" Jun 09 14:00:21.520944 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.520917 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n5q88"] Jun 09 14:00:21.608728 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.608639 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvkjh\" (UniqueName: \"kubernetes.io/projected/25f816eb-1bdd-421d-a5a8-56103ca868b7-kube-api-access-lvkjh\") pod \"authorino-5d4b67c446-n5q88\" (UID: \"25f816eb-1bdd-421d-a5a8-56103ca868b7\") " pod="kuadrant-system/authorino-5d4b67c446-n5q88" Jun 09 14:00:21.709240 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.709206 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvkjh\" (UniqueName: \"kubernetes.io/projected/25f816eb-1bdd-421d-a5a8-56103ca868b7-kube-api-access-lvkjh\") pod \"authorino-5d4b67c446-n5q88\" (UID: \"25f816eb-1bdd-421d-a5a8-56103ca868b7\") " pod="kuadrant-system/authorino-5d4b67c446-n5q88" Jun 09 14:00:21.718539 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.718513 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvkjh\" (UniqueName: \"kubernetes.io/projected/25f816eb-1bdd-421d-a5a8-56103ca868b7-kube-api-access-lvkjh\") pod \"authorino-5d4b67c446-n5q88\" (UID: \"25f816eb-1bdd-421d-a5a8-56103ca868b7\") " pod="kuadrant-system/authorino-5d4b67c446-n5q88" Jun 09 14:00:21.740337 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.740307 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n5q88"] Jun 09 14:00:21.740613 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.740600 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n5q88" Jun 09 14:00:21.769819 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.769784 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b4f5455f8-qp99r"] Jun 09 14:00:21.773791 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.773767 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b4f5455f8-qp99r" Jun 09 14:00:21.782139 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.782101 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b4f5455f8-qp99r"] Jun 09 14:00:21.809924 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.809880 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45xsd\" (UniqueName: \"kubernetes.io/projected/f240404d-e83e-454b-ab63-aa82a6ce3145-kube-api-access-45xsd\") pod \"authorino-6b4f5455f8-qp99r\" (UID: \"f240404d-e83e-454b-ab63-aa82a6ce3145\") " pod="kuadrant-system/authorino-6b4f5455f8-qp99r" Jun 09 14:00:21.888750 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.888717 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n5q88"] Jun 09 14:00:21.890096 ip-10-0-136-4 kubenswrapper[2558]: W0609 14:00:21.890063 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25f816eb_1bdd_421d_a5a8_56103ca868b7.slice/crio-163b7492cd988fdf6c9fdefe8241c124800fd1eb4aead4fb27408baf16129c22 WatchSource:0}: Error finding container 163b7492cd988fdf6c9fdefe8241c124800fd1eb4aead4fb27408baf16129c22: Status 404 returned error can't find the container with id 163b7492cd988fdf6c9fdefe8241c124800fd1eb4aead4fb27408baf16129c22 Jun 09 14:00:21.905694 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.905664 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b4f5455f8-qp99r"] Jun 09 14:00:21.906022 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:00:21.905996 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-45xsd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6b4f5455f8-qp99r" podUID="f240404d-e83e-454b-ab63-aa82a6ce3145" Jun 09 14:00:21.910880 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.910861 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45xsd\" (UniqueName: \"kubernetes.io/projected/f240404d-e83e-454b-ab63-aa82a6ce3145-kube-api-access-45xsd\") pod \"authorino-6b4f5455f8-qp99r\" (UID: \"f240404d-e83e-454b-ab63-aa82a6ce3145\") " pod="kuadrant-system/authorino-6b4f5455f8-qp99r" Jun 09 14:00:21.924026 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.923996 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45xsd\" (UniqueName: \"kubernetes.io/projected/f240404d-e83e-454b-ab63-aa82a6ce3145-kube-api-access-45xsd\") pod \"authorino-6b4f5455f8-qp99r\" (UID: \"f240404d-e83e-454b-ab63-aa82a6ce3145\") " pod="kuadrant-system/authorino-6b4f5455f8-qp99r" Jun 09 14:00:21.947319 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.947290 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fd47695fd-8hxrw"] Jun 09 14:00:21.950894 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.950872 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd47695fd-8hxrw" Jun 09 14:00:21.954218 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.954196 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 14:00:21.962516 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:21.962495 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fd47695fd-8hxrw"] Jun 09 14:00:22.012194 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:22.012162 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32b82025-b4b4-442a-8194-1668a7c60d22-tls-cert\") pod \"authorino-fd47695fd-8hxrw\" (UID: \"32b82025-b4b4-442a-8194-1668a7c60d22\") " pod="kuadrant-system/authorino-fd47695fd-8hxrw" Jun 09 14:00:22.012371 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:22.012208 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwk8v\" (UniqueName: \"kubernetes.io/projected/32b82025-b4b4-442a-8194-1668a7c60d22-kube-api-access-xwk8v\") pod \"authorino-fd47695fd-8hxrw\" (UID: \"32b82025-b4b4-442a-8194-1668a7c60d22\") " pod="kuadrant-system/authorino-fd47695fd-8hxrw" Jun 09 14:00:22.112851 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:22.112812 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32b82025-b4b4-442a-8194-1668a7c60d22-tls-cert\") pod \"authorino-fd47695fd-8hxrw\" (UID: \"32b82025-b4b4-442a-8194-1668a7c60d22\") " pod="kuadrant-system/authorino-fd47695fd-8hxrw" Jun 09 14:00:22.113060 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:22.112868 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwk8v\" (UniqueName: \"kubernetes.io/projected/32b82025-b4b4-442a-8194-1668a7c60d22-kube-api-access-xwk8v\") pod \"authorino-fd47695fd-8hxrw\" (UID: \"32b82025-b4b4-442a-8194-1668a7c60d22\") " pod="kuadrant-system/authorino-fd47695fd-8hxrw" Jun 09 14:00:22.115416 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:22.115383 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32b82025-b4b4-442a-8194-1668a7c60d22-tls-cert\") pod \"authorino-fd47695fd-8hxrw\" (UID: \"32b82025-b4b4-442a-8194-1668a7c60d22\") " pod="kuadrant-system/authorino-fd47695fd-8hxrw" Jun 09 14:00:22.124021 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:22.123994 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwk8v\" (UniqueName: \"kubernetes.io/projected/32b82025-b4b4-442a-8194-1668a7c60d22-kube-api-access-xwk8v\") pod \"authorino-fd47695fd-8hxrw\" (UID: \"32b82025-b4b4-442a-8194-1668a7c60d22\") " pod="kuadrant-system/authorino-fd47695fd-8hxrw" Jun 09 14:00:22.261597 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:22.261561 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd47695fd-8hxrw" Jun 09 14:00:22.281724 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:22.281685 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-n5q88" event={"ID":"25f816eb-1bdd-421d-a5a8-56103ca868b7","Type":"ContainerStarted","Data":"163b7492cd988fdf6c9fdefe8241c124800fd1eb4aead4fb27408baf16129c22"} Jun 09 14:00:22.281724 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:22.281711 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b4f5455f8-qp99r" Jun 09 14:00:22.289179 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:22.289154 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b4f5455f8-qp99r" Jun 09 14:00:22.416425 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:22.416399 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45xsd\" (UniqueName: \"kubernetes.io/projected/f240404d-e83e-454b-ab63-aa82a6ce3145-kube-api-access-45xsd\") pod \"f240404d-e83e-454b-ab63-aa82a6ce3145\" (UID: \"f240404d-e83e-454b-ab63-aa82a6ce3145\") " Jun 09 14:00:22.420034 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:22.419495 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fd47695fd-8hxrw"] Jun 09 14:00:22.421350 ip-10-0-136-4 kubenswrapper[2558]: W0609 14:00:22.421300 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32b82025_b4b4_442a_8194_1668a7c60d22.slice/crio-5494484963b39a3a13c4367bfd65b48adfba6c82df8d5747ccf0a5ec79a0df96 WatchSource:0}: Error finding container 5494484963b39a3a13c4367bfd65b48adfba6c82df8d5747ccf0a5ec79a0df96: Status 404 returned error can't find the container with id 5494484963b39a3a13c4367bfd65b48adfba6c82df8d5747ccf0a5ec79a0df96 Jun 09 14:00:22.421884 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:22.421825 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f240404d-e83e-454b-ab63-aa82a6ce3145-kube-api-access-45xsd" (OuterVolumeSpecName: "kube-api-access-45xsd") pod "f240404d-e83e-454b-ab63-aa82a6ce3145" (UID: "f240404d-e83e-454b-ab63-aa82a6ce3145"). InnerVolumeSpecName "kube-api-access-45xsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:00:22.517532 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:22.517434 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45xsd\" (UniqueName: \"kubernetes.io/projected/f240404d-e83e-454b-ab63-aa82a6ce3145-kube-api-access-45xsd\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:00:23.289964 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.289922 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-n5q88" event={"ID":"25f816eb-1bdd-421d-a5a8-56103ca868b7","Type":"ContainerStarted","Data":"365bedbc7d4636e2a878a7bd9d697bcb3bb2ff746ba723b16b42e168fd71f2c6"} Jun 09 14:00:23.290481 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.289960 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-n5q88" podUID="25f816eb-1bdd-421d-a5a8-56103ca868b7" containerName="authorino" containerID="cri-o://365bedbc7d4636e2a878a7bd9d697bcb3bb2ff746ba723b16b42e168fd71f2c6" gracePeriod=30 Jun 09 14:00:23.291570 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.291544 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fd47695fd-8hxrw" event={"ID":"32b82025-b4b4-442a-8194-1668a7c60d22","Type":"ContainerStarted","Data":"d640d37b07275a4558e3bda347e2f5dc9f57038fe2911098f780567c32c15214"} Jun 09 14:00:23.291570 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.291563 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b4f5455f8-qp99r" Jun 09 14:00:23.291758 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.291579 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fd47695fd-8hxrw" event={"ID":"32b82025-b4b4-442a-8194-1668a7c60d22","Type":"ContainerStarted","Data":"5494484963b39a3a13c4367bfd65b48adfba6c82df8d5747ccf0a5ec79a0df96"} Jun 09 14:00:23.360696 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.360640 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-fd47695fd-8hxrw" podStartSLOduration=2.005238138 podStartE2EDuration="2.36062451s" totalImagesPullingTime="355.386372ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:00:23.358403267 +0000 UTC m=+917.806125629" watchObservedRunningTime="2026-06-09 14:00:23.36062451 +0000 UTC m=+917.808346866" Jun 09 14:00:23.361399 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.361370 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-n5q88" podStartSLOduration=1.9462898320000002 podStartE2EDuration="2.361358842s" totalImagesPullingTime="415.06901ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:00:23.324682191 +0000 UTC m=+917.772404548" watchObservedRunningTime="2026-06-09 14:00:23.361358842 +0000 UTC m=+917.809081198" Jun 09 14:00:23.412460 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.412425 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxhtp"] Jun 09 14:00:23.412659 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.412634 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-dxhtp" podUID="00fe0514-504f-492f-bc47-ec5ce73b797f" containerName="authorino" containerID="cri-o://132ca38b8e8791ccaea2ed52407ebbe94d4a2ccbc747136cce34a10610fd3618" gracePeriod=30 Jun 09 14:00:23.421968 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.421941 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b4f5455f8-qp99r"] Jun 09 14:00:23.431441 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.431387 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6b4f5455f8-qp99r"] Jun 09 14:00:23.561696 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.561653 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n5q88" Jun 09 14:00:23.628858 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.628824 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvkjh\" (UniqueName: \"kubernetes.io/projected/25f816eb-1bdd-421d-a5a8-56103ca868b7-kube-api-access-lvkjh\") pod \"25f816eb-1bdd-421d-a5a8-56103ca868b7\" (UID: \"25f816eb-1bdd-421d-a5a8-56103ca868b7\") " Jun 09 14:00:23.631042 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.631012 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25f816eb-1bdd-421d-a5a8-56103ca868b7-kube-api-access-lvkjh" (OuterVolumeSpecName: "kube-api-access-lvkjh") pod "25f816eb-1bdd-421d-a5a8-56103ca868b7" (UID: "25f816eb-1bdd-421d-a5a8-56103ca868b7"). InnerVolumeSpecName "kube-api-access-lvkjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:00:23.663959 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.663933 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dxhtp" Jun 09 14:00:23.730211 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.730178 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt9g4\" (UniqueName: \"kubernetes.io/projected/00fe0514-504f-492f-bc47-ec5ce73b797f-kube-api-access-zt9g4\") pod \"00fe0514-504f-492f-bc47-ec5ce73b797f\" (UID: \"00fe0514-504f-492f-bc47-ec5ce73b797f\") " Jun 09 14:00:23.730612 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.730593 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvkjh\" (UniqueName: \"kubernetes.io/projected/25f816eb-1bdd-421d-a5a8-56103ca868b7-kube-api-access-lvkjh\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:00:23.732487 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.732461 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00fe0514-504f-492f-bc47-ec5ce73b797f-kube-api-access-zt9g4" (OuterVolumeSpecName: "kube-api-access-zt9g4") pod "00fe0514-504f-492f-bc47-ec5ce73b797f" (UID: "00fe0514-504f-492f-bc47-ec5ce73b797f"). InnerVolumeSpecName "kube-api-access-zt9g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:00:23.832222 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.832134 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt9g4\" (UniqueName: \"kubernetes.io/projected/00fe0514-504f-492f-bc47-ec5ce73b797f-kube-api-access-zt9g4\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:00:23.946555 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:23.946513 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f240404d-e83e-454b-ab63-aa82a6ce3145" path="/var/lib/kubelet/pods/f240404d-e83e-454b-ab63-aa82a6ce3145/volumes" Jun 09 14:00:24.298833 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.298794 2558 generic.go:356] "Generic (PLEG): container finished" podID="25f816eb-1bdd-421d-a5a8-56103ca868b7" containerID="365bedbc7d4636e2a878a7bd9d697bcb3bb2ff746ba723b16b42e168fd71f2c6" exitCode=0 Jun 09 14:00:24.299357 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.298837 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n5q88" Jun 09 14:00:24.299357 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.298851 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-n5q88" event={"ID":"25f816eb-1bdd-421d-a5a8-56103ca868b7","Type":"ContainerDied","Data":"365bedbc7d4636e2a878a7bd9d697bcb3bb2ff746ba723b16b42e168fd71f2c6"} Jun 09 14:00:24.299357 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.298900 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-n5q88" event={"ID":"25f816eb-1bdd-421d-a5a8-56103ca868b7","Type":"ContainerDied","Data":"163b7492cd988fdf6c9fdefe8241c124800fd1eb4aead4fb27408baf16129c22"} Jun 09 14:00:24.299357 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.298922 2558 scope.go:117] "RemoveContainer" containerID="365bedbc7d4636e2a878a7bd9d697bcb3bb2ff746ba723b16b42e168fd71f2c6" Jun 09 14:00:24.300281 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.300256 2558 generic.go:356] "Generic (PLEG): container finished" podID="00fe0514-504f-492f-bc47-ec5ce73b797f" containerID="132ca38b8e8791ccaea2ed52407ebbe94d4a2ccbc747136cce34a10610fd3618" exitCode=0 Jun 09 14:00:24.300403 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.300306 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dxhtp" Jun 09 14:00:24.300403 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.300345 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dxhtp" event={"ID":"00fe0514-504f-492f-bc47-ec5ce73b797f","Type":"ContainerDied","Data":"132ca38b8e8791ccaea2ed52407ebbe94d4a2ccbc747136cce34a10610fd3618"} Jun 09 14:00:24.300403 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.300386 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dxhtp" event={"ID":"00fe0514-504f-492f-bc47-ec5ce73b797f","Type":"ContainerDied","Data":"671a3fa7fc93bcb875d4b5f825cfbbd1a477e2cf128fb938f71aba8894d61001"} Jun 09 14:00:24.308789 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.308770 2558 scope.go:117] "RemoveContainer" containerID="365bedbc7d4636e2a878a7bd9d697bcb3bb2ff746ba723b16b42e168fd71f2c6" Jun 09 14:00:24.309095 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:00:24.309074 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"365bedbc7d4636e2a878a7bd9d697bcb3bb2ff746ba723b16b42e168fd71f2c6\": container with ID starting with 365bedbc7d4636e2a878a7bd9d697bcb3bb2ff746ba723b16b42e168fd71f2c6 not found: ID does not exist" containerID="365bedbc7d4636e2a878a7bd9d697bcb3bb2ff746ba723b16b42e168fd71f2c6" Jun 09 14:00:24.309185 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.309101 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"365bedbc7d4636e2a878a7bd9d697bcb3bb2ff746ba723b16b42e168fd71f2c6"} err="failed to get container status \"365bedbc7d4636e2a878a7bd9d697bcb3bb2ff746ba723b16b42e168fd71f2c6\": rpc error: code = NotFound desc = could not find container \"365bedbc7d4636e2a878a7bd9d697bcb3bb2ff746ba723b16b42e168fd71f2c6\": container with ID starting with 365bedbc7d4636e2a878a7bd9d697bcb3bb2ff746ba723b16b42e168fd71f2c6 not found: ID does not exist" Jun 09 14:00:24.309185 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.309118 2558 scope.go:117] "RemoveContainer" containerID="132ca38b8e8791ccaea2ed52407ebbe94d4a2ccbc747136cce34a10610fd3618" Jun 09 14:00:24.317615 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.317599 2558 scope.go:117] "RemoveContainer" containerID="132ca38b8e8791ccaea2ed52407ebbe94d4a2ccbc747136cce34a10610fd3618" Jun 09 14:00:24.317879 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:00:24.317853 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"132ca38b8e8791ccaea2ed52407ebbe94d4a2ccbc747136cce34a10610fd3618\": container with ID starting with 132ca38b8e8791ccaea2ed52407ebbe94d4a2ccbc747136cce34a10610fd3618 not found: ID does not exist" containerID="132ca38b8e8791ccaea2ed52407ebbe94d4a2ccbc747136cce34a10610fd3618" Jun 09 14:00:24.317939 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.317881 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"132ca38b8e8791ccaea2ed52407ebbe94d4a2ccbc747136cce34a10610fd3618"} err="failed to get container status \"132ca38b8e8791ccaea2ed52407ebbe94d4a2ccbc747136cce34a10610fd3618\": rpc error: code = NotFound desc = could not find container \"132ca38b8e8791ccaea2ed52407ebbe94d4a2ccbc747136cce34a10610fd3618\": container with ID starting with 132ca38b8e8791ccaea2ed52407ebbe94d4a2ccbc747136cce34a10610fd3618 not found: ID does not exist" Jun 09 14:00:24.332264 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.332235 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n5q88"] Jun 09 14:00:24.342289 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.342264 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n5q88"] Jun 09 14:00:24.351408 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.351384 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxhtp"] Jun 09 14:00:24.355649 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:24.355628 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxhtp"] Jun 09 14:00:25.949662 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:25.949623 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00fe0514-504f-492f-bc47-ec5ce73b797f" path="/var/lib/kubelet/pods/00fe0514-504f-492f-bc47-ec5ce73b797f/volumes" Jun 09 14:00:25.950167 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:25.950148 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25f816eb-1bdd-421d-a5a8-56103ca868b7" path="/var/lib/kubelet/pods/25f816eb-1bdd-421d-a5a8-56103ca868b7/volumes" Jun 09 14:00:27.039578 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.039543 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:00:27.065809 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.065778 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dc49f7b7c-nmqww"] Jun 09 14:00:27.066212 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.066198 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f816eb-1bdd-421d-a5a8-56103ca868b7" containerName="authorino" Jun 09 14:00:27.066262 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.066214 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f816eb-1bdd-421d-a5a8-56103ca868b7" containerName="authorino" Jun 09 14:00:27.066262 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.066230 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00fe0514-504f-492f-bc47-ec5ce73b797f" containerName="authorino" Jun 09 14:00:27.066262 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.066238 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="00fe0514-504f-492f-bc47-ec5ce73b797f" containerName="authorino" Jun 09 14:00:27.066361 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.066307 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="25f816eb-1bdd-421d-a5a8-56103ca868b7" containerName="authorino" Jun 09 14:00:27.066361 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.066317 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="00fe0514-504f-492f-bc47-ec5ce73b797f" containerName="authorino" Jun 09 14:00:27.069216 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.069200 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" Jun 09 14:00:27.072531 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.072511 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mkxqb\"" Jun 09 14:00:27.073624 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.073603 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 14:00:27.073624 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.073615 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 14:00:27.080839 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.080817 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dc49f7b7c-nmqww"] Jun 09 14:00:27.120521 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.120483 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:00:27.170160 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.170122 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/503f0625-d458-40cc-a2ba-ff0a64a661c4-webhook-cert\") pod \"maas-controller-7dc49f7b7c-nmqww\" (UID: \"503f0625-d458-40cc-a2ba-ff0a64a661c4\") " pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" Jun 09 14:00:27.170338 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.170168 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr4lv\" (UniqueName: \"kubernetes.io/projected/503f0625-d458-40cc-a2ba-ff0a64a661c4-kube-api-access-zr4lv\") pod \"maas-controller-7dc49f7b7c-nmqww\" (UID: \"503f0625-d458-40cc-a2ba-ff0a64a661c4\") " pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" Jun 09 14:00:27.196609 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.196579 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:00:27.225278 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.225245 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78776866f5-sfjnh"] Jun 09 14:00:27.228849 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.228830 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78776866f5-sfjnh" Jun 09 14:00:27.240394 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.240369 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78776866f5-sfjnh"] Jun 09 14:00:27.271012 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.270938 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/503f0625-d458-40cc-a2ba-ff0a64a661c4-webhook-cert\") pod \"maas-controller-7dc49f7b7c-nmqww\" (UID: \"503f0625-d458-40cc-a2ba-ff0a64a661c4\") " pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" Jun 09 14:00:27.271012 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.271009 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr4lv\" (UniqueName: \"kubernetes.io/projected/503f0625-d458-40cc-a2ba-ff0a64a661c4-kube-api-access-zr4lv\") pod \"maas-controller-7dc49f7b7c-nmqww\" (UID: \"503f0625-d458-40cc-a2ba-ff0a64a661c4\") " pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" Jun 09 14:00:27.273570 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.273547 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/503f0625-d458-40cc-a2ba-ff0a64a661c4-webhook-cert\") pod \"maas-controller-7dc49f7b7c-nmqww\" (UID: \"503f0625-d458-40cc-a2ba-ff0a64a661c4\") " pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" Jun 09 14:00:27.280175 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.280148 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr4lv\" (UniqueName: \"kubernetes.io/projected/503f0625-d458-40cc-a2ba-ff0a64a661c4-kube-api-access-zr4lv\") pod \"maas-controller-7dc49f7b7c-nmqww\" (UID: \"503f0625-d458-40cc-a2ba-ff0a64a661c4\") " pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" Jun 09 14:00:27.371680 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.371584 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/088b2e52-aa95-44c4-b53b-8a1de082fa9c-webhook-cert\") pod \"maas-controller-78776866f5-sfjnh\" (UID: \"088b2e52-aa95-44c4-b53b-8a1de082fa9c\") " pod="opendatahub/maas-controller-78776866f5-sfjnh" Jun 09 14:00:27.371832 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.371713 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-777sg\" (UniqueName: \"kubernetes.io/projected/088b2e52-aa95-44c4-b53b-8a1de082fa9c-kube-api-access-777sg\") pod \"maas-controller-78776866f5-sfjnh\" (UID: \"088b2e52-aa95-44c4-b53b-8a1de082fa9c\") " pod="opendatahub/maas-controller-78776866f5-sfjnh" Jun 09 14:00:27.380500 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.380462 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" Jun 09 14:00:27.472747 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.472698 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/088b2e52-aa95-44c4-b53b-8a1de082fa9c-webhook-cert\") pod \"maas-controller-78776866f5-sfjnh\" (UID: \"088b2e52-aa95-44c4-b53b-8a1de082fa9c\") " pod="opendatahub/maas-controller-78776866f5-sfjnh" Jun 09 14:00:27.472888 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.472831 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-777sg\" (UniqueName: \"kubernetes.io/projected/088b2e52-aa95-44c4-b53b-8a1de082fa9c-kube-api-access-777sg\") pod \"maas-controller-78776866f5-sfjnh\" (UID: \"088b2e52-aa95-44c4-b53b-8a1de082fa9c\") " pod="opendatahub/maas-controller-78776866f5-sfjnh" Jun 09 14:00:27.475480 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.475455 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/088b2e52-aa95-44c4-b53b-8a1de082fa9c-webhook-cert\") pod \"maas-controller-78776866f5-sfjnh\" (UID: \"088b2e52-aa95-44c4-b53b-8a1de082fa9c\") " pod="opendatahub/maas-controller-78776866f5-sfjnh" Jun 09 14:00:27.482929 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.482904 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-777sg\" (UniqueName: \"kubernetes.io/projected/088b2e52-aa95-44c4-b53b-8a1de082fa9c-kube-api-access-777sg\") pod \"maas-controller-78776866f5-sfjnh\" (UID: \"088b2e52-aa95-44c4-b53b-8a1de082fa9c\") " pod="opendatahub/maas-controller-78776866f5-sfjnh" Jun 09 14:00:27.520243 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.520212 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dc49f7b7c-nmqww"] Jun 09 14:00:27.521135 ip-10-0-136-4 kubenswrapper[2558]: W0609 14:00:27.521106 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503f0625_d458_40cc_a2ba_ff0a64a661c4.slice/crio-913e9ed0616c8e8a70ddd52db665e840467e33cc0d39ee78681c34f80443ab5b WatchSource:0}: Error finding container 913e9ed0616c8e8a70ddd52db665e840467e33cc0d39ee78681c34f80443ab5b: Status 404 returned error can't find the container with id 913e9ed0616c8e8a70ddd52db665e840467e33cc0d39ee78681c34f80443ab5b Jun 09 14:00:27.541551 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.541524 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78776866f5-sfjnh" Jun 09 14:00:27.684241 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:27.684211 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78776866f5-sfjnh"] Jun 09 14:00:27.685533 ip-10-0-136-4 kubenswrapper[2558]: W0609 14:00:27.685505 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod088b2e52_aa95_44c4_b53b_8a1de082fa9c.slice/crio-6562954cc8c9ec4461592f5c31ea9311048d9f8998a5939c23ea4618b693bc5f WatchSource:0}: Error finding container 6562954cc8c9ec4461592f5c31ea9311048d9f8998a5939c23ea4618b693bc5f: Status 404 returned error can't find the container with id 6562954cc8c9ec4461592f5c31ea9311048d9f8998a5939c23ea4618b693bc5f Jun 09 14:00:28.332952 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:28.332882 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" event={"ID":"503f0625-d458-40cc-a2ba-ff0a64a661c4","Type":"ContainerStarted","Data":"913e9ed0616c8e8a70ddd52db665e840467e33cc0d39ee78681c34f80443ab5b"} Jun 09 14:00:28.334725 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:28.334653 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78776866f5-sfjnh" event={"ID":"088b2e52-aa95-44c4-b53b-8a1de082fa9c","Type":"ContainerStarted","Data":"6562954cc8c9ec4461592f5c31ea9311048d9f8998a5939c23ea4618b693bc5f"} Jun 09 14:00:30.350796 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:30.350759 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78776866f5-sfjnh" event={"ID":"088b2e52-aa95-44c4-b53b-8a1de082fa9c","Type":"ContainerStarted","Data":"d97c0ce86ebbc5bddda0c0cd9ab2df27d436dc5572e8604d211fd78a3f69f5d5"} Jun 09 14:00:30.351264 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:30.350840 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78776866f5-sfjnh" Jun 09 14:00:30.352390 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:30.352367 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" event={"ID":"503f0625-d458-40cc-a2ba-ff0a64a661c4","Type":"ContainerStarted","Data":"e3bb725e212b42fabe7d7cd5080e7906a22986bc6103b134b7445540bd39ccdd"} Jun 09 14:00:30.352488 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:30.352419 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" Jun 09 14:00:30.369392 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:30.369348 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78776866f5-sfjnh" podStartSLOduration=0.811586462 podStartE2EDuration="3.369333617s" totalImagesPullingTime="2.557747155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:00:30.368588044 +0000 UTC m=+924.816310401" watchObservedRunningTime="2026-06-09 14:00:30.369333617 +0000 UTC m=+924.817055952" Jun 09 14:00:30.386874 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:30.386824 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" podStartSLOduration=0.671364761 podStartE2EDuration="3.386809649s" totalImagesPullingTime="2.715444888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:00:30.384956246 +0000 UTC m=+924.832678662" watchObservedRunningTime="2026-06-09 14:00:30.386809649 +0000 UTC m=+924.834532005" Jun 09 14:00:30.508274 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:30.508239 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:00:30.606924 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:30.606888 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:00:41.364440 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:41.364404 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" Jun 09 14:00:41.365074 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:41.364733 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78776866f5-sfjnh" Jun 09 14:00:41.431317 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:41.431280 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dc49f7b7c-nmqww"] Jun 09 14:00:41.431557 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:41.431527 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" podUID="503f0625-d458-40cc-a2ba-ff0a64a661c4" containerName="manager" containerID="cri-o://e3bb725e212b42fabe7d7cd5080e7906a22986bc6103b134b7445540bd39ccdd" gracePeriod=30 Jun 09 14:00:41.681137 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:41.681109 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" Jun 09 14:00:41.717282 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:41.717253 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/503f0625-d458-40cc-a2ba-ff0a64a661c4-webhook-cert\") pod \"503f0625-d458-40cc-a2ba-ff0a64a661c4\" (UID: \"503f0625-d458-40cc-a2ba-ff0a64a661c4\") " Jun 09 14:00:41.717458 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:41.717288 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr4lv\" (UniqueName: \"kubernetes.io/projected/503f0625-d458-40cc-a2ba-ff0a64a661c4-kube-api-access-zr4lv\") pod \"503f0625-d458-40cc-a2ba-ff0a64a661c4\" (UID: \"503f0625-d458-40cc-a2ba-ff0a64a661c4\") " Jun 09 14:00:41.719607 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:41.719576 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/503f0625-d458-40cc-a2ba-ff0a64a661c4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "503f0625-d458-40cc-a2ba-ff0a64a661c4" (UID: "503f0625-d458-40cc-a2ba-ff0a64a661c4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:00:41.719746 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:41.719657 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/503f0625-d458-40cc-a2ba-ff0a64a661c4-kube-api-access-zr4lv" (OuterVolumeSpecName: "kube-api-access-zr4lv") pod "503f0625-d458-40cc-a2ba-ff0a64a661c4" (UID: "503f0625-d458-40cc-a2ba-ff0a64a661c4"). InnerVolumeSpecName "kube-api-access-zr4lv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:00:41.818487 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:41.818450 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/503f0625-d458-40cc-a2ba-ff0a64a661c4-webhook-cert\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:00:41.818487 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:41.818483 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr4lv\" (UniqueName: \"kubernetes.io/projected/503f0625-d458-40cc-a2ba-ff0a64a661c4-kube-api-access-zr4lv\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:00:42.424681 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:42.424649 2558 generic.go:356] "Generic (PLEG): container finished" podID="503f0625-d458-40cc-a2ba-ff0a64a661c4" containerID="e3bb725e212b42fabe7d7cd5080e7906a22986bc6103b134b7445540bd39ccdd" exitCode=0 Jun 09 14:00:42.425144 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:42.424695 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" Jun 09 14:00:42.425144 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:42.424745 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" event={"ID":"503f0625-d458-40cc-a2ba-ff0a64a661c4","Type":"ContainerDied","Data":"e3bb725e212b42fabe7d7cd5080e7906a22986bc6103b134b7445540bd39ccdd"} Jun 09 14:00:42.425144 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:42.424795 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc49f7b7c-nmqww" event={"ID":"503f0625-d458-40cc-a2ba-ff0a64a661c4","Type":"ContainerDied","Data":"913e9ed0616c8e8a70ddd52db665e840467e33cc0d39ee78681c34f80443ab5b"} Jun 09 14:00:42.425144 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:42.424818 2558 scope.go:117] "RemoveContainer" containerID="e3bb725e212b42fabe7d7cd5080e7906a22986bc6103b134b7445540bd39ccdd" Jun 09 14:00:42.434606 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:42.434420 2558 scope.go:117] "RemoveContainer" containerID="e3bb725e212b42fabe7d7cd5080e7906a22986bc6103b134b7445540bd39ccdd" Jun 09 14:00:42.434699 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:00:42.434681 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3bb725e212b42fabe7d7cd5080e7906a22986bc6103b134b7445540bd39ccdd\": container with ID starting with e3bb725e212b42fabe7d7cd5080e7906a22986bc6103b134b7445540bd39ccdd not found: ID does not exist" containerID="e3bb725e212b42fabe7d7cd5080e7906a22986bc6103b134b7445540bd39ccdd" Jun 09 14:00:42.434740 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:42.434710 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3bb725e212b42fabe7d7cd5080e7906a22986bc6103b134b7445540bd39ccdd"} err="failed to get container status \"e3bb725e212b42fabe7d7cd5080e7906a22986bc6103b134b7445540bd39ccdd\": rpc error: code = NotFound desc = could not find container \"e3bb725e212b42fabe7d7cd5080e7906a22986bc6103b134b7445540bd39ccdd\": container with ID starting with e3bb725e212b42fabe7d7cd5080e7906a22986bc6103b134b7445540bd39ccdd not found: ID does not exist" Jun 09 14:00:42.443693 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:42.443667 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dc49f7b7c-nmqww"] Jun 09 14:00:42.454954 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:42.454923 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7dc49f7b7c-nmqww"] Jun 09 14:00:43.945961 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:43.945916 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="503f0625-d458-40cc-a2ba-ff0a64a661c4" path="/var/lib/kubelet/pods/503f0625-d458-40cc-a2ba-ff0a64a661c4/volumes" Jun 09 14:00:45.664604 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.664566 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69879bcb5f-6c7hm"] Jun 09 14:00:45.665188 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.665167 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="503f0625-d458-40cc-a2ba-ff0a64a661c4" containerName="manager" Jun 09 14:00:45.665188 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.665189 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="503f0625-d458-40cc-a2ba-ff0a64a661c4" containerName="manager" Jun 09 14:00:45.665308 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.665269 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="503f0625-d458-40cc-a2ba-ff0a64a661c4" containerName="manager" Jun 09 14:00:45.669896 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.669869 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.683703 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.683679 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69879bcb5f-6c7hm"] Jun 09 14:00:45.729365 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.729332 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:00:45.749565 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.749539 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-service-ca\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.749655 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.749589 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-trusted-ca-bundle\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.749655 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.749616 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vghh4\" (UniqueName: \"kubernetes.io/projected/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-kube-api-access-vghh4\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.749655 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.749643 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-console-serving-cert\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.749769 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.749677 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-oauth-serving-cert\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.749769 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.749693 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-console-config\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.749769 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.749722 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-console-oauth-config\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.782562 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.782534 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:00:45.850513 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.850481 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-service-ca\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.850656 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.850554 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-trusted-ca-bundle\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.850656 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.850581 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghh4\" (UniqueName: \"kubernetes.io/projected/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-kube-api-access-vghh4\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.850656 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.850607 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-console-serving-cert\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.850786 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.850660 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-oauth-serving-cert\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.850786 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.850681 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-console-config\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.850786 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.850715 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-console-oauth-config\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.851312 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.851287 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-service-ca\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.851459 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.851384 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-oauth-serving-cert\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.851745 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.851721 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-console-config\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.851792 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.851724 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-trusted-ca-bundle\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.853319 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.853297 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-console-serving-cert\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.853418 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.853389 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-console-oauth-config\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.859200 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.859183 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vghh4\" (UniqueName: \"kubernetes.io/projected/5a9d6d7f-aacc-428e-bd9a-a05af97e0c20-kube-api-access-vghh4\") pod \"console-69879bcb5f-6c7hm\" (UID: \"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20\") " pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:45.980777 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:45.980688 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:46.126114 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:46.126086 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69879bcb5f-6c7hm"] Jun 09 14:00:46.127325 ip-10-0-136-4 kubenswrapper[2558]: W0609 14:00:46.127297 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a9d6d7f_aacc_428e_bd9a_a05af97e0c20.slice/crio-e602bc8e38288e6fcc02c059596c96c5bac8a26266b5af6e12f513a2e69731d5 WatchSource:0}: Error finding container e602bc8e38288e6fcc02c059596c96c5bac8a26266b5af6e12f513a2e69731d5: Status 404 returned error can't find the container with id e602bc8e38288e6fcc02c059596c96c5bac8a26266b5af6e12f513a2e69731d5 Jun 09 14:00:46.451636 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:46.451596 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69879bcb5f-6c7hm" event={"ID":"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20","Type":"ContainerStarted","Data":"c046b62cf61394a4e9bb92fe01633690dc7f3012bfbe94069da05293d18a9835"} Jun 09 14:00:46.451827 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:46.451652 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69879bcb5f-6c7hm" event={"ID":"5a9d6d7f-aacc-428e-bd9a-a05af97e0c20","Type":"ContainerStarted","Data":"e602bc8e38288e6fcc02c059596c96c5bac8a26266b5af6e12f513a2e69731d5"} Jun 09 14:00:46.470594 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:46.470541 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69879bcb5f-6c7hm" podStartSLOduration=1.470524534 podStartE2EDuration="1.470524534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:00:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:00:46.469569724 +0000 UTC m=+940.917292082" watchObservedRunningTime="2026-06-09 14:00:46.470524534 +0000 UTC m=+940.918246887" Jun 09 14:00:55.981631 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:55.981595 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:55.982036 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:55.981663 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:55.987546 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:55.987523 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:56.517135 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:56.517109 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69879bcb5f-6c7hm" Jun 09 14:00:56.571954 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:56.571923 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7784c4597-trblb"] Jun 09 14:00:56.681224 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:56.681192 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:00:56.781763 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:56.781683 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:00:56.869406 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:00:56.869371 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:01:01.601166 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:01.601123 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:01:01.645461 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:01.645420 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-746566c6c4-99crn"] Jun 09 14:01:01.649720 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:01.649703 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-746566c6c4-99crn" Jun 09 14:01:01.652449 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:01.652423 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 09 14:01:01.652618 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:01.652467 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-68pd8\"" Jun 09 14:01:01.652698 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:01.652661 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 14:01:01.653524 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:01.653508 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 14:01:01.658532 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:01.658261 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-746566c6c4-99crn"] Jun 09 14:01:01.712853 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:01.712818 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a4d2e54-9cef-48ad-bdee-40adf1ae51e7-maas-api-tls\") pod \"maas-api-746566c6c4-99crn\" (UID: \"0a4d2e54-9cef-48ad-bdee-40adf1ae51e7\") " pod="redhat-ai-gateway-infra/maas-api-746566c6c4-99crn" Jun 09 14:01:01.713065 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:01.712905 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cprzd\" (UniqueName: \"kubernetes.io/projected/0a4d2e54-9cef-48ad-bdee-40adf1ae51e7-kube-api-access-cprzd\") pod \"maas-api-746566c6c4-99crn\" (UID: \"0a4d2e54-9cef-48ad-bdee-40adf1ae51e7\") " pod="redhat-ai-gateway-infra/maas-api-746566c6c4-99crn" Jun 09 14:01:01.813767 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:01.813727 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cprzd\" (UniqueName: \"kubernetes.io/projected/0a4d2e54-9cef-48ad-bdee-40adf1ae51e7-kube-api-access-cprzd\") pod \"maas-api-746566c6c4-99crn\" (UID: \"0a4d2e54-9cef-48ad-bdee-40adf1ae51e7\") " pod="redhat-ai-gateway-infra/maas-api-746566c6c4-99crn" Jun 09 14:01:01.813966 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:01.813853 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a4d2e54-9cef-48ad-bdee-40adf1ae51e7-maas-api-tls\") pod \"maas-api-746566c6c4-99crn\" (UID: \"0a4d2e54-9cef-48ad-bdee-40adf1ae51e7\") " pod="redhat-ai-gateway-infra/maas-api-746566c6c4-99crn" Jun 09 14:01:01.814042 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:01:01.814006 2558 secret.go:189] Couldn't get secret redhat-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 09 14:01:01.814089 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:01:01.814073 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a4d2e54-9cef-48ad-bdee-40adf1ae51e7-maas-api-tls podName:0a4d2e54-9cef-48ad-bdee-40adf1ae51e7 nodeName:}" failed. No retries permitted until 2026-06-09 14:01:02.31405767 +0000 UTC m=+956.761780004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0a4d2e54-9cef-48ad-bdee-40adf1ae51e7-maas-api-tls") pod "maas-api-746566c6c4-99crn" (UID: "0a4d2e54-9cef-48ad-bdee-40adf1ae51e7") : secret "maas-api-serving-cert" not found Jun 09 14:01:01.823313 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:01.823287 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cprzd\" (UniqueName: \"kubernetes.io/projected/0a4d2e54-9cef-48ad-bdee-40adf1ae51e7-kube-api-access-cprzd\") pod \"maas-api-746566c6c4-99crn\" (UID: \"0a4d2e54-9cef-48ad-bdee-40adf1ae51e7\") " pod="redhat-ai-gateway-infra/maas-api-746566c6c4-99crn" Jun 09 14:01:02.082901 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.082863 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:01:02.173375 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.173341 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:01:02.223572 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.223536 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-jrm58"] Jun 09 14:01:02.227259 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.227239 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:01:02.231046 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.231027 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 14:01:02.232389 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.232372 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-r44d4\"" Jun 09 14:01:02.246288 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.246260 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-jrm58"] Jun 09 14:01:02.319078 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.319046 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a4d2e54-9cef-48ad-bdee-40adf1ae51e7-maas-api-tls\") pod \"maas-api-746566c6c4-99crn\" (UID: \"0a4d2e54-9cef-48ad-bdee-40adf1ae51e7\") " pod="redhat-ai-gateway-infra/maas-api-746566c6c4-99crn" Jun 09 14:01:02.319263 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.319101 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn2gd\" (UniqueName: \"kubernetes.io/projected/50c5b74a-571e-4800-8cd8-578e6152600b-kube-api-access-kn2gd\") pod \"payload-processing-7c6c859784-jrm58\" (UID: \"50c5b74a-571e-4800-8cd8-578e6152600b\") " pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:01:02.321527 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.321507 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a4d2e54-9cef-48ad-bdee-40adf1ae51e7-maas-api-tls\") pod \"maas-api-746566c6c4-99crn\" (UID: \"0a4d2e54-9cef-48ad-bdee-40adf1ae51e7\") " pod="redhat-ai-gateway-infra/maas-api-746566c6c4-99crn" Jun 09 14:01:02.388105 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.388018 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:01:02.419893 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.419855 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn2gd\" (UniqueName: \"kubernetes.io/projected/50c5b74a-571e-4800-8cd8-578e6152600b-kube-api-access-kn2gd\") pod \"payload-processing-7c6c859784-jrm58\" (UID: \"50c5b74a-571e-4800-8cd8-578e6152600b\") " pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:01:02.429040 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.429008 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn2gd\" (UniqueName: \"kubernetes.io/projected/50c5b74a-571e-4800-8cd8-578e6152600b-kube-api-access-kn2gd\") pod \"payload-processing-7c6c859784-jrm58\" (UID: \"50c5b74a-571e-4800-8cd8-578e6152600b\") " pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:01:02.540349 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.540306 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:01:02.562865 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.562835 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-746566c6c4-99crn" Jun 09 14:01:02.714043 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.714011 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-jrm58"] Jun 09 14:01:02.715158 ip-10-0-136-4 kubenswrapper[2558]: W0609 14:01:02.714930 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c5b74a_571e_4800_8cd8_578e6152600b.slice/crio-d3b890e50b2094a5143e259f6966eaf4433c539023cf0cf4f2f03ee68a1ab11d WatchSource:0}: Error finding container d3b890e50b2094a5143e259f6966eaf4433c539023cf0cf4f2f03ee68a1ab11d: Status 404 returned error can't find the container with id d3b890e50b2094a5143e259f6966eaf4433c539023cf0cf4f2f03ee68a1ab11d Jun 09 14:01:02.717616 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.717597 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:01:02.745322 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:02.744865 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-746566c6c4-99crn"] Jun 09 14:01:02.746406 ip-10-0-136-4 kubenswrapper[2558]: W0609 14:01:02.746376 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a4d2e54_9cef_48ad_bdee_40adf1ae51e7.slice/crio-516d10ec7c6185bf2d1cb0cbacbc34fbb8fcede6dbf7bdb95d64e5aef827489c WatchSource:0}: Error finding container 516d10ec7c6185bf2d1cb0cbacbc34fbb8fcede6dbf7bdb95d64e5aef827489c: Status 404 returned error can't find the container with id 516d10ec7c6185bf2d1cb0cbacbc34fbb8fcede6dbf7bdb95d64e5aef827489c Jun 09 14:01:03.562066 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:03.562025 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-746566c6c4-99crn" event={"ID":"0a4d2e54-9cef-48ad-bdee-40adf1ae51e7","Type":"ContainerStarted","Data":"516d10ec7c6185bf2d1cb0cbacbc34fbb8fcede6dbf7bdb95d64e5aef827489c"} Jun 09 14:01:03.563653 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:03.563622 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" event={"ID":"50c5b74a-571e-4800-8cd8-578e6152600b","Type":"ContainerStarted","Data":"d3b890e50b2094a5143e259f6966eaf4433c539023cf0cf4f2f03ee68a1ab11d"} Jun 09 14:01:05.579244 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:05.579204 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-746566c6c4-99crn" event={"ID":"0a4d2e54-9cef-48ad-bdee-40adf1ae51e7","Type":"ContainerStarted","Data":"6ea92f2a057671c1f3cf8ef27bc5d13f3a5241886d956709a15ce13b104479b4"} Jun 09 14:01:05.579733 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:05.579287 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-746566c6c4-99crn" Jun 09 14:01:05.581180 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:05.581144 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" event={"ID":"50c5b74a-571e-4800-8cd8-578e6152600b","Type":"ContainerStarted","Data":"a2058dcba339fa2179c837d66fa0927424d5ebfc39d83e77b1e578d586cfec2c"} Jun 09 14:01:05.581294 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:05.581207 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:01:05.618373 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:05.618314 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podStartSLOduration=1.398671966 podStartE2EDuration="3.618294772s" totalImagesPullingTime="2.219622806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:01:05.615941147 +0000 UTC m=+960.063663504" watchObservedRunningTime="2026-06-09 14:01:05.618294772 +0000 UTC m=+960.066017154" Jun 09 14:01:05.619323 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:05.619291 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-746566c6c4-99crn" podStartSLOduration=2.427676472 podStartE2EDuration="4.619283213s" totalImagesPullingTime="2.191606741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:01:05.599249482 +0000 UTC m=+960.046971839" watchObservedRunningTime="2026-06-09 14:01:05.619283213 +0000 UTC m=+960.067005570" Jun 09 14:01:10.621498 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:10.621459 2558 generic.go:356] "Generic (PLEG): container finished" podID="d571bcab-0030-44bc-a20b-879906afd588" containerID="fa92dd5bdaa516b1a94a822c6b8132fc6fbfa07b04b409d57ce27de75bb9f046" exitCode=0 Jun 09 14:01:10.621938 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:10.621536 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" event={"ID":"d571bcab-0030-44bc-a20b-879906afd588","Type":"ContainerDied","Data":"fa92dd5bdaa516b1a94a822c6b8132fc6fbfa07b04b409d57ce27de75bb9f046"} Jun 09 14:01:10.622010 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:10.621945 2558 scope.go:117] "RemoveContainer" containerID="fa92dd5bdaa516b1a94a822c6b8132fc6fbfa07b04b409d57ce27de75bb9f046" Jun 09 14:01:10.622954 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:10.622928 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 14:01:10.623033 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:10.623006 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 14:01:10.623077 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:10.623038 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 14:01:11.602327 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:11.602281 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-746566c6c4-99crn" Jun 09 14:01:11.630956 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:11.630917 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" event={"ID":"d571bcab-0030-44bc-a20b-879906afd588","Type":"ContainerStarted","Data":"1f2ba06915ed70c2c5a489e59b115d335cc79492592e6b4739ef158ee1a8394d"} Jun 09 14:01:11.726828 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:11.726792 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 14:01:11.727154 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:11.727133 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-952cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Jun 09 14:01:11.727213 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:11.727180 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" podUID="d571bcab-0030-44bc-a20b-879906afd588" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Jun 09 14:01:12.726406 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:12.726360 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-952cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Jun 09 14:01:12.726837 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:12.726429 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" podUID="d571bcab-0030-44bc-a20b-879906afd588" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Jun 09 14:01:13.726512 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:13.726475 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-952cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Jun 09 14:01:13.726931 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:13.726537 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" podUID="d571bcab-0030-44bc-a20b-879906afd588" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Jun 09 14:01:14.727122 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:14.727085 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-952cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Jun 09 14:01:14.727531 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:14.727145 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" podUID="d571bcab-0030-44bc-a20b-879906afd588" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Jun 09 14:01:15.145066 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:15.145033 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:01:15.731159 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:15.731124 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 14:01:15.731616 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:15.731596 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 14:01:15.732262 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:15.732240 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-952cc" Jun 09 14:01:16.591545 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:16.591516 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:01:21.593544 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:21.593502 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7784c4597-trblb" podUID="e9315e63-9f22-4984-9e57-7de0674cbc88" containerName="console" containerID="cri-o://92cdbb59532201a072ffe655efd40b3f31371fd1d51e489e329f0f03447378e4" gracePeriod=15 Jun 09 14:01:21.846221 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:21.846160 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7784c4597-trblb" Jun 09 14:01:22.023280 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.023246 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-trusted-ca-bundle\") pod \"e9315e63-9f22-4984-9e57-7de0674cbc88\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " Jun 09 14:01:22.023481 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.023287 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx9lg\" (UniqueName: \"kubernetes.io/projected/e9315e63-9f22-4984-9e57-7de0674cbc88-kube-api-access-mx9lg\") pod \"e9315e63-9f22-4984-9e57-7de0674cbc88\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " Jun 09 14:01:22.023481 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.023317 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-console-config\") pod \"e9315e63-9f22-4984-9e57-7de0674cbc88\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " Jun 09 14:01:22.023481 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.023398 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9315e63-9f22-4984-9e57-7de0674cbc88-console-oauth-config\") pod \"e9315e63-9f22-4984-9e57-7de0674cbc88\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " Jun 09 14:01:22.023481 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.023432 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-oauth-serving-cert\") pod \"e9315e63-9f22-4984-9e57-7de0674cbc88\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " Jun 09 14:01:22.023481 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.023448 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9315e63-9f22-4984-9e57-7de0674cbc88-console-serving-cert\") pod \"e9315e63-9f22-4984-9e57-7de0674cbc88\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " Jun 09 14:01:22.023481 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.023472 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-service-ca\") pod \"e9315e63-9f22-4984-9e57-7de0674cbc88\" (UID: \"e9315e63-9f22-4984-9e57-7de0674cbc88\") " Jun 09 14:01:22.023869 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.023847 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e9315e63-9f22-4984-9e57-7de0674cbc88" (UID: "e9315e63-9f22-4984-9e57-7de0674cbc88"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:01:22.023933 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.023865 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-console-config" (OuterVolumeSpecName: "console-config") pod "e9315e63-9f22-4984-9e57-7de0674cbc88" (UID: "e9315e63-9f22-4984-9e57-7de0674cbc88"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:01:22.023933 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.023869 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e9315e63-9f22-4984-9e57-7de0674cbc88" (UID: "e9315e63-9f22-4984-9e57-7de0674cbc88"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:01:22.024048 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.023941 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-service-ca" (OuterVolumeSpecName: "service-ca") pod "e9315e63-9f22-4984-9e57-7de0674cbc88" (UID: "e9315e63-9f22-4984-9e57-7de0674cbc88"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:01:22.025820 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.025796 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9315e63-9f22-4984-9e57-7de0674cbc88-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e9315e63-9f22-4984-9e57-7de0674cbc88" (UID: "e9315e63-9f22-4984-9e57-7de0674cbc88"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:01:22.025938 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.025818 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9315e63-9f22-4984-9e57-7de0674cbc88-kube-api-access-mx9lg" (OuterVolumeSpecName: "kube-api-access-mx9lg") pod "e9315e63-9f22-4984-9e57-7de0674cbc88" (UID: "e9315e63-9f22-4984-9e57-7de0674cbc88"). InnerVolumeSpecName "kube-api-access-mx9lg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:01:22.026123 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.026105 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9315e63-9f22-4984-9e57-7de0674cbc88-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e9315e63-9f22-4984-9e57-7de0674cbc88" (UID: "e9315e63-9f22-4984-9e57-7de0674cbc88"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:01:22.125023 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.124927 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9315e63-9f22-4984-9e57-7de0674cbc88-console-oauth-config\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:01:22.125023 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.124953 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-oauth-serving-cert\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:01:22.125023 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.124962 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9315e63-9f22-4984-9e57-7de0674cbc88-console-serving-cert\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:01:22.125023 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.124971 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-service-ca\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:01:22.125023 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.125003 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-trusted-ca-bundle\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:01:22.125023 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.125011 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx9lg\" (UniqueName: \"kubernetes.io/projected/e9315e63-9f22-4984-9e57-7de0674cbc88-kube-api-access-mx9lg\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:01:22.125023 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.125021 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9315e63-9f22-4984-9e57-7de0674cbc88-console-config\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:01:22.702117 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.702078 2558 generic.go:356] "Generic (PLEG): container finished" podID="e9315e63-9f22-4984-9e57-7de0674cbc88" containerID="92cdbb59532201a072ffe655efd40b3f31371fd1d51e489e329f0f03447378e4" exitCode=0 Jun 09 14:01:22.702531 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.702143 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7784c4597-trblb" Jun 09 14:01:22.702531 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.702166 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7784c4597-trblb" event={"ID":"e9315e63-9f22-4984-9e57-7de0674cbc88","Type":"ContainerDied","Data":"92cdbb59532201a072ffe655efd40b3f31371fd1d51e489e329f0f03447378e4"} Jun 09 14:01:22.702531 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.702242 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7784c4597-trblb" event={"ID":"e9315e63-9f22-4984-9e57-7de0674cbc88","Type":"ContainerDied","Data":"15fceccb66db7a4e046aa4c4bf4b4993a379ae0a9f69da0f2951c27f49776bc8"} Jun 09 14:01:22.702531 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.702263 2558 scope.go:117] "RemoveContainer" containerID="92cdbb59532201a072ffe655efd40b3f31371fd1d51e489e329f0f03447378e4" Jun 09 14:01:22.715217 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.715166 2558 scope.go:117] "RemoveContainer" containerID="92cdbb59532201a072ffe655efd40b3f31371fd1d51e489e329f0f03447378e4" Jun 09 14:01:22.715797 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:01:22.715771 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92cdbb59532201a072ffe655efd40b3f31371fd1d51e489e329f0f03447378e4\": container with ID starting with 92cdbb59532201a072ffe655efd40b3f31371fd1d51e489e329f0f03447378e4 not found: ID does not exist" containerID="92cdbb59532201a072ffe655efd40b3f31371fd1d51e489e329f0f03447378e4" Jun 09 14:01:22.715911 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.715802 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92cdbb59532201a072ffe655efd40b3f31371fd1d51e489e329f0f03447378e4"} err="failed to get container status \"92cdbb59532201a072ffe655efd40b3f31371fd1d51e489e329f0f03447378e4\": rpc error: code = NotFound desc = could not find container \"92cdbb59532201a072ffe655efd40b3f31371fd1d51e489e329f0f03447378e4\": container with ID starting with 92cdbb59532201a072ffe655efd40b3f31371fd1d51e489e329f0f03447378e4 not found: ID does not exist" Jun 09 14:01:22.731396 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.731364 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7784c4597-trblb"] Jun 09 14:01:22.734973 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:22.734947 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7784c4597-trblb"] Jun 09 14:01:23.946223 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:23.946139 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9315e63-9f22-4984-9e57-7de0674cbc88" path="/var/lib/kubelet/pods/e9315e63-9f22-4984-9e57-7de0674cbc88/volumes" Jun 09 14:01:51.341731 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.341691 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cdcd7fbfb-kdxrp"] Jun 09 14:01:51.342210 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.342133 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9315e63-9f22-4984-9e57-7de0674cbc88" containerName="console" Jun 09 14:01:51.342210 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.342146 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9315e63-9f22-4984-9e57-7de0674cbc88" containerName="console" Jun 09 14:01:51.342292 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.342227 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9315e63-9f22-4984-9e57-7de0674cbc88" containerName="console" Jun 09 14:01:51.345156 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.345134 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" Jun 09 14:01:51.348031 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.348010 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 14:01:51.353558 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.353531 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cdcd7fbfb-kdxrp"] Jun 09 14:01:51.507442 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.507407 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-tls-cert\") pod \"authorino-7cdcd7fbfb-kdxrp\" (UID: \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\") " pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" Jun 09 14:01:51.507442 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.507445 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f574c\" (UniqueName: \"kubernetes.io/projected/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-kube-api-access-f574c\") pod \"authorino-7cdcd7fbfb-kdxrp\" (UID: \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\") " pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" Jun 09 14:01:51.507668 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.507528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-oidc-ca\") pod \"authorino-7cdcd7fbfb-kdxrp\" (UID: \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\") " pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" Jun 09 14:01:51.609083 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.608957 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-oidc-ca\") pod \"authorino-7cdcd7fbfb-kdxrp\" (UID: \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\") " pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" Jun 09 14:01:51.609236 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.609110 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-tls-cert\") pod \"authorino-7cdcd7fbfb-kdxrp\" (UID: \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\") " pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" Jun 09 14:01:51.609236 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.609139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f574c\" (UniqueName: \"kubernetes.io/projected/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-kube-api-access-f574c\") pod \"authorino-7cdcd7fbfb-kdxrp\" (UID: \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\") " pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" Jun 09 14:01:51.609709 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.609689 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-oidc-ca\") pod \"authorino-7cdcd7fbfb-kdxrp\" (UID: \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\") " pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" Jun 09 14:01:51.611780 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.611752 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-tls-cert\") pod \"authorino-7cdcd7fbfb-kdxrp\" (UID: \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\") " pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" Jun 09 14:01:51.617625 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.617605 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f574c\" (UniqueName: \"kubernetes.io/projected/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-kube-api-access-f574c\") pod \"authorino-7cdcd7fbfb-kdxrp\" (UID: \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\") " pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" Jun 09 14:01:51.655647 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.655608 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" Jun 09 14:01:51.823762 ip-10-0-136-4 kubenswrapper[2558]: W0609 14:01:51.823727 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65456a51_ff69_4e3f_abcc_acb6f79ba6a0.slice/crio-5d697fc105e499dc86d2529fb34b2478de4431aa20057bd73bb8c7bde8d70222 WatchSource:0}: Error finding container 5d697fc105e499dc86d2529fb34b2478de4431aa20057bd73bb8c7bde8d70222: Status 404 returned error can't find the container with id 5d697fc105e499dc86d2529fb34b2478de4431aa20057bd73bb8c7bde8d70222 Jun 09 14:01:51.830385 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.830357 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cdcd7fbfb-kdxrp"] Jun 09 14:01:51.877432 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:51.877347 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" event={"ID":"65456a51-ff69-4e3f-abcc-acb6f79ba6a0","Type":"ContainerStarted","Data":"5d697fc105e499dc86d2529fb34b2478de4431aa20057bd73bb8c7bde8d70222"} Jun 09 14:01:52.885398 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:52.885359 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" event={"ID":"65456a51-ff69-4e3f-abcc-acb6f79ba6a0","Type":"ContainerStarted","Data":"e7bf56265f09f3415f9099d5dcedbbc59887c63d8bfff37aa1bded018155c1af"} Jun 09 14:01:52.922669 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:52.922605 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" podStartSLOduration=1.537779132 podStartE2EDuration="1.92258296s" totalImagesPullingTime="384.803828ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:01:52.918708395 +0000 UTC m=+1007.366430755" watchObservedRunningTime="2026-06-09 14:01:52.92258296 +0000 UTC m=+1007.370305319" Jun 09 14:01:52.965282 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:52.965246 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fd47695fd-8hxrw"] Jun 09 14:01:52.965452 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:52.965412 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-fd47695fd-8hxrw" podUID="32b82025-b4b4-442a-8194-1668a7c60d22" containerName="authorino" containerID="cri-o://d640d37b07275a4558e3bda347e2f5dc9f57038fe2911098f780567c32c15214" gracePeriod=30 Jun 09 14:01:53.234909 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.234878 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd47695fd-8hxrw" Jun 09 14:01:53.326625 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.326587 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32b82025-b4b4-442a-8194-1668a7c60d22-tls-cert\") pod \"32b82025-b4b4-442a-8194-1668a7c60d22\" (UID: \"32b82025-b4b4-442a-8194-1668a7c60d22\") " Jun 09 14:01:53.326790 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.326644 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwk8v\" (UniqueName: \"kubernetes.io/projected/32b82025-b4b4-442a-8194-1668a7c60d22-kube-api-access-xwk8v\") pod \"32b82025-b4b4-442a-8194-1668a7c60d22\" (UID: \"32b82025-b4b4-442a-8194-1668a7c60d22\") " Jun 09 14:01:53.328957 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.328922 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32b82025-b4b4-442a-8194-1668a7c60d22-kube-api-access-xwk8v" (OuterVolumeSpecName: "kube-api-access-xwk8v") pod "32b82025-b4b4-442a-8194-1668a7c60d22" (UID: "32b82025-b4b4-442a-8194-1668a7c60d22"). InnerVolumeSpecName "kube-api-access-xwk8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:01:53.339118 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.339084 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32b82025-b4b4-442a-8194-1668a7c60d22-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "32b82025-b4b4-442a-8194-1668a7c60d22" (UID: "32b82025-b4b4-442a-8194-1668a7c60d22"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:01:53.409216 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.409123 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:01:53.427464 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.427422 2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32b82025-b4b4-442a-8194-1668a7c60d22-tls-cert\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:01:53.427464 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.427457 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwk8v\" (UniqueName: \"kubernetes.io/projected/32b82025-b4b4-442a-8194-1668a7c60d22-kube-api-access-xwk8v\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:01:53.507484 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.507448 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:01:53.893226 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.893186 2558 generic.go:356] "Generic (PLEG): container finished" podID="32b82025-b4b4-442a-8194-1668a7c60d22" containerID="d640d37b07275a4558e3bda347e2f5dc9f57038fe2911098f780567c32c15214" exitCode=0 Jun 09 14:01:53.893675 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.893232 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd47695fd-8hxrw" Jun 09 14:01:53.893675 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.893268 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fd47695fd-8hxrw" event={"ID":"32b82025-b4b4-442a-8194-1668a7c60d22","Type":"ContainerDied","Data":"d640d37b07275a4558e3bda347e2f5dc9f57038fe2911098f780567c32c15214"} Jun 09 14:01:53.893675 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.893316 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fd47695fd-8hxrw" event={"ID":"32b82025-b4b4-442a-8194-1668a7c60d22","Type":"ContainerDied","Data":"5494484963b39a3a13c4367bfd65b48adfba6c82df8d5747ccf0a5ec79a0df96"} Jun 09 14:01:53.893675 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.893334 2558 scope.go:117] "RemoveContainer" containerID="d640d37b07275a4558e3bda347e2f5dc9f57038fe2911098f780567c32c15214" Jun 09 14:01:53.903222 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.903208 2558 scope.go:117] "RemoveContainer" containerID="d640d37b07275a4558e3bda347e2f5dc9f57038fe2911098f780567c32c15214" Jun 09 14:01:53.903500 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:01:53.903481 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d640d37b07275a4558e3bda347e2f5dc9f57038fe2911098f780567c32c15214\": container with ID starting with d640d37b07275a4558e3bda347e2f5dc9f57038fe2911098f780567c32c15214 not found: ID does not exist" containerID="d640d37b07275a4558e3bda347e2f5dc9f57038fe2911098f780567c32c15214" Jun 09 14:01:53.903548 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.903511 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d640d37b07275a4558e3bda347e2f5dc9f57038fe2911098f780567c32c15214"} err="failed to get container status \"d640d37b07275a4558e3bda347e2f5dc9f57038fe2911098f780567c32c15214\": rpc error: code = NotFound desc = could not find container \"d640d37b07275a4558e3bda347e2f5dc9f57038fe2911098f780567c32c15214\": container with ID starting with d640d37b07275a4558e3bda347e2f5dc9f57038fe2911098f780567c32c15214 not found: ID does not exist" Jun 09 14:01:53.923383 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.923356 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fd47695fd-8hxrw"] Jun 09 14:01:53.929879 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.929849 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-fd47695fd-8hxrw"] Jun 09 14:01:53.947058 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:53.947032 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32b82025-b4b4-442a-8194-1668a7c60d22" path="/var/lib/kubelet/pods/32b82025-b4b4-442a-8194-1668a7c60d22/volumes" Jun 09 14:01:57.037165 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:01:57.037128 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:02:09.785974 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.785938 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps"] Jun 09 14:02:09.786513 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.786491 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b82025-b4b4-442a-8194-1668a7c60d22" containerName="authorino" Jun 09 14:02:09.786562 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.786520 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b82025-b4b4-442a-8194-1668a7c60d22" containerName="authorino" Jun 09 14:02:09.786626 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.786614 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="32b82025-b4b4-442a-8194-1668a7c60d22" containerName="authorino" Jun 09 14:02:09.790175 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.790155 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.792860 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.792837 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 14:02:09.794904 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.794272 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 14:02:09.794904 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.794354 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-csvmt\"" Jun 09 14:02:09.794904 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.794289 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 09 14:02:09.798799 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.798645 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps"] Jun 09 14:02:09.813633 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.813600 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:02:09.874424 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.874381 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfxlq\" (UniqueName: \"kubernetes.io/projected/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-kube-api-access-lfxlq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.874594 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.874426 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.874594 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.874477 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.874594 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.874527 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.874594 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.874574 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.874767 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.874687 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.975502 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.975464 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.975695 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.975529 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfxlq\" (UniqueName: \"kubernetes.io/projected/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-kube-api-access-lfxlq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.975695 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.975549 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.975695 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.975567 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.975695 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.975600 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.975695 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.975689 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.976048 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.976027 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.976126 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.976068 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.976228 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.976206 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.977968 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.977946 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.978225 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.978204 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:09.983865 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:09.983838 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfxlq\" (UniqueName: \"kubernetes.io/projected/7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0-kube-api-access-lfxlq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vb8ps\" (UID: \"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:10.102607 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:10.102514 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:10.249231 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:10.249202 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps"] Jun 09 14:02:10.251271 ip-10-0-136-4 kubenswrapper[2558]: W0609 14:02:10.251237 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad0aab7_3d5c_4e4b_b60d_0c6fa79d53c0.slice/crio-457354ac7cee22ad7a2cd932e0a0631402bae35978485b207d67bfea074b7ea5 WatchSource:0}: Error finding container 457354ac7cee22ad7a2cd932e0a0631402bae35978485b207d67bfea074b7ea5: Status 404 returned error can't find the container with id 457354ac7cee22ad7a2cd932e0a0631402bae35978485b207d67bfea074b7ea5 Jun 09 14:02:11.006596 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:11.006556 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" event={"ID":"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0","Type":"ContainerStarted","Data":"457354ac7cee22ad7a2cd932e0a0631402bae35978485b207d67bfea074b7ea5"} Jun 09 14:02:14.030214 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:14.030174 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" event={"ID":"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0","Type":"ContainerStarted","Data":"0d54fe779b650450cc52e900aadacd618ec22d83c1ca64b7ae1e50cf2596d297"} Jun 09 14:02:15.037791 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:15.037749 2558 generic.go:356] "Generic (PLEG): container finished" podID="7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0" containerID="0d54fe779b650450cc52e900aadacd618ec22d83c1ca64b7ae1e50cf2596d297" exitCode=0 Jun 09 14:02:15.038196 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:15.037871 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" event={"ID":"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0","Type":"ContainerDied","Data":"0d54fe779b650450cc52e900aadacd618ec22d83c1ca64b7ae1e50cf2596d297"} Jun 09 14:02:17.874175 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:17.874138 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:02:21.077175 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:21.077137 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" event={"ID":"7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0","Type":"ContainerStarted","Data":"2850695029fc48aba0a60ad7e0fc9a58ed559197f87c595852ac8c65cb5a5d36"} Jun 09 14:02:21.097313 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:21.097255 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" podStartSLOduration=2.259355405 podStartE2EDuration="12.097235579s" totalImagesPullingTime="8.518978041s" totalInitContainerRuntime="1.318902133s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:02:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:02:21.095054118 +0000 UTC m=+1035.542776475" watchObservedRunningTime="2026-06-09 14:02:21.097235579 +0000 UTC m=+1035.544957935" Jun 09 14:02:24.683760 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:24.683725 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:02:30.103136 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:30.103087 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:30.103136 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:30.103160 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:30.117155 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:30.117118 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:30.144419 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:30.144372 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vb8ps" Jun 09 14:02:36.323824 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:36.323779 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:02:38.915081 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:38.915037 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:02:42.720727 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:42.720663 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:02:55.184886 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.184794 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9"] Jun 09 14:02:55.198745 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.198713 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.201757 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.201732 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 09 14:02:55.202170 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.202147 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9"] Jun 09 14:02:55.208860 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.208836 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:02:55.212784 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.212763 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.212898 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.212808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f8b7\" (UniqueName: \"kubernetes.io/projected/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-kube-api-access-5f8b7\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.212898 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.212888 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.213044 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.212940 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.213044 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.213017 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.213137 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.213061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.313469 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.313434 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f8b7\" (UniqueName: \"kubernetes.io/projected/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-kube-api-access-5f8b7\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.313665 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.313479 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.313665 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.313510 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.313665 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.313550 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.313665 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.313586 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.313665 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.313642 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.313943 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.313919 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.314013 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.313959 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.314083 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.314011 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.316047 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.316021 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.316296 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.316278 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.324908 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.324881 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f8b7\" (UniqueName: \"kubernetes.io/projected/d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589-kube-api-access-5f8b7\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2dmg9\" (UID: \"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.510554 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.510520 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:02:55.656714 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:55.656685 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9"] Jun 09 14:02:55.658185 ip-10-0-136-4 kubenswrapper[2558]: W0609 14:02:55.658159 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a2ac9e_dcbe_4fac_8f7e_d2c87f0ac589.slice/crio-e931d156ec194c623c5a5b903ec3d8fb84997830f9ea4ebdfaeb12f19e539dfc WatchSource:0}: Error finding container e931d156ec194c623c5a5b903ec3d8fb84997830f9ea4ebdfaeb12f19e539dfc: Status 404 returned error can't find the container with id e931d156ec194c623c5a5b903ec3d8fb84997830f9ea4ebdfaeb12f19e539dfc Jun 09 14:02:56.299396 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:56.299337 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" event={"ID":"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589","Type":"ContainerStarted","Data":"cbea10ce7da5e6c84aa20546e7395a3c188a00d681efe87850e49e81fc425d0f"} Jun 09 14:02:56.299869 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:56.299412 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" event={"ID":"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589","Type":"ContainerStarted","Data":"e931d156ec194c623c5a5b903ec3d8fb84997830f9ea4ebdfaeb12f19e539dfc"} Jun 09 14:02:57.307313 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:57.307202 2558 generic.go:356] "Generic (PLEG): container finished" podID="d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589" containerID="cbea10ce7da5e6c84aa20546e7395a3c188a00d681efe87850e49e81fc425d0f" exitCode=0 Jun 09 14:02:57.307313 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:57.307266 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" event={"ID":"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589","Type":"ContainerDied","Data":"cbea10ce7da5e6c84aa20546e7395a3c188a00d681efe87850e49e81fc425d0f"} Jun 09 14:02:58.315356 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:58.315309 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" event={"ID":"d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589","Type":"ContainerStarted","Data":"ee61c42a8003d33b3b384caafb798a97071d69860cc166b0560d1a33c853ef9e"} Jun 09 14:02:58.335020 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:02:58.334948 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" podStartSLOduration=1.6944502350000001 podStartE2EDuration="3.334931872s" totalImagesPullingTime="306.984429ms" totalInitContainerRuntime="1.333497208s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:02:58.334548007 +0000 UTC m=+1072.782270362" watchObservedRunningTime="2026-06-09 14:02:58.334931872 +0000 UTC m=+1072.782654298" Jun 09 14:03:05.355883 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:03:05.355848 2558 generic.go:356] "Generic (PLEG): container finished" podID="50c5b74a-571e-4800-8cd8-578e6152600b" containerID="a2058dcba339fa2179c837d66fa0927424d5ebfc39d83e77b1e578d586cfec2c" exitCode=1 Jun 09 14:03:05.356302 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:03:05.355920 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" event={"ID":"50c5b74a-571e-4800-8cd8-578e6152600b","Type":"ContainerDied","Data":"a2058dcba339fa2179c837d66fa0927424d5ebfc39d83e77b1e578d586cfec2c"} Jun 09 14:03:05.356302 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:03:05.356294 2558 scope.go:117] "RemoveContainer" containerID="a2058dcba339fa2179c837d66fa0927424d5ebfc39d83e77b1e578d586cfec2c" Jun 09 14:03:05.510654 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:03:05.510621 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:03:05.510871 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:03:05.510739 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:03:05.523025 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:03:05.522975 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:03:06.364313 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:03:06.364272 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" event={"ID":"50c5b74a-571e-4800-8cd8-578e6152600b","Type":"ContainerStarted","Data":"7e00ee3a4f60bab88d908224fb3c06d34a443c7f3161fb166086b3b9e84df319"} Jun 09 14:03:06.364734 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:03:06.364638 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:03:06.375638 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:03:06.375613 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2dmg9" Jun 09 14:03:17.372575 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:03:17.372541 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:04:09.355018 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:09.354848 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:04:09.448294 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:09.448249 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:04:10.030890 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.030847 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7cdcd7fbfb-kdxrp"] Jun 09 14:04:10.031153 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.031125 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" podUID="65456a51-ff69-4e3f-abcc-acb6f79ba6a0" containerName="authorino" containerID="cri-o://e7bf56265f09f3415f9099d5dcedbbc59887c63d8bfff37aa1bded018155c1af" gracePeriod=30 Jun 09 14:04:10.294895 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.294811 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" Jun 09 14:04:10.452841 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.452798 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-tls-cert\") pod \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\" (UID: \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\") " Jun 09 14:04:10.453324 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.452847 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f574c\" (UniqueName: \"kubernetes.io/projected/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-kube-api-access-f574c\") pod \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\" (UID: \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\") " Jun 09 14:04:10.453324 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.452914 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-oidc-ca\") pod \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\" (UID: \"65456a51-ff69-4e3f-abcc-acb6f79ba6a0\") " Jun 09 14:04:10.455194 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.455161 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:04:10.455453 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.455432 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-kube-api-access-f574c" (OuterVolumeSpecName: "kube-api-access-f574c") pod "65456a51-ff69-4e3f-abcc-acb6f79ba6a0" (UID: "65456a51-ff69-4e3f-abcc-acb6f79ba6a0"). InnerVolumeSpecName "kube-api-access-f574c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:04:10.460065 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.460032 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "65456a51-ff69-4e3f-abcc-acb6f79ba6a0" (UID: "65456a51-ff69-4e3f-abcc-acb6f79ba6a0"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:04:10.464806 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.464785 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "65456a51-ff69-4e3f-abcc-acb6f79ba6a0" (UID: "65456a51-ff69-4e3f-abcc-acb6f79ba6a0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:04:10.550232 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.550118 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:04:10.554466 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.554443 2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-tls-cert\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:04:10.554551 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.554469 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f574c\" (UniqueName: \"kubernetes.io/projected/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-kube-api-access-f574c\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:04:10.554551 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.554479 2558 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/65456a51-ff69-4e3f-abcc-acb6f79ba6a0-oidc-ca\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:04:10.770381 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.770343 2558 generic.go:356] "Generic (PLEG): container finished" podID="65456a51-ff69-4e3f-abcc-acb6f79ba6a0" containerID="e7bf56265f09f3415f9099d5dcedbbc59887c63d8bfff37aa1bded018155c1af" exitCode=0 Jun 09 14:04:10.770557 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.770390 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" Jun 09 14:04:10.770557 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.770393 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" event={"ID":"65456a51-ff69-4e3f-abcc-acb6f79ba6a0","Type":"ContainerDied","Data":"e7bf56265f09f3415f9099d5dcedbbc59887c63d8bfff37aa1bded018155c1af"} Jun 09 14:04:10.770557 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.770508 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cdcd7fbfb-kdxrp" event={"ID":"65456a51-ff69-4e3f-abcc-acb6f79ba6a0","Type":"ContainerDied","Data":"5d697fc105e499dc86d2529fb34b2478de4431aa20057bd73bb8c7bde8d70222"} Jun 09 14:04:10.770557 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.770531 2558 scope.go:117] "RemoveContainer" containerID="e7bf56265f09f3415f9099d5dcedbbc59887c63d8bfff37aa1bded018155c1af" Jun 09 14:04:10.781005 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.780967 2558 scope.go:117] "RemoveContainer" containerID="e7bf56265f09f3415f9099d5dcedbbc59887c63d8bfff37aa1bded018155c1af" Jun 09 14:04:10.781253 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:04:10.781235 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7bf56265f09f3415f9099d5dcedbbc59887c63d8bfff37aa1bded018155c1af\": container with ID starting with e7bf56265f09f3415f9099d5dcedbbc59887c63d8bfff37aa1bded018155c1af not found: ID does not exist" containerID="e7bf56265f09f3415f9099d5dcedbbc59887c63d8bfff37aa1bded018155c1af" Jun 09 14:04:10.781304 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.781263 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7bf56265f09f3415f9099d5dcedbbc59887c63d8bfff37aa1bded018155c1af"} err="failed to get container status \"e7bf56265f09f3415f9099d5dcedbbc59887c63d8bfff37aa1bded018155c1af\": rpc error: code = NotFound desc = could not find container \"e7bf56265f09f3415f9099d5dcedbbc59887c63d8bfff37aa1bded018155c1af\": container with ID starting with e7bf56265f09f3415f9099d5dcedbbc59887c63d8bfff37aa1bded018155c1af not found: ID does not exist" Jun 09 14:04:10.793927 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.793902 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7cdcd7fbfb-kdxrp"] Jun 09 14:04:10.800933 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:10.800869 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7cdcd7fbfb-kdxrp"] Jun 09 14:04:11.947266 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:04:11.947232 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65456a51-ff69-4e3f-abcc-acb6f79ba6a0" path="/var/lib/kubelet/pods/65456a51-ff69-4e3f-abcc-acb6f79ba6a0/volumes" Jun 09 14:05:06.014529 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:06.014495 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gp8mh_94fe717f-e61a-483a-bac8-be82ca3c7dc2/ovn-acl-logging/0.log" Jun 09 14:05:06.020830 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:06.020806 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gp8mh_94fe717f-e61a-483a-bac8-be82ca3c7dc2/ovn-acl-logging/0.log" Jun 09 14:05:06.114868 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:06.114829 2558 generic.go:356] "Generic (PLEG): container finished" podID="50c5b74a-571e-4800-8cd8-578e6152600b" containerID="7e00ee3a4f60bab88d908224fb3c06d34a443c7f3161fb166086b3b9e84df319" exitCode=1 Jun 09 14:05:06.115065 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:06.114902 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" event={"ID":"50c5b74a-571e-4800-8cd8-578e6152600b","Type":"ContainerDied","Data":"7e00ee3a4f60bab88d908224fb3c06d34a443c7f3161fb166086b3b9e84df319"} Jun 09 14:05:06.115065 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:06.114974 2558 scope.go:117] "RemoveContainer" containerID="a2058dcba339fa2179c837d66fa0927424d5ebfc39d83e77b1e578d586cfec2c" Jun 09 14:05:06.115383 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:06.115363 2558 scope.go:117] "RemoveContainer" containerID="7e00ee3a4f60bab88d908224fb3c06d34a443c7f3161fb166086b3b9e84df319" Jun 09 14:05:06.115696 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:05:06.115667 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:05:07.370117 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:07.370078 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:05:07.370518 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:07.370424 2558 scope.go:117] "RemoveContainer" containerID="7e00ee3a4f60bab88d908224fb3c06d34a443c7f3161fb166086b3b9e84df319" Jun 09 14:05:07.370663 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:05:07.370643 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:05:18.940106 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:18.940071 2558 scope.go:117] "RemoveContainer" containerID="7e00ee3a4f60bab88d908224fb3c06d34a443c7f3161fb166086b3b9e84df319" Jun 09 14:05:19.199656 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:19.199552 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" event={"ID":"50c5b74a-571e-4800-8cd8-578e6152600b","Type":"ContainerStarted","Data":"fccd2489f20637ae0aa3a10f93215081e244abfc43d86896c0b66b620315d230"} Jun 09 14:05:19.199822 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:19.199799 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:05:30.208032 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:30.207976 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:05:36.635510 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:36.635474 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:05:36.737486 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:36.737446 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78776866f5-sfjnh"] Jun 09 14:05:36.737694 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:36.737666 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-78776866f5-sfjnh" podUID="088b2e52-aa95-44c4-b53b-8a1de082fa9c" containerName="manager" containerID="cri-o://d97c0ce86ebbc5bddda0c0cd9ab2df27d436dc5572e8604d211fd78a3f69f5d5" gracePeriod=30 Jun 09 14:05:37.003865 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.003841 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78776866f5-sfjnh" Jun 09 14:05:37.102084 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.102049 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/088b2e52-aa95-44c4-b53b-8a1de082fa9c-webhook-cert\") pod \"088b2e52-aa95-44c4-b53b-8a1de082fa9c\" (UID: \"088b2e52-aa95-44c4-b53b-8a1de082fa9c\") " Jun 09 14:05:37.102256 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.102171 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-777sg\" (UniqueName: \"kubernetes.io/projected/088b2e52-aa95-44c4-b53b-8a1de082fa9c-kube-api-access-777sg\") pod \"088b2e52-aa95-44c4-b53b-8a1de082fa9c\" (UID: \"088b2e52-aa95-44c4-b53b-8a1de082fa9c\") " Jun 09 14:05:37.104449 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.104422 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/088b2e52-aa95-44c4-b53b-8a1de082fa9c-kube-api-access-777sg" (OuterVolumeSpecName: "kube-api-access-777sg") pod "088b2e52-aa95-44c4-b53b-8a1de082fa9c" (UID: "088b2e52-aa95-44c4-b53b-8a1de082fa9c"). InnerVolumeSpecName "kube-api-access-777sg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:05:37.104449 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.104435 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/088b2e52-aa95-44c4-b53b-8a1de082fa9c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "088b2e52-aa95-44c4-b53b-8a1de082fa9c" (UID: "088b2e52-aa95-44c4-b53b-8a1de082fa9c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:05:37.203471 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.203388 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/088b2e52-aa95-44c4-b53b-8a1de082fa9c-webhook-cert\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:05:37.203471 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.203418 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-777sg\" (UniqueName: \"kubernetes.io/projected/088b2e52-aa95-44c4-b53b-8a1de082fa9c-kube-api-access-777sg\") on node \"ip-10-0-136-4.ec2.internal\" DevicePath \"\"" Jun 09 14:05:37.313259 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.313227 2558 generic.go:356] "Generic (PLEG): container finished" podID="088b2e52-aa95-44c4-b53b-8a1de082fa9c" containerID="d97c0ce86ebbc5bddda0c0cd9ab2df27d436dc5572e8604d211fd78a3f69f5d5" exitCode=0 Jun 09 14:05:37.313445 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.313269 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78776866f5-sfjnh" Jun 09 14:05:37.313445 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.313302 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78776866f5-sfjnh" event={"ID":"088b2e52-aa95-44c4-b53b-8a1de082fa9c","Type":"ContainerDied","Data":"d97c0ce86ebbc5bddda0c0cd9ab2df27d436dc5572e8604d211fd78a3f69f5d5"} Jun 09 14:05:37.313445 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.313345 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78776866f5-sfjnh" event={"ID":"088b2e52-aa95-44c4-b53b-8a1de082fa9c","Type":"ContainerDied","Data":"6562954cc8c9ec4461592f5c31ea9311048d9f8998a5939c23ea4618b693bc5f"} Jun 09 14:05:37.313445 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.313369 2558 scope.go:117] "RemoveContainer" containerID="d97c0ce86ebbc5bddda0c0cd9ab2df27d436dc5572e8604d211fd78a3f69f5d5" Jun 09 14:05:37.324580 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.324555 2558 scope.go:117] "RemoveContainer" containerID="d97c0ce86ebbc5bddda0c0cd9ab2df27d436dc5572e8604d211fd78a3f69f5d5" Jun 09 14:05:37.324821 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:05:37.324798 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d97c0ce86ebbc5bddda0c0cd9ab2df27d436dc5572e8604d211fd78a3f69f5d5\": container with ID starting with d97c0ce86ebbc5bddda0c0cd9ab2df27d436dc5572e8604d211fd78a3f69f5d5 not found: ID does not exist" containerID="d97c0ce86ebbc5bddda0c0cd9ab2df27d436dc5572e8604d211fd78a3f69f5d5" Jun 09 14:05:37.324879 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.324828 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d97c0ce86ebbc5bddda0c0cd9ab2df27d436dc5572e8604d211fd78a3f69f5d5"} err="failed to get container status \"d97c0ce86ebbc5bddda0c0cd9ab2df27d436dc5572e8604d211fd78a3f69f5d5\": rpc error: code = NotFound desc = could not find container \"d97c0ce86ebbc5bddda0c0cd9ab2df27d436dc5572e8604d211fd78a3f69f5d5\": container with ID starting with d97c0ce86ebbc5bddda0c0cd9ab2df27d436dc5572e8604d211fd78a3f69f5d5 not found: ID does not exist" Jun 09 14:05:37.338243 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.338214 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78776866f5-sfjnh"] Jun 09 14:05:37.341610 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.341583 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-78776866f5-sfjnh"] Jun 09 14:05:37.946832 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.946799 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="088b2e52-aa95-44c4-b53b-8a1de082fa9c" path="/var/lib/kubelet/pods/088b2e52-aa95-44c4-b53b-8a1de082fa9c/volumes" Jun 09 14:05:37.994381 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:37.994348 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:05:38.112288 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.112253 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78776866f5-ndtn2"] Jun 09 14:05:38.112668 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.112656 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65456a51-ff69-4e3f-abcc-acb6f79ba6a0" containerName="authorino" Jun 09 14:05:38.112717 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.112671 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="65456a51-ff69-4e3f-abcc-acb6f79ba6a0" containerName="authorino" Jun 09 14:05:38.112717 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.112687 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="088b2e52-aa95-44c4-b53b-8a1de082fa9c" containerName="manager" Jun 09 14:05:38.112717 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.112693 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="088b2e52-aa95-44c4-b53b-8a1de082fa9c" containerName="manager" Jun 09 14:05:38.112813 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.112791 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="65456a51-ff69-4e3f-abcc-acb6f79ba6a0" containerName="authorino" Jun 09 14:05:38.112813 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.112801 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="088b2e52-aa95-44c4-b53b-8a1de082fa9c" containerName="manager" Jun 09 14:05:38.117294 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.117276 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78776866f5-ndtn2" Jun 09 14:05:38.120134 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.120111 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mkxqb\"" Jun 09 14:05:38.120266 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.120208 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 14:05:38.121124 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.121109 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 14:05:38.126156 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.126134 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78776866f5-ndtn2"] Jun 09 14:05:38.210865 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.210776 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1688937d-03c1-4bf9-be65-db526a14cb0f-webhook-cert\") pod \"maas-controller-78776866f5-ndtn2\" (UID: \"1688937d-03c1-4bf9-be65-db526a14cb0f\") " pod="opendatahub/maas-controller-78776866f5-ndtn2" Jun 09 14:05:38.211035 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.210908 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4gft\" (UniqueName: \"kubernetes.io/projected/1688937d-03c1-4bf9-be65-db526a14cb0f-kube-api-access-s4gft\") pod \"maas-controller-78776866f5-ndtn2\" (UID: \"1688937d-03c1-4bf9-be65-db526a14cb0f\") " pod="opendatahub/maas-controller-78776866f5-ndtn2" Jun 09 14:05:38.312014 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.311940 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4gft\" (UniqueName: \"kubernetes.io/projected/1688937d-03c1-4bf9-be65-db526a14cb0f-kube-api-access-s4gft\") pod \"maas-controller-78776866f5-ndtn2\" (UID: \"1688937d-03c1-4bf9-be65-db526a14cb0f\") " pod="opendatahub/maas-controller-78776866f5-ndtn2" Jun 09 14:05:38.312214 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.312042 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1688937d-03c1-4bf9-be65-db526a14cb0f-webhook-cert\") pod \"maas-controller-78776866f5-ndtn2\" (UID: \"1688937d-03c1-4bf9-be65-db526a14cb0f\") " pod="opendatahub/maas-controller-78776866f5-ndtn2" Jun 09 14:05:38.314787 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.314756 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1688937d-03c1-4bf9-be65-db526a14cb0f-webhook-cert\") pod \"maas-controller-78776866f5-ndtn2\" (UID: \"1688937d-03c1-4bf9-be65-db526a14cb0f\") " pod="opendatahub/maas-controller-78776866f5-ndtn2" Jun 09 14:05:38.321194 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.321166 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4gft\" (UniqueName: \"kubernetes.io/projected/1688937d-03c1-4bf9-be65-db526a14cb0f-kube-api-access-s4gft\") pod \"maas-controller-78776866f5-ndtn2\" (UID: \"1688937d-03c1-4bf9-be65-db526a14cb0f\") " pod="opendatahub/maas-controller-78776866f5-ndtn2" Jun 09 14:05:38.429887 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.429840 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78776866f5-ndtn2" Jun 09 14:05:38.571524 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:38.571493 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78776866f5-ndtn2"] Jun 09 14:05:38.572145 ip-10-0-136-4 kubenswrapper[2558]: W0609 14:05:38.572122 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1688937d_03c1_4bf9_be65_db526a14cb0f.slice/crio-66535a394f6daa10c10997844673ce40da59a2f4fa110b7384a20726f886d1ec WatchSource:0}: Error finding container 66535a394f6daa10c10997844673ce40da59a2f4fa110b7384a20726f886d1ec: Status 404 returned error can't find the container with id 66535a394f6daa10c10997844673ce40da59a2f4fa110b7384a20726f886d1ec Jun 09 14:05:39.330706 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:39.330604 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78776866f5-ndtn2" event={"ID":"1688937d-03c1-4bf9-be65-db526a14cb0f","Type":"ContainerStarted","Data":"bee48d412a655dadc83a7fcc6af9e78751bce2253a7932688fad22623bf49852"} Jun 09 14:05:39.330706 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:39.330700 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78776866f5-ndtn2" event={"ID":"1688937d-03c1-4bf9-be65-db526a14cb0f","Type":"ContainerStarted","Data":"66535a394f6daa10c10997844673ce40da59a2f4fa110b7384a20726f886d1ec"} Jun 09 14:05:39.331127 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:39.330724 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78776866f5-ndtn2" Jun 09 14:05:39.350756 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:39.350696 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78776866f5-ndtn2" podStartSLOduration=0.85327062 podStartE2EDuration="1.350680032s" totalImagesPullingTime="497.409412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:05:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:05:39.34843426 +0000 UTC m=+1233.796156641" watchObservedRunningTime="2026-06-09 14:05:39.350680032 +0000 UTC m=+1233.798402387" Jun 09 14:05:50.343038 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:05:50.342971 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78776866f5-ndtn2" Jun 09 14:06:13.232188 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:06:13.232153 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:06:17.876319 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:06:17.876270 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:06:17.963641 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:06:17.963603 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:06:18.229008 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:06:18.228900 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:06:18.704956 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:06:18.704919 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:06:18.812338 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:06:18.812297 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:06:22.713452 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:06:22.713408 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:06:26.441657 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:06:26.441620 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:06:32.810466 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:06:32.810417 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:06:32.946225 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:06:32.946185 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:06:53.433791 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:06:53.433742 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:05.082947 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:05.082898 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:05.244948 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:05.244896 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:05.372861 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:05.372767 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:06.128590 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:06.128530 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:06.291278 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:06.291240 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:19.957035 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:19.956999 2558 generic.go:356] "Generic (PLEG): container finished" podID="50c5b74a-571e-4800-8cd8-578e6152600b" containerID="fccd2489f20637ae0aa3a10f93215081e244abfc43d86896c0b66b620315d230" exitCode=1 Jun 09 14:07:19.957499 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:19.957071 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" event={"ID":"50c5b74a-571e-4800-8cd8-578e6152600b","Type":"ContainerDied","Data":"fccd2489f20637ae0aa3a10f93215081e244abfc43d86896c0b66b620315d230"} Jun 09 14:07:19.957499 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:19.957143 2558 scope.go:117] "RemoveContainer" containerID="7e00ee3a4f60bab88d908224fb3c06d34a443c7f3161fb166086b3b9e84df319" Jun 09 14:07:19.957587 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:19.957537 2558 scope.go:117] "RemoveContainer" containerID="fccd2489f20637ae0aa3a10f93215081e244abfc43d86896c0b66b620315d230" Jun 09 14:07:19.957765 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:07:19.957742 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:07:20.206521 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:20.206488 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:07:20.964831 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:20.964800 2558 scope.go:117] "RemoveContainer" containerID="fccd2489f20637ae0aa3a10f93215081e244abfc43d86896c0b66b620315d230" Jun 09 14:07:20.965234 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:07:20.965061 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:07:22.540564 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:22.540525 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:07:22.541013 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:22.540910 2558 scope.go:117] "RemoveContainer" containerID="fccd2489f20637ae0aa3a10f93215081e244abfc43d86896c0b66b620315d230" Jun 09 14:07:22.541119 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:07:22.541096 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:07:29.026615 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:29.026526 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:33.940244 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:33.940212 2558 scope.go:117] "RemoveContainer" containerID="fccd2489f20637ae0aa3a10f93215081e244abfc43d86896c0b66b620315d230" Jun 09 14:07:33.940635 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:07:33.940418 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:07:35.535849 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:35.535814 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:35.641401 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:35.641359 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:35.736714 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:35.736681 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:35.868332 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:35.868226 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:35.964385 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:35.964354 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:47.940356 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:47.940324 2558 scope.go:117] "RemoveContainer" containerID="fccd2489f20637ae0aa3a10f93215081e244abfc43d86896c0b66b620315d230" Jun 09 14:07:48.127318 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:48.127281 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" event={"ID":"50c5b74a-571e-4800-8cd8-578e6152600b","Type":"ContainerStarted","Data":"be7edbc5f501fbcf197d5b1c66ae4f667931c4cbf3cc9724c5628620e8705caa"} Jun 09 14:07:48.127508 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:48.127492 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:07:52.414050 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:52.414007 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:52.539679 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:52.539641 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:52.647927 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:52.647890 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:59.136529 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:59.136494 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:07:59.278519 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:59.278482 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:07:59.358353 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:07:59.358318 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:05.985358 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:05.985321 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:06.044722 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:06.044690 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:06.773536 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:06.773491 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:06.888719 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:06.888662 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:07.001165 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:07.001128 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:23.453658 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:23.453612 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:23.584130 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:23.584093 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:23.686865 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:23.686833 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:29.721450 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:29.721413 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:29.790400 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:29.790361 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:52.394039 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:52.393995 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:52.493799 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:52.493765 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:52.614661 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:52.614628 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:58.500803 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:58.500721 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:58.603968 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:58.603914 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:58.700859 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:58.700818 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:08:58.820294 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:08:58.820216 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:09:04.615679 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:09:04.615641 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:09:04.715448 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:09:04.715404 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:09:48.888295 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:09:48.888253 2558 generic.go:356] "Generic (PLEG): container finished" podID="50c5b74a-571e-4800-8cd8-578e6152600b" containerID="be7edbc5f501fbcf197d5b1c66ae4f667931c4cbf3cc9724c5628620e8705caa" exitCode=1 Jun 09 14:09:48.888819 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:09:48.888321 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" event={"ID":"50c5b74a-571e-4800-8cd8-578e6152600b","Type":"ContainerDied","Data":"be7edbc5f501fbcf197d5b1c66ae4f667931c4cbf3cc9724c5628620e8705caa"} Jun 09 14:09:48.888819 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:09:48.888384 2558 scope.go:117] "RemoveContainer" containerID="fccd2489f20637ae0aa3a10f93215081e244abfc43d86896c0b66b620315d230" Jun 09 14:09:48.888819 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:09:48.888764 2558 scope.go:117] "RemoveContainer" containerID="be7edbc5f501fbcf197d5b1c66ae4f667931c4cbf3cc9724c5628620e8705caa" Jun 09 14:09:48.889138 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:09:48.889113 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:09:49.135053 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:09:49.135020 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:09:49.900294 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:09:49.900265 2558 scope.go:117] "RemoveContainer" containerID="be7edbc5f501fbcf197d5b1c66ae4f667931c4cbf3cc9724c5628620e8705caa" Jun 09 14:09:49.900677 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:09:49.900487 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:10:02.541415 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:10:02.541377 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:10:02.541806 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:10:02.541755 2558 scope.go:117] "RemoveContainer" containerID="be7edbc5f501fbcf197d5b1c66ae4f667931c4cbf3cc9724c5628620e8705caa" Jun 09 14:10:02.542017 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:10:02.541967 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:10:06.060757 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:10:06.060729 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gp8mh_94fe717f-e61a-483a-bac8-be82ca3c7dc2/ovn-acl-logging/0.log" Jun 09 14:10:06.067942 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:10:06.067919 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gp8mh_94fe717f-e61a-483a-bac8-be82ca3c7dc2/ovn-acl-logging/0.log" Jun 09 14:10:12.940341 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:10:12.940304 2558 scope.go:117] "RemoveContainer" containerID="be7edbc5f501fbcf197d5b1c66ae4f667931c4cbf3cc9724c5628620e8705caa" Jun 09 14:10:12.940731 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:10:12.940531 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:10:25.016777 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:10:25.016687 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:10:25.943555 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:10:25.943526 2558 scope.go:117] "RemoveContainer" containerID="be7edbc5f501fbcf197d5b1c66ae4f667931c4cbf3cc9724c5628620e8705caa" Jun 09 14:10:25.943737 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:10:25.943711 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:10:36.662615 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:10:36.662578 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:10:36.940480 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:10:36.940379 2558 scope.go:117] "RemoveContainer" containerID="be7edbc5f501fbcf197d5b1c66ae4f667931c4cbf3cc9724c5628620e8705caa" Jun 09 14:10:37.193455 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:10:37.193350 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" event={"ID":"50c5b74a-571e-4800-8cd8-578e6152600b","Type":"ContainerStarted","Data":"abea414aabdb59a65a98380a3fa5e051f2e363044f9b0b0b6a54c5ef97d8f94f"} Jun 09 14:10:37.193636 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:10:37.193619 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:10:45.733228 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:10:45.733187 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:10:48.201900 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:10:48.201860 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:10:59.713085 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:10:59.713043 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:11:00.135312 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:11:00.135269 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:11:00.235440 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:11:00.235407 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:12:37.952174 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:12:37.952137 2558 generic.go:356] "Generic (PLEG): container finished" podID="50c5b74a-571e-4800-8cd8-578e6152600b" containerID="abea414aabdb59a65a98380a3fa5e051f2e363044f9b0b0b6a54c5ef97d8f94f" exitCode=1 Jun 09 14:12:37.952718 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:12:37.952212 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" event={"ID":"50c5b74a-571e-4800-8cd8-578e6152600b","Type":"ContainerDied","Data":"abea414aabdb59a65a98380a3fa5e051f2e363044f9b0b0b6a54c5ef97d8f94f"} Jun 09 14:12:37.952718 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:12:37.952279 2558 scope.go:117] "RemoveContainer" containerID="be7edbc5f501fbcf197d5b1c66ae4f667931c4cbf3cc9724c5628620e8705caa" Jun 09 14:12:37.952718 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:12:37.952610 2558 scope.go:117] "RemoveContainer" containerID="abea414aabdb59a65a98380a3fa5e051f2e363044f9b0b0b6a54c5ef97d8f94f" Jun 09 14:12:37.952928 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:12:37.952903 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:12:38.200062 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:12:38.200028 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:12:38.961101 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:12:38.961069 2558 scope.go:117] "RemoveContainer" containerID="abea414aabdb59a65a98380a3fa5e051f2e363044f9b0b0b6a54c5ef97d8f94f" Jun 09 14:12:38.961527 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:12:38.961303 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:12:42.540914 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:12:42.540876 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:12:42.541349 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:12:42.541302 2558 scope.go:117] "RemoveContainer" containerID="abea414aabdb59a65a98380a3fa5e051f2e363044f9b0b0b6a54c5ef97d8f94f" Jun 09 14:12:42.541565 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:12:42.541545 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:12:55.943376 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:12:55.943345 2558 scope.go:117] "RemoveContainer" containerID="abea414aabdb59a65a98380a3fa5e051f2e363044f9b0b0b6a54c5ef97d8f94f" Jun 09 14:12:55.943757 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:12:55.943581 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:13:10.940259 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:10.940227 2558 scope.go:117] "RemoveContainer" containerID="abea414aabdb59a65a98380a3fa5e051f2e363044f9b0b0b6a54c5ef97d8f94f" Jun 09 14:13:10.940939 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:13:10.940418 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:13:21.939901 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:21.939862 2558 scope.go:117] "RemoveContainer" containerID="abea414aabdb59a65a98380a3fa5e051f2e363044f9b0b0b6a54c5ef97d8f94f" Jun 09 14:13:21.940439 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:13:21.940150 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:13:33.940747 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:33.940657 2558 scope.go:117] "RemoveContainer" containerID="abea414aabdb59a65a98380a3fa5e051f2e363044f9b0b0b6a54c5ef97d8f94f" Jun 09 14:13:33.941161 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:13:33.940841 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:13:40.485629 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:40.485589 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5f4cf5f6dc-cb5lt_76f28e95-3427-404e-ae80-9673e4fe5f9d/nginx/0.log" Jun 09 14:13:40.952885 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:40.952799 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-78776866f5-ndtn2_1688937d-03c1-4bf9-be65-db526a14cb0f/manager/0.log" Jun 09 14:13:41.412453 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:41.412423 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7877c79489-zgnch_ac446fd7-d6e3-4c90-ba24-c7bfac040e85/copy-manifests/0.log" Jun 09 14:13:41.420224 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:41.420200 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7877c79489-zgnch_ac446fd7-d6e3-4c90-ba24-c7bfac040e85/manager/0.log" Jun 09 14:13:42.317159 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:42.317131 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw_4f066217-5758-41e5-8cd2-b7db3d329dd7/util/0.log" Jun 09 14:13:42.324130 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:42.324103 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw_4f066217-5758-41e5-8cd2-b7db3d329dd7/pull/0.log" Jun 09 14:13:42.331039 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:42.331018 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw_4f066217-5758-41e5-8cd2-b7db3d329dd7/extract/0.log" Jun 09 14:13:42.443215 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:42.443182 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr_186eef70-b03c-4b7e-8676-e0e59ccdc629/util/0.log" Jun 09 14:13:42.450245 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:42.450218 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr_186eef70-b03c-4b7e-8676-e0e59ccdc629/pull/0.log" Jun 09 14:13:42.456195 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:42.456170 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr_186eef70-b03c-4b7e-8676-e0e59ccdc629/extract/0.log" Jun 09 14:13:42.564604 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:42.564573 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh_0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c/util/0.log" Jun 09 14:13:42.571275 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:42.571199 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh_0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c/pull/0.log" Jun 09 14:13:42.577590 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:42.577563 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh_0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c/extract/0.log" Jun 09 14:13:42.686849 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:42.686817 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v_a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0/util/0.log" Jun 09 14:13:42.693332 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:42.693313 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v_a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0/pull/0.log" Jun 09 14:13:42.699477 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:42.699454 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v_a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0/extract/0.log" Jun 09 14:13:43.268124 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:43.268087 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bgjl6_7f65958a-cdba-482b-bca8-93e80f36d383/registry-server/0.log" Jun 09 14:13:43.390382 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:43.390351 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-grqt5_b36046e5-fbbf-4405-ad97-63db7fb48101/manager/0.log" Jun 09 14:13:43.644088 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:43.644007 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-znzsq_1fa374f4-b237-45cd-ae18-1a454c6003b4/manager/0.log" Jun 09 14:13:44.006990 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:44.006949 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795bsrxl_6aa33ab1-78d7-4cc5-906c-03f6131f1ec6/istio-proxy/0.log" Jun 09 14:13:44.462491 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:44.462405 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-952cc_d571bcab-0030-44bc-a20b-879906afd588/istio-proxy/1.log" Jun 09 14:13:44.694468 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:44.694437 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jrm58_50c5b74a-571e-4800-8cd8-578e6152600b/payload-processing/4.log" Jun 09 14:13:44.809532 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:44.809504 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-668858dbc7-7wp8j_6d34e2ed-b066-4106-a582-9a90c7d0cbaf/router/0.log" Jun 09 14:13:45.266315 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:45.266284 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-vb8ps_7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0/storage-initializer/0.log" Jun 09 14:13:45.274788 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:45.274766 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-vb8ps_7ad0aab7-3d5c-4e4b-b60d-0c6fa79d53c0/main/0.log" Jun 09 14:13:45.734497 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:45.734475 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-2dmg9_d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589/storage-initializer/0.log" Jun 09 14:13:45.741893 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:45.741869 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-2dmg9_d5a2ac9e-dcbe-4fac-8f7e-d2c87f0ac589/main/0.log" Jun 09 14:13:46.939871 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:46.939841 2558 scope.go:117] "RemoveContainer" containerID="abea414aabdb59a65a98380a3fa5e051f2e363044f9b0b0b6a54c5ef97d8f94f" Jun 09 14:13:46.940319 ip-10-0-136-4 kubenswrapper[2558]: E0609 14:13:46.940088 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jrm58_openshift-ingress(50c5b74a-571e-4800-8cd8-578e6152600b)\"" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" podUID="50c5b74a-571e-4800-8cd8-578e6152600b" Jun 09 14:13:50.333305 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.333276 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-747d5/must-gather-fwkfs"] Jun 09 14:13:50.337000 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.336951 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-747d5/must-gather-fwkfs" Jun 09 14:13:50.339814 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.339792 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-747d5\"/\"kube-root-ca.crt\"" Jun 09 14:13:50.339814 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.339808 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-747d5\"/\"default-dockercfg-pntdp\"" Jun 09 14:13:50.340875 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.340856 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-747d5\"/\"openshift-service-ca.crt\"" Jun 09 14:13:50.347028 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.347005 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-747d5/must-gather-fwkfs"] Jun 09 14:13:50.362615 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.362581 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:13:50.405011 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.404965 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/90395ca8-bb77-4753-9ef2-693ccd3ce3a2-must-gather-output\") pod \"must-gather-fwkfs\" (UID: \"90395ca8-bb77-4753-9ef2-693ccd3ce3a2\") " pod="openshift-must-gather-747d5/must-gather-fwkfs" Jun 09 14:13:50.405126 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.405074 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7wnm\" (UniqueName: \"kubernetes.io/projected/90395ca8-bb77-4753-9ef2-693ccd3ce3a2-kube-api-access-h7wnm\") pod \"must-gather-fwkfs\" (UID: \"90395ca8-bb77-4753-9ef2-693ccd3ce3a2\") " pod="openshift-must-gather-747d5/must-gather-fwkfs" Jun 09 14:13:50.423097 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.423068 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:13:50.506379 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.506343 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/90395ca8-bb77-4753-9ef2-693ccd3ce3a2-must-gather-output\") pod \"must-gather-fwkfs\" (UID: \"90395ca8-bb77-4753-9ef2-693ccd3ce3a2\") " pod="openshift-must-gather-747d5/must-gather-fwkfs" Jun 09 14:13:50.506534 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.506426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7wnm\" (UniqueName: \"kubernetes.io/projected/90395ca8-bb77-4753-9ef2-693ccd3ce3a2-kube-api-access-h7wnm\") pod \"must-gather-fwkfs\" (UID: \"90395ca8-bb77-4753-9ef2-693ccd3ce3a2\") " pod="openshift-must-gather-747d5/must-gather-fwkfs" Jun 09 14:13:50.506676 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.506657 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/90395ca8-bb77-4753-9ef2-693ccd3ce3a2-must-gather-output\") pod \"must-gather-fwkfs\" (UID: \"90395ca8-bb77-4753-9ef2-693ccd3ce3a2\") " pod="openshift-must-gather-747d5/must-gather-fwkfs" Jun 09 14:13:50.514468 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.514444 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7wnm\" (UniqueName: \"kubernetes.io/projected/90395ca8-bb77-4753-9ef2-693ccd3ce3a2-kube-api-access-h7wnm\") pod \"must-gather-fwkfs\" (UID: \"90395ca8-bb77-4753-9ef2-693ccd3ce3a2\") " pod="openshift-must-gather-747d5/must-gather-fwkfs" Jun 09 14:13:50.647581 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.647499 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-747d5/must-gather-fwkfs" Jun 09 14:13:50.793822 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.790958 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-747d5/must-gather-fwkfs"] Jun 09 14:13:50.798030 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:50.798005 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:13:51.411937 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:51.411898 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-747d5/must-gather-fwkfs" event={"ID":"90395ca8-bb77-4753-9ef2-693ccd3ce3a2","Type":"ContainerStarted","Data":"e29b2b9b0e75238e25b9c3d8a01fb4d781a41f7b5ab2f98ee44d51316165edd1"} Jun 09 14:13:52.420611 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:52.420569 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-747d5/must-gather-fwkfs" event={"ID":"90395ca8-bb77-4753-9ef2-693ccd3ce3a2","Type":"ContainerStarted","Data":"fe0f3388404fe5e8c830aebe0131b20331b88891cc192cda8675be90a2bfb097"} Jun 09 14:13:52.421050 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:52.420628 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-747d5/must-gather-fwkfs" event={"ID":"90395ca8-bb77-4753-9ef2-693ccd3ce3a2","Type":"ContainerStarted","Data":"e177310ae1ef15d0e55dc715c418f5fc800e9689ebdcb0d9e19e7f1f40ba5016"} Jun 09 14:13:52.438907 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:52.438847 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-747d5/must-gather-fwkfs" podStartSLOduration=1.32343509 podStartE2EDuration="2.438829436s" totalImagesPullingTime="1.115394346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:13:52.437551944 +0000 UTC m=+1726.885274299" watchObservedRunningTime="2026-06-09 14:13:52.438829436 +0000 UTC m=+1726.886551793" Jun 09 14:13:53.673222 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:53.673185 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hbqlt_44f2fe44-5b07-4d88-8271-081c442714f6/global-pull-secret-syncer/0.log" Jun 09 14:13:53.730889 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:53.730859 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" Jun 09 14:13:53.809674 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:53.809639 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-4.ec2.internal_b15aebb8a62392542274bac25b50b144/haproxy/0.log" Jun 09 14:13:57.950839 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:57.950790 2558 scope.go:117] "RemoveContainer" containerID="abea414aabdb59a65a98380a3fa5e051f2e363044f9b0b0b6a54c5ef97d8f94f" Jun 09 14:13:58.368906 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.368818 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw_4f066217-5758-41e5-8cd2-b7db3d329dd7/extract/0.log" Jun 09 14:13:58.400749 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.400721 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw_4f066217-5758-41e5-8cd2-b7db3d329dd7/util/0.log" Jun 09 14:13:58.429861 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.429822 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5sw_4f066217-5758-41e5-8cd2-b7db3d329dd7/pull/0.log" Jun 09 14:13:58.473711 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.473685 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr_186eef70-b03c-4b7e-8676-e0e59ccdc629/extract/0.log" Jun 09 14:13:58.475672 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.475634 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" event={"ID":"50c5b74a-571e-4800-8cd8-578e6152600b","Type":"ContainerStarted","Data":"c715ff8e7ee3cefe6bfb02216541e24c3e643a378d072ece93aa722817326128"} Jun 09 14:13:58.475954 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.475937 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:13:58.504325 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.504281 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr_186eef70-b03c-4b7e-8676-e0e59ccdc629/util/0.log" Jun 09 14:13:58.532335 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.532301 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026dkr_186eef70-b03c-4b7e-8676-e0e59ccdc629/pull/0.log" Jun 09 14:13:58.578311 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.578277 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh_0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c/extract/0.log" Jun 09 14:13:58.604138 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.604111 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh_0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c/util/0.log" Jun 09 14:13:58.627767 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.627690 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737s9lh_0ac6da1d-7c1d-4a0a-97b6-86e93628bd5c/pull/0.log" Jun 09 14:13:58.657997 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.657950 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v_a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0/extract/0.log" Jun 09 14:13:58.693425 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.693398 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v_a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0/util/0.log" Jun 09 14:13:58.714649 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.714622 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17bd4v_a10dbe76-ba51-4c4b-a1f7-f6128b91c1e0/pull/0.log" Jun 09 14:13:58.983954 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:58.983866 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bgjl6_7f65958a-cdba-482b-bca8-93e80f36d383/registry-server/0.log" Jun 09 14:13:59.040173 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:59.040145 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-grqt5_b36046e5-fbbf-4405-ad97-63db7fb48101/manager/0.log" Jun 09 14:13:59.129827 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:13:59.129789 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-znzsq_1fa374f4-b237-45cd-ae18-1a454c6003b4/manager/0.log" Jun 09 14:14:00.703096 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:00.703061 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e568b77-2c26-472a-b2b2-3b24e2680877/alertmanager/0.log" Jun 09 14:14:00.728207 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:00.728177 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e568b77-2c26-472a-b2b2-3b24e2680877/config-reloader/0.log" Jun 09 14:14:00.755356 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:00.755328 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e568b77-2c26-472a-b2b2-3b24e2680877/kube-rbac-proxy-web/0.log" Jun 09 14:14:00.780785 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:00.780753 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e568b77-2c26-472a-b2b2-3b24e2680877/kube-rbac-proxy/0.log" Jun 09 14:14:00.803921 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:00.803896 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e568b77-2c26-472a-b2b2-3b24e2680877/kube-rbac-proxy-metric/0.log" Jun 09 14:14:00.826792 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:00.826765 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e568b77-2c26-472a-b2b2-3b24e2680877/prom-label-proxy/0.log" Jun 09 14:14:00.856164 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:00.856136 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e568b77-2c26-472a-b2b2-3b24e2680877/init-config-reloader/0.log" Jun 09 14:14:00.930709 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:00.930673 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mmqfq_58c9f7cd-2acb-4b70-85b6-453047ed70d5/kube-state-metrics/0.log" Jun 09 14:14:00.955100 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:00.954992 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mmqfq_58c9f7cd-2acb-4b70-85b6-453047ed70d5/kube-rbac-proxy-main/0.log" Jun 09 14:14:00.978816 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:00.978784 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mmqfq_58c9f7cd-2acb-4b70-85b6-453047ed70d5/kube-rbac-proxy-self/0.log" Jun 09 14:14:01.012366 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:01.012340 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7ddc94f557-djv7k_20d8c6ae-e027-4938-8a50-6ca22d88f51a/metrics-server/0.log" Jun 09 14:14:01.039104 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:01.039061 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-rwd7s_62c05740-8144-46c4-9a47-01a0b8b6306f/monitoring-plugin/0.log" Jun 09 14:14:01.247666 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:01.247630 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zmssj_b98d3d22-460b-4840-a6cd-42115be15590/node-exporter/0.log" Jun 09 14:14:01.272216 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:01.272184 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zmssj_b98d3d22-460b-4840-a6cd-42115be15590/kube-rbac-proxy/0.log" Jun 09 14:14:01.299065 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:01.299037 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zmssj_b98d3d22-460b-4840-a6cd-42115be15590/init-textfile/0.log" Jun 09 14:14:01.333858 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:01.333821 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rz9l9_4f7b69ea-2645-4d99-b1b3-e64c26e21799/kube-rbac-proxy-main/0.log" Jun 09 14:14:01.364763 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:01.364735 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rz9l9_4f7b69ea-2645-4d99-b1b3-e64c26e21799/kube-rbac-proxy-self/0.log" Jun 09 14:14:01.394936 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:01.394908 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rz9l9_4f7b69ea-2645-4d99-b1b3-e64c26e21799/openshift-state-metrics/0.log" Jun 09 14:14:01.693775 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:01.693694 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-848d4_4b1a137b-1edd-46ae-b325-e9702eb30a31/prometheus-operator-admission-webhook/0.log" Jun 09 14:14:01.732022 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:01.731995 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb956d567-xqkvb_cdd47680-74a0-4491-91cd-244741fe3d5f/telemeter-client/0.log" Jun 09 14:14:01.778092 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:01.778064 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb956d567-xqkvb_cdd47680-74a0-4491-91cd-244741fe3d5f/reload/0.log" Jun 09 14:14:01.811172 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:01.811146 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb956d567-xqkvb_cdd47680-74a0-4491-91cd-244741fe3d5f/kube-rbac-proxy/0.log" Jun 09 14:14:03.447065 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:03.447034 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-sz6zd_41d47fdd-eed4-4d5e-aefe-0c0064e2511f/networking-console-plugin/0.log" Jun 09 14:14:04.637421 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:04.637386 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69879bcb5f-6c7hm_5a9d6d7f-aacc-428e-bd9a-a05af97e0c20/console/0.log" Jun 09 14:14:04.672300 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:04.672267 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-994rw_31fbae42-0c4a-46be-ab35-d9f75106bd57/download-server/0.log" Jun 09 14:14:05.130750 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.130710 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt"] Jun 09 14:14:05.137001 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.136341 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.146435 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.146367 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt"] Jun 09 14:14:05.282588 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.282546 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9de792f2-b496-4485-a2fa-dbbce85b43ef-podres\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.282912 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.282875 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7ff8\" (UniqueName: \"kubernetes.io/projected/9de792f2-b496-4485-a2fa-dbbce85b43ef-kube-api-access-d7ff8\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.283123 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.283100 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9de792f2-b496-4485-a2fa-dbbce85b43ef-proc\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.283297 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.283280 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9de792f2-b496-4485-a2fa-dbbce85b43ef-sys\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.283456 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.283436 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9de792f2-b496-4485-a2fa-dbbce85b43ef-lib-modules\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.384757 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.384660 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9de792f2-b496-4485-a2fa-dbbce85b43ef-lib-modules\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.384927 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.384759 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9de792f2-b496-4485-a2fa-dbbce85b43ef-podres\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.384927 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.384811 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7ff8\" (UniqueName: \"kubernetes.io/projected/9de792f2-b496-4485-a2fa-dbbce85b43ef-kube-api-access-d7ff8\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.384927 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.384865 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9de792f2-b496-4485-a2fa-dbbce85b43ef-proc\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.384927 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.384908 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9de792f2-b496-4485-a2fa-dbbce85b43ef-sys\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.385169 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.384947 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9de792f2-b496-4485-a2fa-dbbce85b43ef-podres\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.385169 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.385046 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9de792f2-b496-4485-a2fa-dbbce85b43ef-sys\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.385169 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.385098 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9de792f2-b496-4485-a2fa-dbbce85b43ef-proc\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.385314 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.385178 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9de792f2-b496-4485-a2fa-dbbce85b43ef-lib-modules\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.399495 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.399459 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7ff8\" (UniqueName: \"kubernetes.io/projected/9de792f2-b496-4485-a2fa-dbbce85b43ef-kube-api-access-d7ff8\") pod \"perf-node-gather-daemonset-zr5vt\" (UID: \"9de792f2-b496-4485-a2fa-dbbce85b43ef\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.457565 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.457519 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:05.660510 ip-10-0-136-4 kubenswrapper[2558]: W0609 14:14:05.660473 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9de792f2_b496_4485_a2fa_dbbce85b43ef.slice/crio-ba2bfd92f4f4343c16f520d15059fc208d2b4a7ce19d308d1746366bbb264707 WatchSource:0}: Error finding container ba2bfd92f4f4343c16f520d15059fc208d2b4a7ce19d308d1746366bbb264707: Status 404 returned error can't find the container with id ba2bfd92f4f4343c16f520d15059fc208d2b4a7ce19d308d1746366bbb264707 Jun 09 14:14:05.664720 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:05.664693 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt"] Jun 09 14:14:06.558525 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:06.558480 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" event={"ID":"9de792f2-b496-4485-a2fa-dbbce85b43ef","Type":"ContainerStarted","Data":"162f216124a7841a7c9db3ebe0198f56e64ae3e17177b03743682cfaade79946"} Jun 09 14:14:06.558736 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:06.558576 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" event={"ID":"9de792f2-b496-4485-a2fa-dbbce85b43ef","Type":"ContainerStarted","Data":"ba2bfd92f4f4343c16f520d15059fc208d2b4a7ce19d308d1746366bbb264707"} Jun 09 14:14:06.559817 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:06.559780 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:06.580407 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:06.580356 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" podStartSLOduration=1.5803396570000001 podStartE2EDuration="1.580339657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:14:06.576787624 +0000 UTC m=+1741.024509982" watchObservedRunningTime="2026-06-09 14:14:06.580339657 +0000 UTC m=+1741.028062013" Jun 09 14:14:06.827234 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:06.827146 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ppk28_32cb4473-dcd4-49a0-a77b-947ef606801b/dns/0.log" Jun 09 14:14:06.852576 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:06.852542 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ppk28_32cb4473-dcd4-49a0-a77b-947ef606801b/kube-rbac-proxy/0.log" Jun 09 14:14:06.903906 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:06.903875 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-96ng8_f3156ddf-2573-4c42-8de4-c0c79ebd8f80/dns-node-resolver/0.log" Jun 09 14:14:07.539262 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:07.539228 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b5lp8_50528af2-db53-4024-bfe0-3a0ec40c3259/node-ca/0.log" Jun 09 14:14:07.824401 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:07.824279 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:14:07.879240 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:07.879205 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d8tz_e6de29a5-52d3-4e8c-b5a6-f283b237e186/konnectivity-agent/0.log" limit=1024 Jun 09 14:14:08.546105 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:08.546069 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795bsrxl_6aa33ab1-78d7-4cc5-906c-03f6131f1ec6/istio-proxy/0.log" Jun 09 14:14:08.683631 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:08.683598 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-952cc_d571bcab-0030-44bc-a20b-879906afd588/istio-proxy/0.log" Jun 09 14:14:08.722630 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:08.722598 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-952cc_d571bcab-0030-44bc-a20b-879906afd588/istio-proxy/1.log" Jun 09 14:14:08.779211 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:08.779175 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jrm58_50c5b74a-571e-4800-8cd8-578e6152600b/payload-processing/5.log" Jun 09 14:14:08.782677 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:08.782644 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jrm58_50c5b74a-571e-4800-8cd8-578e6152600b/payload-processing/4.log" Jun 09 14:14:08.810712 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:08.810619 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-668858dbc7-7wp8j_6d34e2ed-b066-4106-a582-9a90c7d0cbaf/router/0.log" Jun 09 14:14:09.438801 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:09.438763 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8w6fp_0d086613-2feb-4bf5-bcc3-488f6e280503/serve-healthcheck-canary/0.log" Jun 09 14:14:09.487567 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:09.487521 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-jrm58" Jun 09 14:14:10.243777 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:10.243749 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z7jzz_b79ba834-c031-4d6d-84b6-d12e4bcd70c9/kube-rbac-proxy/0.log" Jun 09 14:14:10.269169 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:10.269138 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z7jzz_b79ba834-c031-4d6d-84b6-d12e4bcd70c9/exporter/0.log" Jun 09 14:14:10.291289 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:10.291257 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z7jzz_b79ba834-c031-4d6d-84b6-d12e4bcd70c9/extractor/0.log" Jun 09 14:14:12.510680 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:12.510643 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5f4cf5f6dc-cb5lt_76f28e95-3427-404e-ae80-9673e4fe5f9d/nginx/0.log" Jun 09 14:14:12.667849 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:12.667816 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-78776866f5-ndtn2_1688937d-03c1-4bf9-be65-db526a14cb0f/manager/0.log" Jun 09 14:14:12.908390 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:12.908308 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7877c79489-zgnch_ac446fd7-d6e3-4c90-ba24-c7bfac040e85/manager/0.log" Jun 09 14:14:12.956303 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:12.956273 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7877c79489-zgnch_ac446fd7-d6e3-4c90-ba24-c7bfac040e85/copy-manifests/0.log" Jun 09 14:14:13.586998 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:13.586938 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-747d5/perf-node-gather-daemonset-zr5vt" Jun 09 14:14:14.512462 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:14.512433 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d545c9fcc-j49wl_41ee16e5-3335-4461-95b2-da4c1fb74828/manager/0.log" Jun 09 14:14:19.149823 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:19.149787 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795bsrxl_6aa33ab1-78d7-4cc5-906c-03f6131f1ec6/istio-proxy/0.log" Jun 09 14:14:19.248316 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:19.248280 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-952cc_d571bcab-0030-44bc-a20b-879906afd588/istio-proxy/0.log" Jun 09 14:14:19.274497 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:19.274459 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-952cc_d571bcab-0030-44bc-a20b-879906afd588/istio-proxy/1.log" Jun 09 14:14:19.317718 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:19.317275 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jrm58_50c5b74a-571e-4800-8cd8-578e6152600b/payload-processing/5.log" Jun 09 14:14:19.321481 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:19.321452 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jrm58_50c5b74a-571e-4800-8cd8-578e6152600b/payload-processing/4.log" Jun 09 14:14:19.337066 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:19.337040 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-668858dbc7-7wp8j_6d34e2ed-b066-4106-a582-9a90c7d0cbaf/router/0.log" Jun 09 14:14:20.439900 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:20.439862 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795bsrxl_6aa33ab1-78d7-4cc5-906c-03f6131f1ec6/istio-proxy/0.log" Jun 09 14:14:20.535608 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:20.535570 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-952cc_d571bcab-0030-44bc-a20b-879906afd588/istio-proxy/0.log" Jun 09 14:14:20.563584 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:20.563543 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-952cc_d571bcab-0030-44bc-a20b-879906afd588/istio-proxy/1.log" Jun 09 14:14:20.611726 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:20.611693 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jrm58_50c5b74a-571e-4800-8cd8-578e6152600b/payload-processing/5.log" Jun 09 14:14:20.616258 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:20.616224 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jrm58_50c5b74a-571e-4800-8cd8-578e6152600b/payload-processing/4.log" Jun 09 14:14:20.632777 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:20.632745 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-668858dbc7-7wp8j_6d34e2ed-b066-4106-a582-9a90c7d0cbaf/router/0.log" Jun 09 14:14:20.957757 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:20.957726 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-tczfk_835718d8-f0eb-43eb-abf2-bb692fed6a79/kube-storage-version-migrator-operator/1.log" Jun 09 14:14:20.959229 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:20.959205 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-tczfk_835718d8-f0eb-43eb-abf2-bb692fed6a79/kube-storage-version-migrator-operator/0.log" Jun 09 14:14:22.268954 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.268918 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xk9k_a078366e-c775-4814-add1-59e187ad45ff/kube-multus-additional-cni-plugins/0.log" Jun 09 14:14:22.297487 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.297453 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xk9k_a078366e-c775-4814-add1-59e187ad45ff/egress-router-binary-copy/0.log" Jun 09 14:14:22.325467 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.325441 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xk9k_a078366e-c775-4814-add1-59e187ad45ff/cni-plugins/0.log" Jun 09 14:14:22.356570 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.356531 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xk9k_a078366e-c775-4814-add1-59e187ad45ff/bond-cni-plugin/0.log" Jun 09 14:14:22.370261 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.370231 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795bsrxl_6aa33ab1-78d7-4cc5-906c-03f6131f1ec6/istio-proxy/0.log" Jun 09 14:14:22.384036 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.384013 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xk9k_a078366e-c775-4814-add1-59e187ad45ff/routeoverride-cni/0.log" Jun 09 14:14:22.408315 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.408285 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xk9k_a078366e-c775-4814-add1-59e187ad45ff/whereabouts-cni-bincopy/0.log" Jun 09 14:14:22.444184 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.444151 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xk9k_a078366e-c775-4814-add1-59e187ad45ff/whereabouts-cni/0.log" Jun 09 14:14:22.474158 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.474125 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-952cc_d571bcab-0030-44bc-a20b-879906afd588/istio-proxy/0.log" Jun 09 14:14:22.514267 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.514227 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-952cc_d571bcab-0030-44bc-a20b-879906afd588/istio-proxy/1.log" Jun 09 14:14:22.549721 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.549632 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jrm58_50c5b74a-571e-4800-8cd8-578e6152600b/payload-processing/5.log" Jun 09 14:14:22.554182 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.554154 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jrm58_50c5b74a-571e-4800-8cd8-578e6152600b/payload-processing/4.log" Jun 09 14:14:22.568346 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.568320 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-668858dbc7-7wp8j_6d34e2ed-b066-4106-a582-9a90c7d0cbaf/router/0.log" Jun 09 14:14:22.862266 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.862189 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jf4fg_c578f83b-1d7a-4005-86bd-81363e3b25b6/kube-multus/0.log" Jun 09 14:14:22.914216 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.914183 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5rz5l_9d2e9f3f-f036-427f-85ac-33212870137f/network-metrics-daemon/0.log" Jun 09 14:14:22.939213 ip-10-0-136-4 kubenswrapper[2558]: I0609 14:14:22.939171 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5rz5l_9d2e9f3f-f036-427f-85ac-33212870137f/kube-rbac-proxy/0.log"